-- Logs begin at Mon 2022-08-01 14:26:22 UTC, end at Mon 2022-08-01 16:07:24 UTC. -- Aug 01 15:23:52.301350 dv-cinder-843277-7-smb systemd[1]: Starting Devstack devstack@keystone.service... Aug 01 15:23:52.310407 dv-cinder-843277-7-smb devstack@keystone.service[80338]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 01 15:23:52.312528 dv-cinder-843277-7-smb devstack@keystone.service[80338]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Aug 1 15:23:52 2022] *** Aug 01 15:23:52.312528 dv-cinder-843277-7-smb devstack@keystone.service[80338]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 01 15:23:52.312528 dv-cinder-843277-7-smb devstack@keystone.service[80338]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 01 15:23:52.312528 dv-cinder-843277-7-smb devstack@keystone.service[80338]: nodename: dv-cinder-843277-7-smb Aug 01 15:23:52.312528 dv-cinder-843277-7-smb devstack@keystone.service[80338]: machine: x86_64 Aug 01 15:23:52.312528 dv-cinder-843277-7-smb devstack@keystone.service[80338]: clock source: unix Aug 01 15:23:52.312528 dv-cinder-843277-7-smb devstack@keystone.service[80338]: pcre jit disabled Aug 01 15:23:52.312528 dv-cinder-843277-7-smb devstack@keystone.service[80338]: detected number of CPU cores: 4 Aug 01 15:23:52.312528 dv-cinder-843277-7-smb devstack@keystone.service[80338]: current working directory: / Aug 01 15:23:52.312528 dv-cinder-843277-7-smb devstack@keystone.service[80338]: detected binary path: /usr/bin/uwsgi-core Aug 01 15:23:52.313167 dv-cinder-843277-7-smb devstack@keystone.service[80338]: your processes number limit is 47680 Aug 01 15:23:52.313167 dv-cinder-843277-7-smb devstack@keystone.service[80338]: your memory page size is 4096 bytes Aug 01 15:23:52.313167 dv-cinder-843277-7-smb devstack@keystone.service[80338]: detected max file descriptor number: 2048 Aug 01 15:23:52.313167 dv-cinder-843277-7-smb devstack@keystone.service[80338]: lock engine: pthread robust mutexes Aug 01 15:23:52.313167 dv-cinder-843277-7-smb devstack@keystone.service[80338]: thunder lock: enabled Aug 01 15:23:52.313167 dv-cinder-843277-7-smb devstack@keystone.service[80338]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 01 15:23:52.313167 dv-cinder-843277-7-smb devstack@keystone.service[80338]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 01 15:23:52.352447 dv-cinder-843277-7-smb devstack@keystone.service[80338]: Python main interpreter initialized at 0x565454efd9c0 Aug 01 15:23:52.352447 dv-cinder-843277-7-smb devstack@keystone.service[80338]: python threads support enabled Aug 01 15:23:52.352447 dv-cinder-843277-7-smb devstack@keystone.service[80338]: your server socket listen backlog is limited to 100 connections Aug 01 15:23:52.352447 dv-cinder-843277-7-smb devstack@keystone.service[80338]: your mercy for graceful operations on workers is 90 seconds Aug 01 15:23:52.352805 dv-cinder-843277-7-smb devstack@keystone.service[80338]: mapped 403077 bytes (393 KB) for 2 cores Aug 01 15:23:52.352910 dv-cinder-843277-7-smb devstack@keystone.service[80338]: *** Operational MODE: preforking *** Aug 01 15:23:52.353155 dv-cinder-843277-7-smb devstack@keystone.service[80338]: *** uWSGI is running in multiple interpreter mode *** Aug 01 15:23:52.353155 dv-cinder-843277-7-smb devstack@keystone.service[80338]: spawned uWSGI master process (pid: 80338) Aug 01 15:23:52.353354 dv-cinder-843277-7-smb systemd[1]: Started Devstack devstack@keystone.service. Aug 01 15:23:52.356879 dv-cinder-843277-7-smb devstack@keystone.service[80338]: spawned uWSGI worker 1 (pid: 80352, cores: 1) Aug 01 15:23:52.356879 dv-cinder-843277-7-smb devstack@keystone.service[80338]: spawned uWSGI worker 2 (pid: 80353, cores: 1) Aug 01 15:23:52.356879 dv-cinder-843277-7-smb devstack@keystone.service[80338]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 01 15:23:57.967259 dv-cinder-843277-7-smb devstack@keystone.service[80352]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 01 15:23:57.967259 dv-cinder-843277-7-smb devstack@keystone.service[80352]: from cryptography.utils import int_from_bytes Aug 01 15:23:57.968081 dv-cinder-843277-7-smb devstack@keystone.service[80353]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 01 15:23:57.968081 dv-cinder-843277-7-smb devstack@keystone.service[80353]: from cryptography.utils import int_from_bytes Aug 01 15:23:57.968081 dv-cinder-843277-7-smb devstack@keystone.service[80353]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 01 15:23:57.968081 dv-cinder-843277-7-smb devstack@keystone.service[80353]: from cryptography.utils import int_from_bytes Aug 01 15:23:57.968622 dv-cinder-843277-7-smb devstack@keystone.service[80352]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 01 15:23:57.968622 dv-cinder-843277-7-smb devstack@keystone.service[80352]: from cryptography.utils import int_from_bytes Aug 01 15:23:58.017169 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 01 15:23:58.017340 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 01 15:23:58.017471 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 01 15:23:58.017616 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] command line args: [] {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 01 15:23:58.017712 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 01 15:23:58.017791 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 01 15:23:58.017871 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] command line args: [] {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 01 15:23:58.017951 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] ================================================================================ {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 01 15:23:58.018101 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 01 15:23:58.018195 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] admin_token = **** {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:23:58.018281 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] ================================================================================ {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 01 15:23:58.018418 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] config_dir = [] {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:23:58.018525 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] admin_token = **** {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:23:58.018603 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:23:58.018769 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] config_source = [] {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:23:58.018853 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] config_dir = [] {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:23:58.018941 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] debug = True {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:23:58.019011 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:23:58.019125 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] config_source = [] {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:23:58.019232 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:23:58.019449 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] debug = True {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:23:58.019527 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:23:58.019612 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:23:58.019672 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:23:58.019735 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:23:58.019953 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:23:58.020047 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:23:58.020115 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:23:58.020175 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:23:58.020362 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] list_limit = None {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:23:58.020446 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:23:58.020576 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] log_config_append = None {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:23:58.020664 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] list_limit = None {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:23:58.020731 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:23:58.020796 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] log_config_append = None {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:23:58.020882 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] log_dir = None {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:23:58.020947 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:23:58.021112 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] log_file = None {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:23:58.021206 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] log_dir = None {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:23:58.021269 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] log_file = None {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:23:58.021326 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:23:58.021486 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:23:58.021573 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:23:58.021739 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:23:58.021837 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:23:58.022003 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:23:58.022124 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:23:58.022201 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:23:58.022265 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:23:58.022340 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:23:58.022403 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:23:58.022560 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:23:58.022638 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:23:58.022796 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:23:58.022905 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:23:58.023068 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:23:58.023170 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:23:58.023246 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:23:58.023316 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:23:58.023471 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:23:58.023560 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:23:58.023725 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:23:58.023811 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:23:58.024517 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:23:58.024609 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:23:58.024764 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:23:58.024873 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:23:58.025053 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:23:58.025140 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:23:58.025335 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:23:58.025551 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.102/identity {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:23:58.025730 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] publish_errors = False {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:23:58.025816 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.102/identity {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:23:58.025960 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:23:58.026111 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] publish_errors = False {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:23:58.026188 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:23:58.026259 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:23:58.026386 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:23:58.026469 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:23:58.026580 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:23:58.026671 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:23:58.026813 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:23:58.026905 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:23:58.027046 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] standard_threads = False {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:23:58.027124 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:23:58.027275 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:23:58.027354 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] standard_threads = False {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:23:58.027506 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:23:58.027584 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:23:58.027676 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:23:58.027759 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:23:58.027844 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] use_journal = False {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:23:58.027916 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:23:58.028012 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] use_json = False {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:23:58.028091 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] use_journal = False {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:23:58.028184 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] use_stderr = False {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:23:58.028261 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] use_json = False {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:23:58.028344 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] use_syslog = False {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:23:58.028424 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] use_stderr = False {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:23:58.028558 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] use_syslog = False {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:23:58.028641 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:23:58.028791 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:23:58.028892 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.029071 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.029146 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.029301 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.029385 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.029544 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.029622 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.029793 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.029877 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.030030 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.030106 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.030264 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.030347 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.030519 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.030606 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.030739 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.030830 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.030987 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.031070 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.031233 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.031312 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.031465 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.031543 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.031706 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.031782 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.031940 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.032025 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.032180 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.032257 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.032426 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.032514 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.032665 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.032750 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.032928 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.033021 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.033189 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.033275 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.033435 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.033514 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.033672 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.033751 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.033906 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.033995 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.034162 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.034245 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.034413 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.034491 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.034662 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.034820 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.034901 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.034973 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.035113 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.035191 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.035342 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.035431 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.035572 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.035649 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.035810 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.035899 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.036054 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.036139 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.036284 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.036365 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.036513 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.036597 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.036742 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.036828 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.037019 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.037100 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.037257 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.037335 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.037494 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.037579 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.037724 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.037806 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.037959 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.038036 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.038193 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.038279 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.038429 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.038506 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.038662 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.038770 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.038890 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.039015 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.039121 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.039224 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.039365 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.039478 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.039606 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.039721 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.039859 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.039971 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.040085 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.040230 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.040319 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.040488 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.040569 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.040751 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.040834 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.041021 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.041099 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.041258 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.041349 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.041493 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.041615 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.041734 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.041820 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.041973 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.042063 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.042213 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.042293 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.042453 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.042580 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.042693 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.042781 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.042926 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.043005 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.043179 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.043260 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.043418 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.043507 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.043657 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.043779 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.043890 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.043979 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.044152 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.044241 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.044391 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.044472 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.044625 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.044707 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.044882 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.044978 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.045125 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.045204 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.045397 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.045475 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.045637 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.045725 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.045892 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.045969 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.046145 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.046223 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.046388 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.046548 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.046624 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.046717 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.046857 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.046960 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.047112 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.047204 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.047360 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.047482 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.047605 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.047749 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.047887 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.048034 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.048128 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.048316 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.048401 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.048558 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.048638 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.048801 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.048907 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.049069 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.049149 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.049324 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.049405 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.049579 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.049672 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.049823 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.049901 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.050064 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.050141 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.050301 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.050391 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.050542 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.050622 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.050780 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.050864 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.051019 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.051105 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.051255 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.051340 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.051486 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.051565 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.051720 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.051806 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.051950 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.052035 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.052181 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.052257 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.052413 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.052500 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.052657 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.052736 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.052920 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.053004 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.053164 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.053254 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.053403 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.053481 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.053663 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.053742 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.053912 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.054000 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.054149 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] auth.external = None {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.054228 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.054381 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] auth.external = None {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.054458 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.054616 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.054706 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.054903 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.054995 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.055140 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] auth.password = None {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.055222 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.055376 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] auth.token = None {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.055456 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] auth.password = None {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.055613 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] auth.token = None {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.055700 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.055851 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.055937 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.056090 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.056168 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.056328 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.056415 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.056563 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.056644 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.056815 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.056952 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.057073 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.057166 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.057316 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] credential.caching = True {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.057404 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.057556 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] credential.caching = True {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.057643 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.057808 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.057897 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.058056 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.058136 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.058295 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.058379 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.058535 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.058616 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.058772 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.058850 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.059010 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.059088 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.059278 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.059359 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.059522 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.059600 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.059763 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.059849 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.060020 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.060102 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.060291 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.060370 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.060538 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.060625 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.060777 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.060874 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.061066 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.061146 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.061313 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] federation.caching = True {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.061391 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.061557 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.061640 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] federation.caching = True {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.061800 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.061880 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.062052 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.062131 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.062289 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.062371 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.062519 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.062598 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.062770 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.062848 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.063008 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.063089 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.063259 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.063338 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.063497 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.063576 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.063746 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.063827 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.063987 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.064071 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.064226 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] identity.caching = True {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.064305 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.064477 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] identity.caching = True {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.064558 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.064727 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.064805 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.064991 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.065073 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.065231 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.065313 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.065480 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.065566 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.065715 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.065793 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.065958 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.066041 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.066215 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.066296 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.066472 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.066551 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.066711 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.066792 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.066946 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.067028 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.067179 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.067258 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.067416 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.067497 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.067664 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.067749 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.067913 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.067992 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.068165 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.068246 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.068412 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.068492 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.068661 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.068749 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.068941 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.069033 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.069184 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.069264 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.069423 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.069510 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.069661 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.069746 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.069895 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.069975 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.070131 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.070220 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.070374 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.070456 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.071118 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.071204 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.071372 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.071501 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.071607 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.071687 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.071857 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.071936 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.072109 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.072197 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.072347 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.072427 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.072597 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.072684 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.072905 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.073001 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.073101 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.073180 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.073339 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.073417 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.073571 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.073662 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.073804 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.073882 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.074041 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.074119 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.074279 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.074365 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.074520 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.074599 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.074760 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.074838 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.075001 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.075088 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.075251 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.075330 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.075487 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.075576 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.075722 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.075814 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.075952 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.076031 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.076203 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.076537 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.076697 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.076785 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.076960 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.077051 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.077198 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.077277 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.077433 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] ldap.user = None {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.077521 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.077664 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] ldap.user = None {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.077747 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.077908 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.077988 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.078150 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.078238 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.078390 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.078469 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.078638 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.078716 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.078886 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.078974 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.079124 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.079203 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.079362 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.079486 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.079596 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.079686 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.079830 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.079909 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.080062 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.080140 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.080294 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.080382 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.080524 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.080604 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.080775 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.080909 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.081050 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.081144 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.081302 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.081407 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.081656 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.081735 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.081890 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.081978 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.082133 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.082212 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.082373 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.082452 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.082612 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.082692 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.082849 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.082926 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.083085 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.083163 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.083327 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.083415 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.083577 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.083657 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.083815 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.083893 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.084057 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.084138 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.084298 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.084376 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.084539 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.084617 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.084767 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.084860 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.085026 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.085107 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.085265 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.085343 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.085507 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.085589 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.085749 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.085828 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.085984 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.086064 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.086308 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.086926 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.087126 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] resource.caching = True {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.087234 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.087384 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.087637 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.087725 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] resource.caching = True {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.087901 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.088129 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.088208 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.088395 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.088592 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.088680 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.088889 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.089087 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.089167 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.089360 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.089565 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.089661 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] role.caching = True {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.089832 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] role.driver = sql {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.090016 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.090096 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.090299 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.090465 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.090553 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.090782 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.090938 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.091021 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.091291 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.091399 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.091728 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.091865 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.092147 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] role.caching = True {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.092226 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.092412 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] role.driver = sql {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.092641 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.092730 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.092937 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.093105 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.093185 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.093536 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.093797 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.094054 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.094309 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.094527 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.094725 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.094809 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.094965 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.095058 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.095218 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.095299 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.095514 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.095773 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.096023 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.096179 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.096296 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.096541 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.096621 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.096803 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.097091 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.097173 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.097351 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.097581 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.097662 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.098007 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.098095 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.098248 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.098476 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.098556 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.098837 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.099082 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.099342 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.099605 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.099861 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.100217 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.100295 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.100511 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.100675 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.100778 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.100991 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.101074 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.101239 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] token.caching = True {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.101319 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.101485 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.101568 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.101738 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.101840 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.102021 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.102101 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.102281 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.102363 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.102886 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.102886 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.103077 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.103323 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.103574 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.103812 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.104052 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.104294 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.104375 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.104565 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.104655 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.104828 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.104927 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.105086 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.105167 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.105329 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.105423 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.105583 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.105662 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.105824 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.105904 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] database.connection = **** {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.106070 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] token.caching = True {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.106162 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.106317 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.106441 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.106652 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.106901 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.107220 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.107538 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.107830 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.108086 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.108340 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.108597 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.108916 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.109000 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.109228 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.109317 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.109485 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.109653 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.109734 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.109988 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.110251 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.110495 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.110747 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.111086 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.111357 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] database.connection = **** {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.111612 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.111869 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.112134 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.112216 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.112397 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.112595 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.112675 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.112916 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.113077 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.113265 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.113512 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.113756 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.114009 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.114286 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.114541 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.114782 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.115037 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.115360 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.115440 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.115618 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.115752 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.115882 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.116132 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.116213 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.116384 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.116463 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.116622 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.116705 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.116826 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 01 15:23:58.116938 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.117122 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:23:58.117293 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 01 15:23:58.147290 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80352) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 15:23:58.147424 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80353) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 15:23:58.147504 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80352) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 15:23:58.147626 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80353) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 15:23:58.147710 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80352) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 15:23:58.147851 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80353) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 15:23:58.156112 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80353) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 15:23:58.156259 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80352) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 15:23:58.186315 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80352) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 15:23:58.186515 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80353) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 15:23:58.186683 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80352) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 15:23:58.186819 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80353) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 15:23:58.239535 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80352) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 15:23:58.239737 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80353) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 15:23:58.291093 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80352) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 15:23:58.291261 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80353) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 15:23:58.291358 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80353) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 15:23:58.291438 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80352) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 15:23:58.356374 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80352) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 15:23:58.356523 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80353) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 15:23:58.356614 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80352) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 15:23:58.356709 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80353) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 15:23:58.356788 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80352) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 15:23:58.356948 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80353) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 15:23:58.357046 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80352) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 15:23:58.357167 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80353) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 15:23:58.357259 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80352) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 15:23:58.357441 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80352) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 15:23:58.357530 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80353) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 15:23:58.357655 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80353) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 15:23:58.383935 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80352) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 15:23:58.384160 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80352) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 15:23:58.384385 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80352) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 15:23:58.384609 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80352) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 15:23:58.384691 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80353) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 15:23:58.384829 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80352) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 15:23:58.384929 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80353) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 15:23:58.385067 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80352) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 15:23:58.385152 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80353) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 15:23:58.385278 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80352) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 15:23:58.385360 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80353) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 15:23:58.385567 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80353) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 15:23:58.385783 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80353) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 15:23:58.386042 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80353) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 15:23:58.396488 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80352) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 15:23:58.397032 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80353) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 15:23:58.409293 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80352) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 15:23:58.409525 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80352) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 15:23:58.409670 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80353) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 15:23:58.409754 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80352) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 15:23:58.409904 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80353) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 15:23:58.409985 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80352) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 15:23:58.410125 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80353) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 15:23:58.410216 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80352) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 15:23:58.410344 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80353) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 15:23:58.410433 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80352) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 15:23:58.410556 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80352) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 15:23:58.410637 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80353) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 15:23:58.410764 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80353) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 15:23:58.410976 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80353) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 15:23:58.427418 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:23:58.427629 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 01 15:23:58.427711 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:23:58.427893 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 01 15:23:58.427975 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:23:58.428152 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 01 15:23:58.428233 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:23:58.428405 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 01 15:23:58.428486 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:23:58.428668 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:23:58.428750 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:23:58.428949 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:23:58.429033 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:23:58.429205 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:23:58.429283 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:23:58.429455 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:23:58.439427 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:23:58.439705 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:23:58.439824 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:23:58.439975 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:23:58.440100 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:23:58.440255 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:23:58.440365 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:23:58.440646 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:23:58.447794 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80352) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 15:23:58.448270 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80353) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 15:23:58.452821 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80352) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 15:23:58.453157 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:23:58.453239 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80353) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 15:23:58.453467 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:23:58.453561 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:23:58.453743 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:23:58.453824 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:23:58.454022 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:23:58.454103 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:23:58.454301 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:23:58.454391 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:23:58.454559 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:23:58.454641 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:23:58.454825 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:23:58.454972 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:23:58.455096 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:23:58.455255 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:23:58.455365 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:23:58.455530 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:23:58.455635 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:23:58.455800 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:23:58.455882 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:23:58.479344 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:23:58.479716 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:23:58.480824 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80353) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 15:23:58.481123 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:23:58.481244 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80352) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 15:23:58.481525 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:23:58.485731 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80353) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 15:23:58.486009 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:23:58.486178 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80352) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 15:23:58.486273 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:23:58.486458 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:23:58.486738 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:23:58.493421 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80353) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 15:23:58.493699 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:23:58.494003 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80352) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 15:23:58.494287 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:23:58.497811 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80353) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 15:23:58.498096 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:23:58.498383 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:23:58.498580 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80352) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 15:23:58.498675 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:23:58.498868 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:23:58.498949 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:23:58.499159 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:23:58.499240 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:23:58.499451 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:23:58.499532 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:23:58.499724 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:23:58.499802 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:23:58.500005 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:23:58.500275 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:23:58.500553 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:23:58.515647 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:23:58.515923 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:23:58.516676 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:23:58.516980 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:23:58.519861 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80353) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 15:23:58.520930 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80352) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 15:23:58.523033 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:23:58.523325 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:23:58.524107 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:23:58.524404 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:23:58.527767 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80353) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 15:23:58.528832 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80352) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 15:23:58.530942 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80353) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 15:23:58.532100 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80352) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 15:23:58.534142 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:23:58.534441 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:23:58.534721 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:23:58.535013 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:23:58.535287 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:23:58.535381 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:23:58.535576 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:23:58.535659 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:23:58.535927 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:23:58.536224 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:23:58.536503 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:23:58.536793 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:23:58.552094 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80353) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 15:23:58.552382 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:23:58.552643 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:23:58.552974 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:23:58.553434 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80352) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 15:23:58.553731 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:23:58.554000 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:23:58.554263 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:23:58.560470 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:23:58.561819 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:23:58.562037 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:23:58.562311 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:23:58.563373 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:23:58.563649 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:23:58.565201 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80353) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 15:23:58.565480 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:23:58.565767 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:23:58.566049 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:23:58.566335 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:23:58.566548 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80352) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 15:23:58.566829 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:23:58.567120 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:23:58.567402 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:23:58.567688 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:23:58.578125 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80353) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 15:23:58.578403 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:23:58.578680 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:23:58.578958 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:23:58.579232 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:23:58.579446 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80352) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 15:23:58.579584 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:23:58.579710 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:23:58.579834 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:23:58.579991 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:23:58.580267 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:23:58.580544 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:23:58.580817 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:23:58.581118 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:23:58.595318 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80353) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 15:23:58.596775 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80352) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 15:23:58.598322 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80353) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 15:23:58.599776 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80352) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 15:23:58.601297 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:23:58.603349 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:23:58.604245 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:23:58.605837 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:23:58.605924 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80353) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 15:23:58.606165 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:23:58.606439 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:23:58.607373 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80352) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 15:23:58.607659 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:23:58.607940 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:23:58.612965 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:23:58.614452 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:23:58.614569 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80353) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 15:23:58.616061 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80352) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 15:23:58.617568 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:23:58.618415 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:23:58.618693 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:23:58.618967 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:23:58.619718 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:23:58.620011 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:23:58.620297 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:23:58.620572 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:23:58.627012 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80353) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 15:23:58.627295 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:23:58.627568 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:23:58.628658 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80352) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 15:23:58.628972 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:23:58.629268 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:23:58.634476 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80353) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 15:23:58.634749 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:23:58.635023 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:23:58.635303 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:23:58.635582 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:23:58.635860 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:23:58.636126 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:23:58.636209 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80352) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 15:23:58.636386 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:23:58.636467 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:23:58.636706 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:23:58.636794 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:23:58.637008 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:23:58.637091 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:23:58.637297 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:23:58.637436 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:23:58.637569 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:23:58.637665 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:23:58.637837 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:23:58.637921 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:23:58.638092 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:23:58.638174 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:23:58.638459 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:23:58.638750 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:23:58.639039 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:23:58.639307 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:23:58.639583 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:23:58.639844 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 15:23:58.677829 dv-cinder-843277-7-smb devstack@keystone.service[80353]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x565454efd9c0 pid: 80353 (default app) Aug 01 15:23:58.677943 dv-cinder-843277-7-smb devstack@keystone.service[80352]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x565454efd9c0 pid: 80352 (default app) Aug 01 15:23:58.678022 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62752727-5808-4c84-b7e9-408df062f37e None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:23:58.678022 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62752727-5808-4c84-b7e9-408df062f37e None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:23:58.678022 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62752727-5808-4c84-b7e9-408df062f37e None None] PATH_INFO: `/v3` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:23:58.680827 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1/1] 10.222.0.102 () {50 vars in 796 bytes} [Mon Aug 1 15:23:58 2022] GET /identity/v3/ => generated 256 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:07.248155 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75354564-1290-42a3-925b-45e02743256a None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:07.248676 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75354564-1290-42a3-925b-45e02743256a None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:07.248783 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75354564-1290-42a3-925b-45e02743256a None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:07.253151 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1/2] 10.222.0.102 () {54 vars in 931 bytes} [Mon Aug 1 15:24:07 2022] GET /identity => generated 271 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 01 15:24:07.258427 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bad60e9-d5ab-43b1-afcf-c1904252d290 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:07.258817 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bad60e9-d5ab-43b1-afcf-c1904252d290 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:07.258993 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bad60e9-d5ab-43b1-afcf-c1904252d290 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:07.330398 dv-cinder-843277-7-smb devstack@keystone.service[80353]: INFO dbcounter [None req-0bad60e9-d5ab-43b1-afcf-c1904252d290 None None] Registered counter for database keystone Aug 01 15:24:07.349750 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG oslo_db.sqlalchemy.engines [None req-0bad60e9-d5ab-43b1-afcf-c1904252d290 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80353) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 01 15:24:07.356652 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writer thread running {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 01 15:24:07.537166 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG passlib.handlers.bcrypt [None req-0bad60e9-d5ab-43b1-afcf-c1904252d290 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80353) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 01 15:24:07.537507 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG passlib.handlers.bcrypt [None req-0bad60e9-d5ab-43b1-afcf-c1904252d290 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80353) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 01 15:24:07.592781 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-0bad60e9-d5ab-43b1-afcf-c1904252d290 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:24:07.600537 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-0bad60e9-d5ab-43b1-afcf-c1904252d290 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:24:07.727229 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 2/3] 10.222.0.102 () {58 vars in 1028 bytes} [Mon Aug 1 15:24:07 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 470 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 01 15:24:07.868776 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75354564-1290-42a3-925b-45e02743256a None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:07.938133 dv-cinder-843277-7-smb devstack@keystone.service[80352]: INFO dbcounter [None req-75354564-1290-42a3-925b-45e02743256a None None] Registered counter for database keystone Aug 01 15:24:07.960280 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG oslo_db.sqlalchemy.engines [None req-75354564-1290-42a3-925b-45e02743256a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80352) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 01 15:24:07.966852 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writer thread running {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 01 15:24:08.089176 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75354564-1290-42a3-925b-45e02743256a None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:08.093547 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaa8d5c-f2a7-4c84-a42c-87a951118597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:08.094184 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaa8d5c-f2a7-4c84-a42c-87a951118597 admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:08.094468 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaa8d5c-f2a7-4c84-a42c-87a951118597 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:08.094744 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaa8d5c-f2a7-4c84-a42c-87a951118597 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:08.103126 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aaa8d5c-f2a7-4c84-a42c-87a951118597 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:08.155693 dv-cinder-843277-7-smb devstack@keystone.service[80352]: WARNING keystone.common.rbac_enforcer.enforcer [None req-2aaa8d5c-f2a7-4c84-a42c-87a951118597 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 01 15:24:08.156042 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aaa8d5c-f2a7-4c84-a42c-87a951118597 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:08.165996 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 2/4] 10.222.0.102 () {58 vars in 1329 bytes} [Mon Aug 1 15:24:07 2022] GET /identity/v3/auth/tokens => generated 915 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 01 15:24:08.172019 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bad60e9-d5ab-43b1-afcf-c1904252d290 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:08.187092 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bad60e9-d5ab-43b1-afcf-c1904252d290 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:08.191726 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58ea9f2-5792-4319-90a0-ab60e3124f5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:08.192835 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58ea9f2-5792-4319-90a0-ab60e3124f5e admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:08.193151 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58ea9f2-5792-4319-90a0-ab60e3124f5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:08.193470 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58ea9f2-5792-4319-90a0-ab60e3124f5e admin admin] PATH_INFO: `/v3/projects/fba62fb532fd40bd9b79f542e01e21d7` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:08.194960 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58ea9f2-5792-4319-90a0-ab60e3124f5e admin admin] RBAC: Authorizing `identity:get_project(project_id=fba62fb532fd40bd9b79f542e01e21d7)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:08.247909 dv-cinder-843277-7-smb devstack@keystone.service[80353]: WARNING keystone.common.rbac_enforcer.enforcer [None req-b58ea9f2-5792-4319-90a0-ab60e3124f5e admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 01 15:24:08.248257 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58ea9f2-5792-4319-90a0-ab60e3124f5e admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:08.252990 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 3/5] 10.222.0.102 () {56 vars in 1212 bytes} [Mon Aug 1 15:24:08 2022] GET /identity/v3/projects/fba62fb532fd40bd9b79f542e01e21d7 => generated 345 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:10.210598 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53f7f81-cdb8-4a25-8983-99e7f2ef414e None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:10.211178 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53f7f81-cdb8-4a25-8983-99e7f2ef414e None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:10.211178 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53f7f81-cdb8-4a25-8983-99e7f2ef414e None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:10.215812 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 3/6] 10.222.0.102 () {54 vars in 931 bytes} [Mon Aug 1 15:24:10 2022] GET /identity => generated 271 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 15:24:10.221649 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e19a00-3d32-4641-b2f2-d222467d2dd4 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:10.222255 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e19a00-3d32-4641-b2f2-d222467d2dd4 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:10.222255 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e19a00-3d32-4641-b2f2-d222467d2dd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:10.245288 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-f4e19a00-3d32-4641-b2f2-d222467d2dd4 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:24:10.246848 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-f4e19a00-3d32-4641-b2f2-d222467d2dd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:24:10.254869 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 4/7] 10.222.0.102 () {58 vars in 1028 bytes} [Mon Aug 1 15:24:10 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 01 15:24:10.277092 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53f7f81-cdb8-4a25-8983-99e7f2ef414e None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:10.289154 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53f7f81-cdb8-4a25-8983-99e7f2ef414e None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:10.294021 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c081d925-c499-4497-b11c-e012d06409cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:10.294621 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c081d925-c499-4497-b11c-e012d06409cf admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:10.294902 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c081d925-c499-4497-b11c-e012d06409cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:10.295174 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c081d925-c499-4497-b11c-e012d06409cf admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:10.303011 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c081d925-c499-4497-b11c-e012d06409cf admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:10.304793 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c081d925-c499-4497-b11c-e012d06409cf admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:10.313534 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 4/8] 10.222.0.102 () {58 vars in 1329 bytes} [Mon Aug 1 15:24:10 2022] GET /identity/v3/auth/tokens => generated 915 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 01 15:24:10.318689 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e19a00-3d32-4641-b2f2-d222467d2dd4 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:10.328002 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e19a00-3d32-4641-b2f2-d222467d2dd4 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:10.332363 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d78be9c-32c2-4594-99a5-038a2f374060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:10.333032 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d78be9c-32c2-4594-99a5-038a2f374060 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:10.333316 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d78be9c-32c2-4594-99a5-038a2f374060 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:10.333593 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d78be9c-32c2-4594-99a5-038a2f374060 admin admin] PATH_INFO: `/v3/users/b6b2cd3e98284877b95b595df909c37d` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:10.334962 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d78be9c-32c2-4594-99a5-038a2f374060 admin admin] RBAC: Authorizing `identity:get_user(user_id=b6b2cd3e98284877b95b595df909c37d)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:10.337353 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d78be9c-32c2-4594-99a5-038a2f374060 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:10.339021 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 5/9] 10.222.0.102 () {56 vars in 1203 bytes} [Mon Aug 1 15:24:10 2022] GET /identity/v3/users/b6b2cd3e98284877b95b595df909c37d => generated 248 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:12.374046 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebc99f4-6886-4d4d-914f-b1754c166ddb None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:12.374581 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebc99f4-6886-4d4d-914f-b1754c166ddb None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:12.374676 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebc99f4-6886-4d4d-914f-b1754c166ddb None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:12.375963 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 5/10] 10.222.0.102 () {54 vars in 931 bytes} [Mon Aug 1 15:24:12 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 15:24:12.381095 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee8345d-9c35-4481-9a54-4fb159d7a310 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:12.381505 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee8345d-9c35-4481-9a54-4fb159d7a310 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:12.381780 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee8345d-9c35-4481-9a54-4fb159d7a310 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:12.391453 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b164d3d-4212-4e40-84a3-b903b3ed026b None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:12.391736 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b164d3d-4212-4e40-84a3-b903b3ed026b None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:12.392011 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b164d3d-4212-4e40-84a3-b903b3ed026b None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:12.393384 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 6/11] 10.222.0.102 () {54 vars in 931 bytes} [Mon Aug 1 15:24:12 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 01 15:24:12.398666 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7149c8c7-acfa-4f08-958d-2eacc4c5e9ae None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:12.399440 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7149c8c7-acfa-4f08-958d-2eacc4c5e9ae None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:12.399713 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7149c8c7-acfa-4f08-958d-2eacc4c5e9ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:12.401690 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-9ee8345d-9c35-4481-9a54-4fb159d7a310 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:24:12.402887 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-9ee8345d-9c35-4481-9a54-4fb159d7a310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:24:12.441779 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG passlib.handlers.bcrypt [None req-7149c8c7-acfa-4f08-958d-2eacc4c5e9ae None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80352) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 01 15:24:12.442197 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG passlib.handlers.bcrypt [None req-7149c8c7-acfa-4f08-958d-2eacc4c5e9ae None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80352) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 01 15:24:12.482568 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 6/12] 10.222.0.102 () {58 vars in 1028 bytes} [Mon Aug 1 15:24:12 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 15:24:12.488247 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-7149c8c7-acfa-4f08-958d-2eacc4c5e9ae None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:24:12.489934 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-7149c8c7-acfa-4f08-958d-2eacc4c5e9ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:24:12.504828 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee8345d-9c35-4481-9a54-4fb159d7a310 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:12.528254 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:12.590578 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 7/13] 10.222.0.102 () {58 vars in 1028 bytes} [Mon Aug 1 15:24:12 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 01 15:24:12.609969 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee8345d-9c35-4481-9a54-4fb159d7a310 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:12.612876 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7149c8c7-acfa-4f08-958d-2eacc4c5e9ae None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:12.644284 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cddbf8c-8036-46b8-8c52-8aa8b559e5f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:12.644909 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cddbf8c-8036-46b8-8c52-8aa8b559e5f6 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:12.645196 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cddbf8c-8036-46b8-8c52-8aa8b559e5f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:12.645476 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cddbf8c-8036-46b8-8c52-8aa8b559e5f6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:12.657603 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cddbf8c-8036-46b8-8c52-8aa8b559e5f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:24:12.666888 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-0cddbf8c-8036-46b8-8c52-8aa8b559e5f6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 15:24:12.666888 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:24:12.666888 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:24:12.666888 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:24:12.666888 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:24:12.666888 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:24:12.666888 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:24:12.666888 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:24:12.666888 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:24:12.666888 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:24:12.666888 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:24:12.666888 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:24:12.666888 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:24:12.666888 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:24:12.666888 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:24:12.666888 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:24:12.667831 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:24:12.667831 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:24:12.667831 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:24:12.667831 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:24:12.667831 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:24:12.667831 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:24:12.667831 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:24:12.667831 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:24:12.667831 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:24:12.667831 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:24:12.667831 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:24:12.667831 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 01 15:24:12.667831 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:24:12.667831 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:24:12.667831 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:24:12.667831 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:24:12.668679 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:24:12.668679 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:24:12.668679 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:24:12.668679 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:24:12.668679 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:24:12.668679 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:24:12.668679 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:24:12.668679 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:24:12.668679 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:24:12.668679 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:24:12.668679 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 15:24:12.668679 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 01 15:24:12.668679 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 7/14] 10.222.0.102 () {56 vars in 1101 bytes} [Mon Aug 1 15:24:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 15:24:12.673944 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cddbf8c-8036-46b8-8c52-8aa8b559e5f6 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:12.716676 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7149c8c7-acfa-4f08-958d-2eacc4c5e9ae None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:12.719367 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:12.753143 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fbfbe0-6d98-4eda-aac7-481f82fff268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:12.754006 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fbfbe0-6d98-4eda-aac7-481f82fff268 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:12.754288 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fbfbe0-6d98-4eda-aac7-481f82fff268 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:12.754565 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fbfbe0-6d98-4eda-aac7-481f82fff268 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:12.754859 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:12.773362 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cddbf8c-8036-46b8-8c52-8aa8b559e5f6 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:12.806500 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a73315e-5db0-41f7-b3c2-3756e7595f0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:12.807118 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a73315e-5db0-41f7-b3c2-3756e7595f0e None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:12.807400 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a73315e-5db0-41f7-b3c2-3756e7595f0e None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:12.807676 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a73315e-5db0-41f7-b3c2-3756e7595f0e None admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:12.808397 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a73315e-5db0-41f7-b3c2-3756e7595f0e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:12.808703 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a73315e-5db0-41f7-b3c2-3756e7595f0e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:12.810133 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a73315e-5db0-41f7-b3c2-3756e7595f0e None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:12.822278 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 8/15] 10.222.0.102 () {56 vars in 1104 bytes} [Mon Aug 1 15:24:12 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:24:12.824820 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fbfbe0-6d98-4eda-aac7-481f82fff268 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:12.826785 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fbfbe0-6d98-4eda-aac7-481f82fff268 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:12.828129 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a73315e-5db0-41f7-b3c2-3756e7595f0e None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:12.927119 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 8/16] 10.222.0.102 () {58 vars in 1287 bytes} [Mon Aug 1 15:24:12 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 01 15:24:12.932696 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fbfbe0-6d98-4eda-aac7-481f82fff268 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:12.934519 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a73315e-5db0-41f7-b3c2-3756e7595f0e None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:12.935348 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:12.970890 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4527763e-fba0-4970-8d1d-33ae80c26276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:12.971533 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4527763e-fba0-4970-8d1d-33ae80c26276 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:12.971813 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4527763e-fba0-4970-8d1d-33ae80c26276 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:12.972089 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4527763e-fba0-4970-8d1d-33ae80c26276 None admin] PATH_INFO: `/v3/users/b6b2cd3e98284877b95b595df909c37d` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:12.973374 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4527763e-fba0-4970-8d1d-33ae80c26276 None admin] RBAC: Authorizing `identity:get_user(user_id=b6b2cd3e98284877b95b595df909c37d)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:12.974833 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4527763e-fba0-4970-8d1d-33ae80c26276 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:12.976482 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 9/17] 10.222.0.102 () {56 vars in 1182 bytes} [Mon Aug 1 15:24:12 2022] GET /identity/v3/users/b6b2cd3e98284877b95b595df909c37d => generated 248 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:24:12.981870 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4527763e-fba0-4970-8d1d-33ae80c26276 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:12.996038 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:13.035080 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fbfbe0-6d98-4eda-aac7-481f82fff268 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:13.072667 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403dc68e-cf9f-4394-87cf-fe0df8d7759a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:13.073609 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403dc68e-cf9f-4394-87cf-fe0df8d7759a None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:13.073886 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403dc68e-cf9f-4394-87cf-fe0df8d7759a None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:13.074155 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403dc68e-cf9f-4394-87cf-fe0df8d7759a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:13.095512 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403dc68e-cf9f-4394-87cf-fe0df8d7759a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:13.097045 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403dc68e-cf9f-4394-87cf-fe0df8d7759a None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:13.116582 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-403dc68e-cf9f-4394-87cf-fe0df8d7759a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:24:13.116582 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:24:13.116582 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:24:13.116582 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:24:13.116582 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:24:13.116582 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:24:13.116582 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:24:13.116582 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:24:13.116582 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:24:13.116582 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:24:13.116582 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:24:13.116582 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:24:13.116582 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:24:13.116582 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:24:13.116582 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:24:13.118123 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:24:13.118123 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:24:13.118123 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:24:13.118123 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:24:13.118123 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:24:13.118123 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:24:13.118123 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:24:13.118123 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:24:13.118123 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 01 15:24:13.118123 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:24:13.118123 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:24:13.118123 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:24:13.118123 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:24:13.118123 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:24:13.118123 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:24:13.118123 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:24:13.118123 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:24:13.118918 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:24:13.118918 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:24:13.118918 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:24:13.118918 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 01 15:24:13.118918 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 9/18] 10.222.0.102 () {56 vars in 1113 bytes} [Mon Aug 1 15:24:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 15:24:13.124293 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403dc68e-cf9f-4394-87cf-fe0df8d7759a None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:13.181234 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:13.188702 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4527763e-fba0-4970-8d1d-33ae80c26276 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:13.222498 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfeb3000-2aa0-4cbc-8f94-b2d90756f7ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:13.223203 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeb3000-2aa0-4cbc-8f94-b2d90756f7ea None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:13.223495 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeb3000-2aa0-4cbc-8f94-b2d90756f7ea None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:13.223795 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeb3000-2aa0-4cbc-8f94-b2d90756f7ea None admin] PATH_INFO: `/v3/domains/default` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:13.225048 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfeb3000-2aa0-4cbc-8f94-b2d90756f7ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:13.225741 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403dc68e-cf9f-4394-87cf-fe0df8d7759a None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:13.226512 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfeb3000-2aa0-4cbc-8f94-b2d90756f7ea None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:13.228193 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 10/19] 10.222.0.102 () {56 vars in 1113 bytes} [Mon Aug 1 15:24:12 2022] GET /identity/v3/domains/default => generated 200 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:24:13.234049 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfeb3000-2aa0-4cbc-8f94-b2d90756f7ea None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:13.260295 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab2bc54-809e-44df-a8c2-7ec03f634f7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:13.260937 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab2bc54-809e-44df-a8c2-7ec03f634f7c None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:13.261219 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab2bc54-809e-44df-a8c2-7ec03f634f7c None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:13.261487 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab2bc54-809e-44df-a8c2-7ec03f634f7c None admin] PATH_INFO: `/v3/domains` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:13.262172 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab2bc54-809e-44df-a8c2-7ec03f634f7c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:13.262473 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab2bc54-809e-44df-a8c2-7ec03f634f7c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:13.263863 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab2bc54-809e-44df-a8c2-7ec03f634f7c None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:13.281023 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 10/20] 10.222.0.102 () {56 vars in 1114 bytes} [Mon Aug 1 15:24:13 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:24:13.317513 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:13.338672 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfeb3000-2aa0-4cbc-8f94-b2d90756f7ea None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:13.374012 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5eb4c51-9c7f-495c-ac64-3908cc2b769b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:13.374651 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5eb4c51-9c7f-495c-ac64-3908cc2b769b None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:13.374939 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5eb4c51-9c7f-495c-ac64-3908cc2b769b None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:13.375209 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5eb4c51-9c7f-495c-ac64-3908cc2b769b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:13.376009 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5eb4c51-9c7f-495c-ac64-3908cc2b769b None admin] RBAC: Adding query filter params (role.id=de1374f966c04c27b579515b54334fd2, scope.domain.id=default, user.id=b6b2cd3e98284877b95b595df909c37d) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:13.376315 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5eb4c51-9c7f-495c-ac64-3908cc2b769b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:13.377799 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5eb4c51-9c7f-495c-ac64-3908cc2b769b None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:13.385831 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 11/21] 10.222.0.102 () {56 vars in 1327 bytes} [Mon Aug 1 15:24:13 2022] GET /identity/v3/role_assignments?user.id=b6b2cd3e98284877b95b595df909c37d&scope.domain.id=default&role.id=de1374f966c04c27b579515b54334fd2 => generated 234 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:24:15.736938 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab126acc-e9ee-4c19-b7c4-f2154a9a8277 None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:15.737450 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab126acc-e9ee-4c19-b7c4-f2154a9a8277 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:15.737866 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab126acc-e9ee-4c19-b7c4-f2154a9a8277 None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:15.740098 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 11/22] 10.222.0.102 () {54 vars in 931 bytes} [Mon Aug 1 15:24:15 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 15:24:15.745853 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a5cac5-4034-4bf8-82f4-0a5f76a636b7 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:15.746272 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a5cac5-4034-4bf8-82f4-0a5f76a636b7 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:15.746444 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a5cac5-4034-4bf8-82f4-0a5f76a636b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:15.773140 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-73a5cac5-4034-4bf8-82f4-0a5f76a636b7 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:24:15.774930 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-73a5cac5-4034-4bf8-82f4-0a5f76a636b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:24:15.792764 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3938e60-83a4-407d-8203-1d8e92643af2 None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:15.793118 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3938e60-83a4-407d-8203-1d8e92643af2 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:15.793430 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3938e60-83a4-407d-8203-1d8e92643af2 None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:15.794798 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 12/23] 10.222.0.102 () {54 vars in 931 bytes} [Mon Aug 1 15:24:15 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 01 15:24:15.816035 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1458e9ab-de78-43b2-9cc1-3c53c1d19b55 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:15.816360 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1458e9ab-de78-43b2-9cc1-3c53c1d19b55 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:15.816677 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1458e9ab-de78-43b2-9cc1-3c53c1d19b55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:15.848200 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-1458e9ab-de78-43b2-9cc1-3c53c1d19b55 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:24:15.849589 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-1458e9ab-de78-43b2-9cc1-3c53c1d19b55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:24:15.914235 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 12/24] 10.222.0.102 () {58 vars in 1028 bytes} [Mon Aug 1 15:24:15 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 15:24:15.955545 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a5cac5-4034-4bf8-82f4-0a5f76a636b7 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:16.003262 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 13/25] 10.222.0.102 () {58 vars in 1028 bytes} [Mon Aug 1 15:24:15 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 01 15:24:16.006550 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63865e17-0396-4510-94bb-1eebce3bdee3 None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:16.006844 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63865e17-0396-4510-94bb-1eebce3bdee3 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:16.007126 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63865e17-0396-4510-94bb-1eebce3bdee3 None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:16.008981 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 14/26] 10.222.0.102 () {54 vars in 931 bytes} [Mon Aug 1 15:24:16 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 01 15:24:16.013973 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc620e3-7ec0-4fad-99ed-a180bb10e9cc None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:16.014480 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc620e3-7ec0-4fad-99ed-a180bb10e9cc None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:16.014982 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc620e3-7ec0-4fad-99ed-a180bb10e9cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:16.049960 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-9dc620e3-7ec0-4fad-99ed-a180bb10e9cc None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:24:16.051544 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-9dc620e3-7ec0-4fad-99ed-a180bb10e9cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:24:16.107701 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:16.126113 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:16.156303 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a5cac5-4034-4bf8-82f4-0a5f76a636b7 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:16.174289 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 15/27] 10.222.0.102 () {58 vars in 1028 bytes} [Mon Aug 1 15:24:16 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 15:24:16.175284 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc620e3-7ec0-4fad-99ed-a180bb10e9cc None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:16.221865 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376340e2-9a05-481d-b58a-b2cbe32e5441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:16.222520 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376340e2-9a05-481d-b58a-b2cbe32e5441 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:16.222806 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376340e2-9a05-481d-b58a-b2cbe32e5441 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:16.223081 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376340e2-9a05-481d-b58a-b2cbe32e5441 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:16.241759 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376340e2-9a05-481d-b58a-b2cbe32e5441 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:24:16.246848 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-376340e2-9a05-481d-b58a-b2cbe32e5441 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 15:24:16.246848 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:24:16.246848 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:24:16.246848 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:24:16.246848 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:24:16.246848 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:24:16.246848 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:24:16.246848 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:24:16.246848 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:24:16.246848 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:24:16.246848 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:24:16.246848 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:24:16.246848 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:24:16.246848 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:24:16.246848 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:24:16.246848 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:24:16.247689 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:24:16.247689 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:24:16.247689 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:24:16.247689 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:24:16.247689 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:24:16.247689 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:24:16.247689 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:24:16.247689 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:24:16.247689 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:24:16.247689 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:24:16.247689 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:24:16.247689 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 01 15:24:16.247689 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:24:16.247689 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:24:16.247689 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:24:16.247689 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:24:16.248464 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:24:16.248464 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:24:16.248464 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:24:16.248464 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:24:16.248464 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:24:16.248464 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:24:16.248464 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:24:16.248464 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:24:16.248464 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:24:16.248464 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:24:16.248464 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 15:24:16.248464 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 01 15:24:16.248464 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 13/28] 10.222.0.102 () {56 vars in 1101 bytes} [Mon Aug 1 15:24:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 15:24:16.249137 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376340e2-9a05-481d-b58a-b2cbe32e5441 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:16.309649 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc620e3-7ec0-4fad-99ed-a180bb10e9cc None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:16.438637 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376340e2-9a05-481d-b58a-b2cbe32e5441 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:16.477849 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70463d5a-d76a-455c-80af-73855ae7cbb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:16.478482 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70463d5a-d76a-455c-80af-73855ae7cbb9 None admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:16.478762 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70463d5a-d76a-455c-80af-73855ae7cbb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:16.479031 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70463d5a-d76a-455c-80af-73855ae7cbb9 None admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:16.479749 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70463d5a-d76a-455c-80af-73855ae7cbb9 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:16.481182 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70463d5a-d76a-455c-80af-73855ae7cbb9 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:16.485279 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:16.511060 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bf7607-8bb3-47a1-a6ec-c39dc508c6fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:16.511709 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bf7607-8bb3-47a1-a6ec-c39dc508c6fc None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:16.511991 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bf7607-8bb3-47a1-a6ec-c39dc508c6fc None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:16.512270 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bf7607-8bb3-47a1-a6ec-c39dc508c6fc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:16.522719 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bf7607-8bb3-47a1-a6ec-c39dc508c6fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:16.524787 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bf7607-8bb3-47a1-a6ec-c39dc508c6fc None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:16.539677 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-81bf7607-8bb3-47a1-a6ec-c39dc508c6fc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:24:16.539677 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:24:16.539677 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:24:16.539677 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:24:16.539677 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:24:16.539677 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:24:16.539677 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:24:16.539677 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:24:16.539677 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:24:16.539677 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:24:16.539677 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:24:16.539677 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:24:16.539677 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:24:16.539677 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:24:16.539677 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:24:16.540475 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:24:16.540475 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:24:16.540475 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:24:16.540475 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:24:16.540475 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:24:16.540475 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:24:16.540475 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:24:16.540475 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:24:16.540475 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 01 15:24:16.540475 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:24:16.540475 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:24:16.540475 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:24:16.540475 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:24:16.540475 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:24:16.540475 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:24:16.540475 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:24:16.540475 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:24:16.541634 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:24:16.541634 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:24:16.541634 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:24:16.541634 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 01 15:24:16.545691 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 16/29] 10.222.0.102 () {56 vars in 1113 bytes} [Mon Aug 1 15:24:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 366 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:24:16.546553 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bf7607-8bb3-47a1-a6ec-c39dc508c6fc None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:16.576673 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:16.653279 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bf7607-8bb3-47a1-a6ec-c39dc508c6fc None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:16.673669 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 14/30] 10.222.0.102 () {60 vars in 1136 bytes} [Mon Aug 1 15:24:16 2022] POST /identity/v3/roles => generated 226 bytes in 425 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:24:16.676003 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04c09d4-b116-4b7f-8e8b-30de3cbfd0fa None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:16.676498 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04c09d4-b116-4b7f-8e8b-30de3cbfd0fa None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:16.677609 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04c09d4-b116-4b7f-8e8b-30de3cbfd0fa None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:16.679342 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 15/31] 10.222.0.102 () {54 vars in 931 bytes} [Mon Aug 1 15:24:16 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 15:24:16.684820 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04c09d4-b116-4b7f-8e8b-30de3cbfd0fa None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:16.714955 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afc5a5e-ef4c-4d2b-8b70-cb4292ef6318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:16.715561 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afc5a5e-ef4c-4d2b-8b70-cb4292ef6318 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:16.715850 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afc5a5e-ef4c-4d2b-8b70-cb4292ef6318 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:16.716124 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afc5a5e-ef4c-4d2b-8b70-cb4292ef6318 None admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:16.717086 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afc5a5e-ef4c-4d2b-8b70-cb4292ef6318 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:16.717291 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afc5a5e-ef4c-4d2b-8b70-cb4292ef6318 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:16.718671 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afc5a5e-ef4c-4d2b-8b70-cb4292ef6318 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:16.732967 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 17/32] 10.222.0.102 () {56 vars in 1104 bytes} [Mon Aug 1 15:24:16 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:16.734298 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462ac3d5-cd1c-4673-82a5-2f5917c2390a None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:16.734589 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462ac3d5-cd1c-4673-82a5-2f5917c2390a None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:16.734855 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462ac3d5-cd1c-4673-82a5-2f5917c2390a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:16.767319 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-462ac3d5-cd1c-4673-82a5-2f5917c2390a None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:24:16.770284 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-462ac3d5-cd1c-4673-82a5-2f5917c2390a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:24:16.875047 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04c09d4-b116-4b7f-8e8b-30de3cbfd0fa None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:16.921796 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 18/33] 10.222.0.102 () {58 vars in 1028 bytes} [Mon Aug 1 15:24:16 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 15:24:16.923103 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462ac3d5-cd1c-4673-82a5-2f5917c2390a None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:16.924484 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34eb130-d423-4c99-bdc1-64c903e04379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:16.925259 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34eb130-d423-4c99-bdc1-64c903e04379 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:16.925619 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34eb130-d423-4c99-bdc1-64c903e04379 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:16.925973 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34eb130-d423-4c99-bdc1-64c903e04379 None admin] PATH_INFO: `/v3/domains` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:16.926762 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34eb130-d423-4c99-bdc1-64c903e04379 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:16.927572 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34eb130-d423-4c99-bdc1-64c903e04379 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:16.930521 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34eb130-d423-4c99-bdc1-64c903e04379 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:16.953743 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:16.955936 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 16/34] 10.222.0.102 () {56 vars in 1114 bytes} [Mon Aug 1 15:24:16 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:16.956875 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34eb130-d423-4c99-bdc1-64c903e04379 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:17.028315 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:17.069534 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462ac3d5-cd1c-4673-82a5-2f5917c2390a None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:17.084612 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34eb130-d423-4c99-bdc1-64c903e04379 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:17.107211 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0d273a-8706-4685-bf52-efbb71be6dd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:17.108298 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0d273a-8706-4685-bf52-efbb71be6dd0 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:17.108592 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0d273a-8706-4685-bf52-efbb71be6dd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:17.108896 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0d273a-8706-4685-bf52-efbb71be6dd0 None admin] PATH_INFO: `/v3/users/b6b2cd3e98284877b95b595df909c37d` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:17.110466 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0d273a-8706-4685-bf52-efbb71be6dd0 None admin] RBAC: Authorizing `identity:get_user(user_id=b6b2cd3e98284877b95b595df909c37d)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:17.111923 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0d273a-8706-4685-bf52-efbb71be6dd0 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:17.113579 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 19/35] 10.222.0.102 () {56 vars in 1182 bytes} [Mon Aug 1 15:24:16 2022] GET /identity/v3/users/b6b2cd3e98284877b95b595df909c37d => generated 248 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:17.114339 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0d273a-8706-4685-bf52-efbb71be6dd0 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:17.123403 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef94c84b-d2c0-4267-a2d6-9aaf48595b67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:17.124043 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef94c84b-d2c0-4267-a2d6-9aaf48595b67 None admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:17.124329 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef94c84b-d2c0-4267-a2d6-9aaf48595b67 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:17.124608 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef94c84b-d2c0-4267-a2d6-9aaf48595b67 None admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:17.125436 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef94c84b-d2c0-4267-a2d6-9aaf48595b67 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:17.126785 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef94c84b-d2c0-4267-a2d6-9aaf48595b67 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:17.188341 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 17/36] 10.222.0.102 () {60 vars in 1136 bytes} [Mon Aug 1 15:24:16 2022] POST /identity/v3/roles => generated 220 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:24:17.189925 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70402e54-b834-4fc2-adb6-a289b17d317d None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:17.197195 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70402e54-b834-4fc2-adb6-a289b17d317d None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:17.197195 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70402e54-b834-4fc2-adb6-a289b17d317d None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:17.197195 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 18/37] 10.222.0.102 () {54 vars in 931 bytes} [Mon Aug 1 15:24:17 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 15:24:17.197195 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70402e54-b834-4fc2-adb6-a289b17d317d None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:17.216263 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:17.231206 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0d273a-8706-4685-bf52-efbb71be6dd0 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:17.272759 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49f8592-5178-4804-ba5b-132c436a374e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:17.273603 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49f8592-5178-4804-ba5b-132c436a374e None admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:17.273985 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49f8592-5178-4804-ba5b-132c436a374e None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:17.274327 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49f8592-5178-4804-ba5b-132c436a374e None admin] PATH_INFO: `/v3/projects` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:17.275098 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49f8592-5178-4804-ba5b-132c436a374e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:17.276876 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49f8592-5178-4804-ba5b-132c436a374e None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:17.333861 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70402e54-b834-4fc2-adb6-a289b17d317d None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:17.348578 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:17.369244 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0372509-cd05-476d-945b-ed1b0114d38b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:17.369893 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0372509-cd05-476d-945b-ed1b0114d38b None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:17.370170 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0372509-cd05-476d-945b-ed1b0114d38b None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:17.370440 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0372509-cd05-476d-945b-ed1b0114d38b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:17.371725 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0372509-cd05-476d-945b-ed1b0114d38b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:17.373211 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0372509-cd05-476d-945b-ed1b0114d38b None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:17.374790 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 19/38] 10.222.0.102 () {56 vars in 1113 bytes} [Mon Aug 1 15:24:17 2022] GET /identity/v3/domains/default => generated 200 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:17.376103 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b66cd6-62a3-46a6-9991-94d5d8e90e6e None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:17.376385 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b66cd6-62a3-46a6-9991-94d5d8e90e6e None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:17.376668 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b66cd6-62a3-46a6-9991-94d5d8e90e6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:17.395005 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-c3b66cd6-62a3-46a6-9991-94d5d8e90e6e None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:24:17.396558 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-c3b66cd6-62a3-46a6-9991-94d5d8e90e6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:24:17.463911 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 20/39] 10.222.0.102 () {58 vars in 1028 bytes} [Mon Aug 1 15:24:17 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 15:24:17.465229 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994dd3f1-71ce-4030-9dd1-24328fa232c2 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:17.465520 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994dd3f1-71ce-4030-9dd1-24328fa232c2 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:17.465794 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994dd3f1-71ce-4030-9dd1-24328fa232c2 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:17.468872 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 21/40] 10.222.0.102 () {54 vars in 931 bytes} [Mon Aug 1 15:24:17 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 15:24:17.468872 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994dd3f1-71ce-4030-9dd1-24328fa232c2 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:17.508029 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 20/41] 10.222.0.102 () {60 vars in 1146 bytes} [Mon Aug 1 15:24:17 2022] POST /identity/v3/projects => generated 302 bytes in 394 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:24:17.509674 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1243b0-b4c0-4f07-9041-d1cb85d3ff0b None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:17.509966 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1243b0-b4c0-4f07-9041-d1cb85d3ff0b None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:17.510294 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1243b0-b4c0-4f07-9041-d1cb85d3ff0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:17.537630 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-9a1243b0-b4c0-4f07-9041-d1cb85d3ff0b None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:24:17.539236 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-9a1243b0-b4c0-4f07-9041-d1cb85d3ff0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:24:17.587342 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994dd3f1-71ce-4030-9dd1-24328fa232c2 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:17.604004 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:17.628969 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 21/42] 10.222.0.102 () {58 vars in 1028 bytes} [Mon Aug 1 15:24:17 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 15:24:17.628969 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1243b0-b4c0-4f07-9041-d1cb85d3ff0b None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:17.635362 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241c9e3f-94c4-4122-8c5b-63476461fe53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:17.636135 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241c9e3f-94c4-4122-8c5b-63476461fe53 None admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:17.636428 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241c9e3f-94c4-4122-8c5b-63476461fe53 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:17.636713 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241c9e3f-94c4-4122-8c5b-63476461fe53 None admin] PATH_INFO: `/v3/domains/default/users/b6b2cd3e98284877b95b595df909c37d/roles/de1374f966c04c27b579515b54334fd2` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:17.639185 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241c9e3f-94c4-4122-8c5b-63476461fe53 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=b6b2cd3e98284877b95b595df909c37d, role_id=de1374f966c04c27b579515b54334fd2)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:17.640709 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241c9e3f-94c4-4122-8c5b-63476461fe53 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:17.705483 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:17.736728 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1243b0-b4c0-4f07-9041-d1cb85d3ff0b None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:17.737555 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 22/43] 10.222.0.102 () {58 vars in 1366 bytes} [Mon Aug 1 15:24:17 2022] PUT /identity/v3/domains/default/users/b6b2cd3e98284877b95b595df909c37d/roles/de1374f966c04c27b579515b54334fd2 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:24:17.738453 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241c9e3f-94c4-4122-8c5b-63476461fe53 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:17.776474 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef844d69-c947-46b9-ab2d-1569347e61e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:17.777936 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef844d69-c947-46b9-ab2d-1569347e61e9 None admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:17.778222 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef844d69-c947-46b9-ab2d-1569347e61e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:17.778496 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef844d69-c947-46b9-ab2d-1569347e61e9 None admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:17.779231 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef844d69-c947-46b9-ab2d-1569347e61e9 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:17.780804 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef844d69-c947-46b9-ab2d-1569347e61e9 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:17.858449 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241c9e3f-94c4-4122-8c5b-63476461fe53 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:17.897709 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 22/44] 10.222.0.102 () {60 vars in 1136 bytes} [Mon Aug 1 15:24:17 2022] POST /identity/v3/roles => generated 224 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:24:17.902566 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba16e19f-efd9-4e44-bffc-aaf0c70c61f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:17.903293 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba16e19f-efd9-4e44-bffc-aaf0c70c61f7 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:17.903531 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba16e19f-efd9-4e44-bffc-aaf0c70c61f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:17.903807 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba16e19f-efd9-4e44-bffc-aaf0c70c61f7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:17.905533 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba16e19f-efd9-4e44-bffc-aaf0c70c61f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:17.907081 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba16e19f-efd9-4e44-bffc-aaf0c70c61f7 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:17.908871 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 23/45] 10.222.0.102 () {56 vars in 1113 bytes} [Mon Aug 1 15:24:17 2022] GET /identity/v3/domains/default => generated 200 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:17.915474 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef844d69-c947-46b9-ab2d-1569347e61e9 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:18.029933 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef844d69-c947-46b9-ab2d-1569347e61e9 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:18.061965 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:18.068893 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f0bcae-55d8-415c-a91e-4c450ce02f87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:18.069533 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f0bcae-55d8-415c-a91e-4c450ce02f87 None admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:18.069971 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f0bcae-55d8-415c-a91e-4c450ce02f87 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:18.070247 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f0bcae-55d8-415c-a91e-4c450ce02f87 None admin] PATH_INFO: `/v3/projects` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:18.071513 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f0bcae-55d8-415c-a91e-4c450ce02f87 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:18.073047 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f0bcae-55d8-415c-a91e-4c450ce02f87 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:18.144600 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 23/46] 10.222.0.102 () {60 vars in 1146 bytes} [Mon Aug 1 15:24:17 2022] POST /identity/v3/projects => generated 313 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:24:19.775971 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b4de64-26b2-4197-a938-87295493ce43 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:19.776487 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b4de64-26b2-4197-a938-87295493ce43 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:19.776569 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b4de64-26b2-4197-a938-87295493ce43 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:19.777901 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 24/47] 10.222.0.102 () {54 vars in 931 bytes} [Mon Aug 1 15:24:19 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 15:24:19.783129 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0af4f93-461b-4464-bbec-600a28fb6849 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:19.783526 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0af4f93-461b-4464-bbec-600a28fb6849 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:19.783700 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0af4f93-461b-4464-bbec-600a28fb6849 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:19.801486 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-d0af4f93-461b-4464-bbec-600a28fb6849 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:24:19.802735 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-d0af4f93-461b-4464-bbec-600a28fb6849 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:24:19.869442 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 24/48] 10.222.0.102 () {58 vars in 1028 bytes} [Mon Aug 1 15:24:19 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 15:24:19.893464 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b4de64-26b2-4197-a938-87295493ce43 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:19.935910 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:19.994509 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b4de64-26b2-4197-a938-87295493ce43 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:20.027875 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cab4123-0b75-41c5-8180-f41dae2a716b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:20.028438 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cab4123-0b75-41c5-8180-f41dae2a716b None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:20.028723 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cab4123-0b75-41c5-8180-f41dae2a716b None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:20.029037 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cab4123-0b75-41c5-8180-f41dae2a716b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:20.038939 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cab4123-0b75-41c5-8180-f41dae2a716b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:24:20.044381 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-3cab4123-0b75-41c5-8180-f41dae2a716b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 15:24:20.044381 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:24:20.044381 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:24:20.044381 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:24:20.044381 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:24:20.044381 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:24:20.044381 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:24:20.044381 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:24:20.044381 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:24:20.044381 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:24:20.044381 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:24:20.044381 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:24:20.044381 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:24:20.044381 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:24:20.044381 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:24:20.044381 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:24:20.045242 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:24:20.045242 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:24:20.045242 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:24:20.045242 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:24:20.045242 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:24:20.045242 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:24:20.045242 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:24:20.045242 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:24:20.045242 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:24:20.045242 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:24:20.045242 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:24:20.045242 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 01 15:24:20.045242 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:24:20.045242 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:24:20.045242 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:24:20.045242 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:24:20.046136 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:24:20.046136 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:24:20.046136 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:24:20.046136 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:24:20.046136 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:24:20.046136 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:24:20.046136 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:24:20.046136 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:24:20.046136 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:24:20.046136 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:24:20.046136 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 15:24:20.046136 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 01 15:24:20.046136 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 25/49] 10.222.0.102 () {56 vars in 1101 bytes} [Mon Aug 1 15:24:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:24:20.051551 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0af4f93-461b-4464-bbec-600a28fb6849 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:20.135101 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32de7cde-9dfa-4b1b-9dca-2d8746e43356 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:20.135396 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32de7cde-9dfa-4b1b-9dca-2d8746e43356 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:20.135677 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32de7cde-9dfa-4b1b-9dca-2d8746e43356 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:20.137061 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 26/50] 10.222.0.102 () {54 vars in 931 bytes} [Mon Aug 1 15:24:20 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 01 15:24:20.141748 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c4961b-6271-409c-b21c-fa75867138f5 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:20.142041 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c4961b-6271-409c-b21c-fa75867138f5 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:20.142320 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c4961b-6271-409c-b21c-fa75867138f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:20.152035 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0af4f93-461b-4464-bbec-600a28fb6849 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:20.159974 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-c0c4961b-6271-409c-b21c-fa75867138f5 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:24:20.161230 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-c0c4961b-6271-409c-b21c-fa75867138f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:24:20.166188 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:20.192767 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd8bb24-9d06-4d4b-81b0-0a5a130572ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:20.193415 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd8bb24-9d06-4d4b-81b0-0a5a130572ab None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:20.193703 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd8bb24-9d06-4d4b-81b0-0a5a130572ab None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:20.193980 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd8bb24-9d06-4d4b-81b0-0a5a130572ab None admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:20.194702 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd8bb24-9d06-4d4b-81b0-0a5a130572ab None admin] RBAC: Adding query filter params (name=admin) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:20.195009 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd8bb24-9d06-4d4b-81b0-0a5a130572ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:20.196990 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd8bb24-9d06-4d4b-81b0-0a5a130572ab None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:20.206254 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 25/51] 10.222.0.102 () {56 vars in 1104 bytes} [Mon Aug 1 15:24:20 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:20.211741 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd8bb24-9d06-4d4b-81b0-0a5a130572ab None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:20.232231 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 27/52] 10.222.0.102 () {58 vars in 1028 bytes} [Mon Aug 1 15:24:20 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 01 15:24:20.255381 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c4961b-6271-409c-b21c-fa75867138f5 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:20.284950 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:20.312762 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd8bb24-9d06-4d4b-81b0-0a5a130572ab None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:20.346037 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583f094e-6b0d-47ec-8c9f-c5d39f1552c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:20.346676 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583f094e-6b0d-47ec-8c9f-c5d39f1552c8 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:20.346964 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583f094e-6b0d-47ec-8c9f-c5d39f1552c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:20.347237 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583f094e-6b0d-47ec-8c9f-c5d39f1552c8 None admin] PATH_INFO: `/v3/users/b6b2cd3e98284877b95b595df909c37d` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:20.348437 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583f094e-6b0d-47ec-8c9f-c5d39f1552c8 None admin] RBAC: Authorizing `identity:get_user(user_id=b6b2cd3e98284877b95b595df909c37d)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:20.349960 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583f094e-6b0d-47ec-8c9f-c5d39f1552c8 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:20.351572 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 26/53] 10.222.0.102 () {56 vars in 1182 bytes} [Mon Aug 1 15:24:20 2022] GET /identity/v3/users/b6b2cd3e98284877b95b595df909c37d => generated 248 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:24:20.356625 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c4961b-6271-409c-b21c-fa75867138f5 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:20.357510 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583f094e-6b0d-47ec-8c9f-c5d39f1552c8 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:20.390729 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5c6f13-bc30-4332-b094-59708242dda3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:20.391365 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5c6f13-bc30-4332-b094-59708242dda3 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:20.391644 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5c6f13-bc30-4332-b094-59708242dda3 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:20.391917 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5c6f13-bc30-4332-b094-59708242dda3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:20.393134 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5c6f13-bc30-4332-b094-59708242dda3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:20.394585 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5c6f13-bc30-4332-b094-59708242dda3 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:20.396167 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 28/54] 10.222.0.102 () {56 vars in 1113 bytes} [Mon Aug 1 15:24:20 2022] GET /identity/v3/domains/default => generated 200 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:24:20.399505 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:20.401679 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5c6f13-bc30-4332-b094-59708242dda3 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:20.455930 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583f094e-6b0d-47ec-8c9f-c5d39f1552c8 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:20.488654 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8279badd-35ce-4d5c-ab96-037a17f18699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:20.489305 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8279badd-35ce-4d5c-ab96-037a17f18699 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:20.489585 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8279badd-35ce-4d5c-ab96-037a17f18699 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:20.489863 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8279badd-35ce-4d5c-ab96-037a17f18699 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:20.491006 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8279badd-35ce-4d5c-ab96-037a17f18699 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:20.492481 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8279badd-35ce-4d5c-ab96-037a17f18699 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:20.494632 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 27/55] 10.222.0.102 () {56 vars in 1113 bytes} [Mon Aug 1 15:24:20 2022] GET /identity/v3/domains/default => generated 200 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:24:20.496595 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:20.500368 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5c6f13-bc30-4332-b094-59708242dda3 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:20.500482 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8279badd-35ce-4d5c-ab96-037a17f18699 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:20.532910 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfb067b-72ec-4343-9e2f-f15f70c795e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:20.533527 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfb067b-72ec-4343-9e2f-f15f70c795e8 None admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:20.533807 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfb067b-72ec-4343-9e2f-f15f70c795e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:20.534082 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfb067b-72ec-4343-9e2f-f15f70c795e8 None admin] PATH_INFO: `/v3/projects` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:20.534775 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfb067b-72ec-4343-9e2f-f15f70c795e8 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:20.536307 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfb067b-72ec-4343-9e2f-f15f70c795e8 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:20.599195 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8279badd-35ce-4d5c-ab96-037a17f18699 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:20.609826 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:20.618802 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 29/56] 10.222.0.102 () {60 vars in 1145 bytes} [Mon Aug 1 15:24:20 2022] POST /identity/v3/projects => generated 299 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 15:24:20.633283 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a63f60c-d516-4ee8-a8b6-0362499346da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:20.633922 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a63f60c-d516-4ee8-a8b6-0362499346da None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:20.634203 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a63f60c-d516-4ee8-a8b6-0362499346da None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:20.634476 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a63f60c-d516-4ee8-a8b6-0362499346da None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:20.635289 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a63f60c-d516-4ee8-a8b6-0362499346da None admin] RBAC: Adding query filter params (role.id=de1374f966c04c27b579515b54334fd2, scope.domain.id=default, user.id=b6b2cd3e98284877b95b595df909c37d) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:20.635600 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a63f60c-d516-4ee8-a8b6-0362499346da None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:20.637152 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a63f60c-d516-4ee8-a8b6-0362499346da None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:20.648128 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 28/57] 10.222.0.102 () {56 vars in 1327 bytes} [Mon Aug 1 15:24:20 2022] GET /identity/v3/role_assignments?user.id=b6b2cd3e98284877b95b595df909c37d&scope.domain.id=default&role.id=de1374f966c04c27b579515b54334fd2 => generated 532 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:24:22.631494 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7fd64f-35e3-4282-b0e8-ca4440ee4a2e None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:22.632035 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7fd64f-35e3-4282-b0e8-ca4440ee4a2e None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:22.632035 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7fd64f-35e3-4282-b0e8-ca4440ee4a2e None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:22.633975 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 30/58] 10.222.0.102 () {54 vars in 931 bytes} [Mon Aug 1 15:24:22 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 15:24:22.639140 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7462af0b-e336-4542-8587-0eb0d220a5e1 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:22.639575 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7462af0b-e336-4542-8587-0eb0d220a5e1 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:22.639848 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7462af0b-e336-4542-8587-0eb0d220a5e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:22.658095 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-7462af0b-e336-4542-8587-0eb0d220a5e1 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:24:22.659275 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-7462af0b-e336-4542-8587-0eb0d220a5e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:24:22.723719 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 29/59] 10.222.0.102 () {58 vars in 1028 bytes} [Mon Aug 1 15:24:22 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 15:24:22.746811 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7fd64f-35e3-4282-b0e8-ca4440ee4a2e None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:22.845743 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7fd64f-35e3-4282-b0e8-ca4440ee4a2e None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:22.879277 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36079a73-6fb1-4830-8de9-215b42179c97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:22.879923 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36079a73-6fb1-4830-8de9-215b42179c97 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:22.880234 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36079a73-6fb1-4830-8de9-215b42179c97 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:22.880512 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36079a73-6fb1-4830-8de9-215b42179c97 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:22.881764 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36079a73-6fb1-4830-8de9-215b42179c97 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:22.883780 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36079a73-6fb1-4830-8de9-215b42179c97 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:22.885431 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 31/60] 10.222.0.102 () {56 vars in 1113 bytes} [Mon Aug 1 15:24:22 2022] GET /identity/v3/domains/default => generated 200 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:22.891045 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7462af0b-e336-4542-8587-0eb0d220a5e1 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:22.988055 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7462af0b-e336-4542-8587-0eb0d220a5e1 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:22.990385 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:23.021536 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb5bcde-c6d3-4a87-a661-691ca7d7faf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:23.022144 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb5bcde-c6d3-4a87-a661-691ca7d7faf8 None admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:23.022425 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb5bcde-c6d3-4a87-a661-691ca7d7faf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:23.022699 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb5bcde-c6d3-4a87-a661-691ca7d7faf8 None admin] PATH_INFO: `/v3/users` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:23.023390 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb5bcde-c6d3-4a87-a661-691ca7d7faf8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:23.024885 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb5bcde-c6d3-4a87-a661-691ca7d7faf8 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:23.113882 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 30/61] 10.222.0.102 () {60 vars in 1137 bytes} [Mon Aug 1 15:24:22 2022] POST /identity/v3/users => generated 276 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:24:26.259030 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2528d05-6544-488b-98f3-6c975ba4de74 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:26.259556 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2528d05-6544-488b-98f3-6c975ba4de74 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:26.259556 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2528d05-6544-488b-98f3-6c975ba4de74 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:26.260955 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 32/62] 10.222.0.102 () {54 vars in 931 bytes} [Mon Aug 1 15:24:26 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 15:24:26.266412 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccb0db8-e563-4707-a20e-2a80d8942141 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:26.267286 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccb0db8-e563-4707-a20e-2a80d8942141 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:26.267764 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccb0db8-e563-4707-a20e-2a80d8942141 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:26.293879 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-8ccb0db8-e563-4707-a20e-2a80d8942141 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:24:26.295424 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-8ccb0db8-e563-4707-a20e-2a80d8942141 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:24:26.300697 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b12cb8-138a-4b3d-9aa0-a0511425e1a8 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:26.301026 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b12cb8-138a-4b3d-9aa0-a0511425e1a8 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:26.301305 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b12cb8-138a-4b3d-9aa0-a0511425e1a8 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:26.302964 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 33/63] 10.222.0.102 () {54 vars in 931 bytes} [Mon Aug 1 15:24:26 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 15:24:26.318428 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4353a2-875e-4156-a327-bae6926149ed None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:26.318713 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4353a2-875e-4156-a327-bae6926149ed None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:26.318993 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4353a2-875e-4156-a327-bae6926149ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:26.353124 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-ba4353a2-875e-4156-a327-bae6926149ed None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:24:26.361464 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-ba4353a2-875e-4156-a327-bae6926149ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:24:26.386597 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:26.408475 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 31/64] 10.222.0.102 () {58 vars in 1028 bytes} [Mon Aug 1 15:24:26 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 15:24:26.431315 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccb0db8-e563-4707-a20e-2a80d8942141 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:26.502393 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 34/65] 10.222.0.102 () {58 vars in 1028 bytes} [Mon Aug 1 15:24:26 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 01 15:24:26.533351 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:26.543247 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccb0db8-e563-4707-a20e-2a80d8942141 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:26.549061 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4353a2-875e-4156-a327-bae6926149ed None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:26.583029 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7477675-314b-4360-994f-49008703ad14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:26.583689 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7477675-314b-4360-994f-49008703ad14 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:26.583973 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7477675-314b-4360-994f-49008703ad14 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:26.584248 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7477675-314b-4360-994f-49008703ad14 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:26.597987 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7477675-314b-4360-994f-49008703ad14 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:24:26.606861 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-e7477675-314b-4360-994f-49008703ad14 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 01 15:24:26.606861 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:24:26.606861 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:24:26.606861 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:24:26.606861 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:24:26.606861 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:24:26.606861 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:24:26.606861 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:24:26.606861 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:24:26.606861 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:24:26.606861 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:24:26.606861 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:24:26.606861 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:24:26.606861 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:24:26.606861 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:24:26.606861 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:24:26.607766 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:24:26.607766 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:24:26.607766 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:24:26.607766 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:24:26.607766 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:24:26.607766 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:24:26.607766 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:24:26.607766 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:24:26.607766 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:24:26.607766 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:24:26.607766 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:24:26.607766 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 01 15:24:26.607766 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:24:26.607766 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:24:26.607766 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:24:26.607766 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:24:26.608528 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:24:26.608528 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:24:26.608528 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:24:26.608528 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:24:26.608528 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:24:26.608528 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:24:26.608528 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:24:26.608528 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:24:26.608528 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:24:26.608528 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:24:26.608528 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 01 15:24:26.608528 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 01 15:24:26.608528 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 32/66] 10.222.0.102 () {56 vars in 1104 bytes} [Mon Aug 1 15:24:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 15:24:26.614457 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7477675-314b-4360-994f-49008703ad14 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:26.712969 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4353a2-875e-4156-a327-bae6926149ed None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:26.734076 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7477675-314b-4360-994f-49008703ad14 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:26.747689 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98c4f93-3837-4533-9e70-2e2b0ecfcaf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:26.748340 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98c4f93-3837-4533-9e70-2e2b0ecfcaf2 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:26.748667 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98c4f93-3837-4533-9e70-2e2b0ecfcaf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:26.749007 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98c4f93-3837-4533-9e70-2e2b0ecfcaf2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:26.760411 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98c4f93-3837-4533-9e70-2e2b0ecfcaf2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:24:26.765438 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-e98c4f93-3837-4533-9e70-2e2b0ecfcaf2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 15:24:26.765438 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:24:26.765438 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:24:26.765438 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:24:26.765438 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:24:26.765438 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:24:26.765438 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:24:26.765438 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:24:26.765438 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:24:26.765438 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:24:26.765438 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:24:26.765438 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:24:26.765438 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:24:26.765438 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:24:26.765438 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:24:26.765438 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:24:26.766311 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:24:26.766311 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:24:26.766311 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:24:26.766311 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:24:26.766311 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:24:26.766311 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:24:26.766311 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:24:26.766311 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:24:26.766311 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:24:26.766311 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:24:26.766311 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:24:26.766311 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 01 15:24:26.766311 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:24:26.766311 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:24:26.766311 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:24:26.766311 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:24:26.771667 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:24:26.771667 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:24:26.771667 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:24:26.771667 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:24:26.771667 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:24:26.771667 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:24:26.771667 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:24:26.771667 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:24:26.771667 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:24:26.771667 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:24:26.771667 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 15:24:26.771667 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 01 15:24:26.771667 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 35/67] 10.222.0.102 () {56 vars in 1101 bytes} [Mon Aug 1 15:24:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:24:26.771667 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624fa416-a3f7-486e-9df3-939ddc120cc4 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:26.772356 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624fa416-a3f7-486e-9df3-939ddc120cc4 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:26.772356 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624fa416-a3f7-486e-9df3-939ddc120cc4 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:26.772356 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 36/68] 10.222.0.102 () {54 vars in 931 bytes} [Mon Aug 1 15:24:26 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 15:24:26.775320 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1d769f-2925-4e3b-a3eb-518c613357b5 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:26.775604 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1d769f-2925-4e3b-a3eb-518c613357b5 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:26.775880 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1d769f-2925-4e3b-a3eb-518c613357b5 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:26.777328 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 37/69] 10.222.0.102 () {54 vars in 931 bytes} [Mon Aug 1 15:24:26 2022] GET /identity => generated 271 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 15:24:26.777825 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1d769f-2925-4e3b-a3eb-518c613357b5 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:26.781764 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe6088f-f6a2-42d3-a84a-9f9c4adce8bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:26.782417 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe6088f-f6a2-42d3-a84a-9f9c4adce8bb None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:26.782703 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe6088f-f6a2-42d3-a84a-9f9c4adce8bb None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:26.782977 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe6088f-f6a2-42d3-a84a-9f9c4adce8bb None admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:26.783761 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe6088f-f6a2-42d3-a84a-9f9c4adce8bb None admin] RBAC: Adding query filter params (name=member) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:26.784023 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe6088f-f6a2-42d3-a84a-9f9c4adce8bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:26.785483 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe6088f-f6a2-42d3-a84a-9f9c4adce8bb None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:26.788964 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:26.795095 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 33/70] 10.222.0.102 () {56 vars in 1106 bytes} [Mon Aug 1 15:24:26 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:24:26.796296 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab01925-bde6-4194-b289-8e75047afcd2 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:26.796591 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab01925-bde6-4194-b289-8e75047afcd2 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:26.800266 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab01925-bde6-4194-b289-8e75047afcd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:26.814999 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-7ab01925-bde6-4194-b289-8e75047afcd2 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:24:26.816207 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-7ab01925-bde6-4194-b289-8e75047afcd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:24:26.824237 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:26.881919 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1d769f-2925-4e3b-a3eb-518c613357b5 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:26.882807 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 34/71] 10.222.0.102 () {58 vars in 1028 bytes} [Mon Aug 1 15:24:26 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 15:24:26.884791 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e9fef0-000d-46f9-9d18-987c1c6fbc1d None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:26.885110 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e9fef0-000d-46f9-9d18-987c1c6fbc1d None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:26.885387 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e9fef0-000d-46f9-9d18-987c1c6fbc1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:26.904664 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-d0e9fef0-000d-46f9-9d18-987c1c6fbc1d None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:24:26.905884 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-d0e9fef0-000d-46f9-9d18-987c1c6fbc1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:24:26.925955 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823837f0-0e84-4083-affc-e02fdcafad24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:26.926584 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823837f0-0e84-4083-affc-e02fdcafad24 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:26.926866 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823837f0-0e84-4083-affc-e02fdcafad24 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:26.927140 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823837f0-0e84-4083-affc-e02fdcafad24 None admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:26.927856 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823837f0-0e84-4083-affc-e02fdcafad24 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:26.928162 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823837f0-0e84-4083-affc-e02fdcafad24 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:26.929584 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823837f0-0e84-4083-affc-e02fdcafad24 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:26.938315 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 38/72] 10.222.0.102 () {56 vars in 1104 bytes} [Mon Aug 1 15:24:26 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:26.939486 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d0ec76-e2ad-4d68-a941-d3a38feb67eb None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:26.939780 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d0ec76-e2ad-4d68-a941-d3a38feb67eb None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:26.940058 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d0ec76-e2ad-4d68-a941-d3a38feb67eb None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:26.941611 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 39/73] 10.222.0.102 () {54 vars in 931 bytes} [Mon Aug 1 15:24:26 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 15:24:26.942511 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d0ec76-e2ad-4d68-a941-d3a38feb67eb None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:26.978916 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 35/74] 10.222.0.102 () {58 vars in 1028 bytes} [Mon Aug 1 15:24:26 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 15:24:26.979964 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e9fef0-000d-46f9-9d18-987c1c6fbc1d None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:27.014165 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:27.045859 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d0ec76-e2ad-4d68-a941-d3a38feb67eb None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:27.050829 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:27.079955 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147cb1f4-5bab-4a57-a266-4f23a6f9369b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:27.080595 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147cb1f4-5bab-4a57-a266-4f23a6f9369b None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:27.080816 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e9fef0-000d-46f9-9d18-987c1c6fbc1d None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:27.080960 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147cb1f4-5bab-4a57-a266-4f23a6f9369b None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:27.081241 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147cb1f4-5bab-4a57-a266-4f23a6f9369b None admin] PATH_INFO: `/v3/users/d63a704c427d4f18a40f7ba2bdc48254` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:27.095532 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147cb1f4-5bab-4a57-a266-4f23a6f9369b None admin] RBAC: Authorizing `identity:get_user(user_id=d63a704c427d4f18a40f7ba2bdc48254)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:27.097020 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147cb1f4-5bab-4a57-a266-4f23a6f9369b None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:27.098665 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 40/75] 10.222.0.102 () {56 vars in 1182 bytes} [Mon Aug 1 15:24:26 2022] GET /identity/v3/users/d63a704c427d4f18a40f7ba2bdc48254 => generated 276 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:27.099428 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147cb1f4-5bab-4a57-a266-4f23a6f9369b None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:27.116133 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b8fcd2-669d-41b8-891a-26bb4f1dff11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:27.116885 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b8fcd2-669d-41b8-891a-26bb4f1dff11 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:27.117182 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b8fcd2-669d-41b8-891a-26bb4f1dff11 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:27.117462 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b8fcd2-669d-41b8-891a-26bb4f1dff11 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:27.127571 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b8fcd2-669d-41b8-891a-26bb4f1dff11 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:24:27.132975 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-a3b8fcd2-669d-41b8-891a-26bb4f1dff11 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 01 15:24:27.132975 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:24:27.132975 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:24:27.132975 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:24:27.132975 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:24:27.132975 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:24:27.132975 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:24:27.132975 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:24:27.132975 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:24:27.132975 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:24:27.132975 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:24:27.132975 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:24:27.132975 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:24:27.132975 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:24:27.132975 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:24:27.132975 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:24:27.134423 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:24:27.134423 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:24:27.134423 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:24:27.134423 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:24:27.134423 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:24:27.134423 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:24:27.134423 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:24:27.134423 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:24:27.134423 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:24:27.134423 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:24:27.134423 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:24:27.134423 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 01 15:24:27.134423 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:24:27.134423 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:24:27.134423 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:24:27.134423 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:24:27.135197 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:24:27.135197 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:24:27.135197 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:24:27.135197 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:24:27.135197 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:24:27.135197 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:24:27.135197 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:24:27.135197 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:24:27.135197 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:24:27.135197 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:24:27.135197 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 01 15:24:27.135197 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 01 15:24:27.135197 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 36/76] 10.222.0.102 () {56 vars in 1119 bytes} [Mon Aug 1 15:24:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:24:27.136444 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b140d38-e6ff-43c4-ab34-22cc875ce538 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:27.136444 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b140d38-e6ff-43c4-ab34-22cc875ce538 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:27.136715 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b140d38-e6ff-43c4-ab34-22cc875ce538 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:27.154176 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-8b140d38-e6ff-43c4-ab34-22cc875ce538 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:24:27.155361 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-8b140d38-e6ff-43c4-ab34-22cc875ce538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:24:27.198724 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147cb1f4-5bab-4a57-a266-4f23a6f9369b None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:27.222381 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 37/77] 10.222.0.102 () {58 vars in 1028 bytes} [Mon Aug 1 15:24:27 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 15:24:27.223210 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b140d38-e6ff-43c4-ab34-22cc875ce538 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:27.225492 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:27.240401 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29664ef3-d4c5-439c-91d1-7a4228f6d5e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:27.241353 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29664ef3-d4c5-439c-91d1-7a4228f6d5e9 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:27.241637 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29664ef3-d4c5-439c-91d1-7a4228f6d5e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:27.241908 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29664ef3-d4c5-439c-91d1-7a4228f6d5e9 None admin] PATH_INFO: `/v3/users/b6b2cd3e98284877b95b595df909c37d` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:27.243086 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29664ef3-d4c5-439c-91d1-7a4228f6d5e9 None admin] RBAC: Authorizing `identity:get_user(user_id=b6b2cd3e98284877b95b595df909c37d)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:27.245242 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29664ef3-d4c5-439c-91d1-7a4228f6d5e9 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:27.246741 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 41/78] 10.222.0.102 () {56 vars in 1182 bytes} [Mon Aug 1 15:24:27 2022] GET /identity/v3/users/b6b2cd3e98284877b95b595df909c37d => generated 248 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:27.247354 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29664ef3-d4c5-439c-91d1-7a4228f6d5e9 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:27.284278 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:27.323478 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b140d38-e6ff-43c4-ab34-22cc875ce538 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:27.347503 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29664ef3-d4c5-439c-91d1-7a4228f6d5e9 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:27.356787 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a8f7d0-5db4-4de3-a7d8-093e9d2fef4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:27.357447 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a8f7d0-5db4-4de3-a7d8-093e9d2fef4f None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:27.357732 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a8f7d0-5db4-4de3-a7d8-093e9d2fef4f None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:27.358010 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a8f7d0-5db4-4de3-a7d8-093e9d2fef4f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:27.368479 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a8f7d0-5db4-4de3-a7d8-093e9d2fef4f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:24:27.374115 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-f8a8f7d0-5db4-4de3-a7d8-093e9d2fef4f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 01 15:24:27.374115 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:24:27.374115 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:24:27.374115 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:24:27.374115 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:24:27.374115 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:24:27.374115 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:24:27.374115 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:24:27.374115 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:24:27.374115 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:24:27.374115 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:24:27.374115 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:24:27.374115 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:24:27.374115 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:24:27.374115 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:24:27.374115 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:24:27.374966 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:24:27.374966 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:24:27.374966 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:24:27.374966 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:24:27.374966 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:24:27.374966 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:24:27.374966 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:24:27.374966 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:24:27.374966 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:24:27.374966 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:24:27.374966 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:24:27.374966 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 01 15:24:27.374966 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:24:27.374966 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:24:27.374966 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:24:27.374966 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:24:27.375728 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:24:27.375728 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:24:27.375728 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:24:27.375728 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:24:27.375728 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:24:27.375728 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:24:27.375728 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:24:27.375728 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:24:27.375728 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:24:27.375728 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:24:27.375728 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 01 15:24:27.375728 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 01 15:24:27.375728 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 38/79] 10.222.0.102 () {56 vars in 1104 bytes} [Mon Aug 1 15:24:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:24:27.376396 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a8f7d0-5db4-4de3-a7d8-093e9d2fef4f None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:27.387244 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e046901b-9a73-4766-95dd-ef210da6264a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:27.387875 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e046901b-9a73-4766-95dd-ef210da6264a None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:27.388161 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e046901b-9a73-4766-95dd-ef210da6264a None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:27.388438 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e046901b-9a73-4766-95dd-ef210da6264a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:27.449346 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:27.455983 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e046901b-9a73-4766-95dd-ef210da6264a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:27.457502 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e046901b-9a73-4766-95dd-ef210da6264a None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:27.475828 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a8f7d0-5db4-4de3-a7d8-093e9d2fef4f None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:27.498310 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:27.509329 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5739de-99c0-47f9-a1b3-4ef972f63a2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:27.509949 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5739de-99c0-47f9-a1b3-4ef972f63a2f None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:27.510232 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5739de-99c0-47f9-a1b3-4ef972f63a2f None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:27.510508 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5739de-99c0-47f9-a1b3-4ef972f63a2f None admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:27.511221 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5739de-99c0-47f9-a1b3-4ef972f63a2f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:27.511528 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5739de-99c0-47f9-a1b3-4ef972f63a2f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:27.512951 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5739de-99c0-47f9-a1b3-4ef972f63a2f None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:27.521295 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 39/80] 10.222.0.102 () {56 vars in 1116 bytes} [Mon Aug 1 15:24:27 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:27.526391 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5739de-99c0-47f9-a1b3-4ef972f63a2f None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:27.558974 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 42/81] 10.222.0.102 () {58 vars in 1287 bytes} [Mon Aug 1 15:24:27 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 15:24:27.560028 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e046901b-9a73-4766-95dd-ef210da6264a None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:27.626871 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5739de-99c0-47f9-a1b3-4ef972f63a2f None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:27.651251 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:27.656735 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e046901b-9a73-4766-95dd-ef210da6264a None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:27.660166 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8962713-9127-4985-8d59-220bcf15fcf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:27.660805 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8962713-9127-4985-8d59-220bcf15fcf8 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:27.661209 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8962713-9127-4985-8d59-220bcf15fcf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:27.661491 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8962713-9127-4985-8d59-220bcf15fcf8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:27.662662 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8962713-9127-4985-8d59-220bcf15fcf8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:27.664138 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8962713-9127-4985-8d59-220bcf15fcf8 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:27.666320 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 40/82] 10.222.0.102 () {56 vars in 1113 bytes} [Mon Aug 1 15:24:27 2022] GET /identity/v3/domains/default => generated 200 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:27.667091 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8962713-9127-4985-8d59-220bcf15fcf8 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:27.690835 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea13c8a2-0bd7-42fc-bfb0-b3010a623ab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:27.691624 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea13c8a2-0bd7-42fc-bfb0-b3010a623ab7 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:27.691892 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea13c8a2-0bd7-42fc-bfb0-b3010a623ab7 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:27.692641 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea13c8a2-0bd7-42fc-bfb0-b3010a623ab7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:27.720405 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:27.759288 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea13c8a2-0bd7-42fc-bfb0-b3010a623ab7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:27.760763 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea13c8a2-0bd7-42fc-bfb0-b3010a623ab7 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:27.767396 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8962713-9127-4985-8d59-220bcf15fcf8 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:27.800712 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425a3234-1513-4da4-bf17-d951bc86b4c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:27.801344 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425a3234-1513-4da4-bf17-d951bc86b4c9 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:27.801626 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425a3234-1513-4da4-bf17-d951bc86b4c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:27.801895 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425a3234-1513-4da4-bf17-d951bc86b4c9 None admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:27.802595 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425a3234-1513-4da4-bf17-d951bc86b4c9 None admin] RBAC: Adding query filter params (name=member) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:27.802896 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425a3234-1513-4da4-bf17-d951bc86b4c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:27.804277 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425a3234-1513-4da4-bf17-d951bc86b4c9 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:27.812195 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 41/83] 10.222.0.102 () {56 vars in 1106 bytes} [Mon Aug 1 15:24:27 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:27.812994 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425a3234-1513-4da4-bf17-d951bc86b4c9 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:27.851328 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:27.858341 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 43/84] 10.222.0.102 () {58 vars in 1287 bytes} [Mon Aug 1 15:24:27 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 15:24:27.859086 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea13c8a2-0bd7-42fc-bfb0-b3010a623ab7 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:27.918867 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425a3234-1513-4da4-bf17-d951bc86b4c9 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:27.933314 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:27.954923 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b361b8-4554-41db-8668-c93671b76821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:27.955568 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b361b8-4554-41db-8668-c93671b76821 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:27.955848 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b361b8-4554-41db-8668-c93671b76821 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:27.956125 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b361b8-4554-41db-8668-c93671b76821 None admin] PATH_INFO: `/v3/users/d63a704c427d4f18a40f7ba2bdc48254` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:27.957320 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b361b8-4554-41db-8668-c93671b76821 None admin] RBAC: Authorizing `identity:get_user(user_id=d63a704c427d4f18a40f7ba2bdc48254)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:27.958805 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b361b8-4554-41db-8668-c93671b76821 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:27.960400 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea13c8a2-0bd7-42fc-bfb0-b3010a623ab7 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:27.965856 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 42/85] 10.222.0.102 () {56 vars in 1182 bytes} [Mon Aug 1 15:24:27 2022] GET /identity/v3/users/d63a704c427d4f18a40f7ba2bdc48254 => generated 276 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:27.965856 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b361b8-4554-41db-8668-c93671b76821 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:27.997184 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3db46b8-bc29-4f49-adc0-973853c833c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:27.997822 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3db46b8-bc29-4f49-adc0-973853c833c3 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:27.998104 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3db46b8-bc29-4f49-adc0-973853c833c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:27.998386 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3db46b8-bc29-4f49-adc0-973853c833c3 None admin] PATH_INFO: `/v3/projects/dfcf3ac155ec4ab1b51e9b6849baec64` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:27.999536 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3db46b8-bc29-4f49-adc0-973853c833c3 None admin] RBAC: Authorizing `identity:get_project(project_id=dfcf3ac155ec4ab1b51e9b6849baec64)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:28.001009 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3db46b8-bc29-4f49-adc0-973853c833c3 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:28.002653 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 44/86] 10.222.0.102 () {56 vars in 1191 bytes} [Mon Aug 1 15:24:27 2022] GET /identity/v3/projects/dfcf3ac155ec4ab1b51e9b6849baec64 => generated 299 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:28.003402 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3db46b8-bc29-4f49-adc0-973853c833c3 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:28.063517 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:28.065520 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b361b8-4554-41db-8668-c93671b76821 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:28.099361 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae075501-febb-438f-bf2e-2af6db746ae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:28.099963 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae075501-febb-438f-bf2e-2af6db746ae1 None admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:28.100243 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae075501-febb-438f-bf2e-2af6db746ae1 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:28.100513 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae075501-febb-438f-bf2e-2af6db746ae1 None admin] PATH_INFO: `/v3/users` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:28.101216 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae075501-febb-438f-bf2e-2af6db746ae1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:28.101833 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3db46b8-bc29-4f49-adc0-973853c833c3 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:28.102857 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae075501-febb-438f-bf2e-2af6db746ae1 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:28.134753 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213aaa9d-a587-41e6-9235-049923ab9d5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:28.135376 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213aaa9d-a587-41e6-9235-049923ab9d5a None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:28.135655 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213aaa9d-a587-41e6-9235-049923ab9d5a None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:28.135928 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213aaa9d-a587-41e6-9235-049923ab9d5a None admin] PATH_INFO: `/v3/users/d63a704c427d4f18a40f7ba2bdc48254` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:28.137100 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213aaa9d-a587-41e6-9235-049923ab9d5a None admin] RBAC: Authorizing `identity:get_user(user_id=d63a704c427d4f18a40f7ba2bdc48254)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:28.138526 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213aaa9d-a587-41e6-9235-049923ab9d5a None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:28.140162 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 45/87] 10.222.0.102 () {56 vars in 1182 bytes} [Mon Aug 1 15:24:28 2022] GET /identity/v3/users/d63a704c427d4f18a40f7ba2bdc48254 => generated 276 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:28.140886 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213aaa9d-a587-41e6-9235-049923ab9d5a None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:28.187523 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 43/88] 10.222.0.102 () {60 vars in 1137 bytes} [Mon Aug 1 15:24:27 2022] POST /identity/v3/users => generated 290 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:24:28.197110 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae075501-febb-438f-bf2e-2af6db746ae1 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:28.237255 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:28.270358 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213aaa9d-a587-41e6-9235-049923ab9d5a None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:28.303737 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:28.310054 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0829781d-1a8b-42e5-8441-4f7d3d1bf4a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:28.311064 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0829781d-1a8b-42e5-8441-4f7d3d1bf4a2 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:28.311356 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0829781d-1a8b-42e5-8441-4f7d3d1bf4a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:28.311934 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0829781d-1a8b-42e5-8441-4f7d3d1bf4a2 None admin] PATH_INFO: `/v3/projects/dfcf3ac155ec4ab1b51e9b6849baec64` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:28.313272 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0829781d-1a8b-42e5-8441-4f7d3d1bf4a2 None admin] RBAC: Authorizing `identity:get_project(project_id=dfcf3ac155ec4ab1b51e9b6849baec64)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:28.314826 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0829781d-1a8b-42e5-8441-4f7d3d1bf4a2 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:28.322413 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 46/89] 10.222.0.102 () {56 vars in 1191 bytes} [Mon Aug 1 15:24:28 2022] GET /identity/v3/projects/dfcf3ac155ec4ab1b51e9b6849baec64 => generated 299 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:28.322589 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae075501-febb-438f-bf2e-2af6db746ae1 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:28.323016 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0829781d-1a8b-42e5-8441-4f7d3d1bf4a2 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:28.366142 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627a1df2-cc6f-447b-baf3-8bfd8c9fbb25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:28.367246 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627a1df2-cc6f-447b-baf3-8bfd8c9fbb25 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:28.368092 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627a1df2-cc6f-447b-baf3-8bfd8c9fbb25 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:28.368484 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627a1df2-cc6f-447b-baf3-8bfd8c9fbb25 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:28.440644 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0829781d-1a8b-42e5-8441-4f7d3d1bf4a2 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:28.456200 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627a1df2-cc6f-447b-baf3-8bfd8c9fbb25 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:28.457739 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627a1df2-cc6f-447b-baf3-8bfd8c9fbb25 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:28.488996 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd24ff0a-c1c3-4303-ba00-f085a0174888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:28.489918 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd24ff0a-c1c3-4303-ba00-f085a0174888 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:28.490500 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd24ff0a-c1c3-4303-ba00-f085a0174888 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:28.490969 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd24ff0a-c1c3-4303-ba00-f085a0174888 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:28.492131 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd24ff0a-c1c3-4303-ba00-f085a0174888 None admin] RBAC: Adding query filter params (role.id=27f5093ac0674d799cdbd17c68482e32, scope.project.id=dfcf3ac155ec4ab1b51e9b6849baec64, user.id=d63a704c427d4f18a40f7ba2bdc48254) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:28.493314 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd24ff0a-c1c3-4303-ba00-f085a0174888 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:28.495891 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd24ff0a-c1c3-4303-ba00-f085a0174888 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:28.505280 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:28.506648 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 47/90] 10.222.0.102 () {56 vars in 1379 bytes} [Mon Aug 1 15:24:28 2022] GET /identity/v3/role_assignments?user.id=d63a704c427d4f18a40f7ba2bdc48254&scope.project.id=dfcf3ac155ec4ab1b51e9b6849baec64&role.id=27f5093ac0674d799cdbd17c68482e32 => generated 260 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:28.508519 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd24ff0a-c1c3-4303-ba00-f085a0174888 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:28.591490 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 44/91] 10.222.0.102 () {58 vars in 1287 bytes} [Mon Aug 1 15:24:28 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 15:24:28.592646 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627a1df2-cc6f-447b-baf3-8bfd8c9fbb25 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:28.616889 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:28.641338 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd24ff0a-c1c3-4303-ba00-f085a0174888 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:28.680926 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c2bafb-ce9b-45d0-9015-6d9c789e1d81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:28.681612 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c2bafb-ce9b-45d0-9015-6d9c789e1d81 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:28.682176 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c2bafb-ce9b-45d0-9015-6d9c789e1d81 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:28.682361 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c2bafb-ce9b-45d0-9015-6d9c789e1d81 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:28.707225 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627a1df2-cc6f-447b-baf3-8bfd8c9fbb25 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:28.759384 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c2bafb-ce9b-45d0-9015-6d9c789e1d81 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:28.764364 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c2bafb-ce9b-45d0-9015-6d9c789e1d81 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:28.818145 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0fdeae-878e-4a35-af6a-bcdcfb9f8618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:28.818778 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0fdeae-878e-4a35-af6a-bcdcfb9f8618 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:28.819060 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0fdeae-878e-4a35-af6a-bcdcfb9f8618 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:28.819337 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0fdeae-878e-4a35-af6a-bcdcfb9f8618 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:28.820137 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0fdeae-878e-4a35-af6a-bcdcfb9f8618 None admin] RBAC: Adding query filter params (role.id=de1374f966c04c27b579515b54334fd2, scope.project.id=dfcf3ac155ec4ab1b51e9b6849baec64, user.id=b6b2cd3e98284877b95b595df909c37d) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:28.820450 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0fdeae-878e-4a35-af6a-bcdcfb9f8618 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:28.821979 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0fdeae-878e-4a35-af6a-bcdcfb9f8618 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:28.825219 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:28.828284 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 45/92] 10.222.0.102 () {56 vars in 1379 bytes} [Mon Aug 1 15:24:28 2022] GET /identity/v3/role_assignments?user.id=b6b2cd3e98284877b95b595df909c37d&scope.project.id=dfcf3ac155ec4ab1b51e9b6849baec64&role.id=de1374f966c04c27b579515b54334fd2 => generated 260 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:28.828961 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0fdeae-878e-4a35-af6a-bcdcfb9f8618 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:28.831778 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:28.870067 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 48/93] 10.222.0.102 () {58 vars in 1287 bytes} [Mon Aug 1 15:24:28 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 15:24:28.876094 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c2bafb-ce9b-45d0-9015-6d9c789e1d81 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:28.994036 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0fdeae-878e-4a35-af6a-bcdcfb9f8618 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:29.048239 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c2bafb-ce9b-45d0-9015-6d9c789e1d81 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:29.065938 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e681f0-160a-40c8-83f4-fc6480be086f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:29.066719 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e681f0-160a-40c8-83f4-fc6480be086f None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:29.067002 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e681f0-160a-40c8-83f4-fc6480be086f None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:29.067274 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e681f0-160a-40c8-83f4-fc6480be086f None admin] PATH_INFO: `/v3/projects/dfcf3ac155ec4ab1b51e9b6849baec64` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:29.068463 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e681f0-160a-40c8-83f4-fc6480be086f None admin] RBAC: Authorizing `identity:get_project(project_id=dfcf3ac155ec4ab1b51e9b6849baec64)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:29.070026 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e681f0-160a-40c8-83f4-fc6480be086f None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:29.071880 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 46/94] 10.222.0.102 () {56 vars in 1191 bytes} [Mon Aug 1 15:24:28 2022] GET /identity/v3/projects/dfcf3ac155ec4ab1b51e9b6849baec64 => generated 299 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:29.078660 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e681f0-160a-40c8-83f4-fc6480be086f None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:29.099050 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d923837-05bc-4dff-8366-5e84f0dee34c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:29.099720 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d923837-05bc-4dff-8366-5e84f0dee34c None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:29.100008 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d923837-05bc-4dff-8366-5e84f0dee34c None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:29.100395 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d923837-05bc-4dff-8366-5e84f0dee34c None admin] PATH_INFO: `/v3/projects/608271161577443ea9dd232f7b3f34ba` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:29.104288 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d923837-05bc-4dff-8366-5e84f0dee34c None admin] RBAC: Authorizing `identity:get_project(project_id=608271161577443ea9dd232f7b3f34ba)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:29.105945 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d923837-05bc-4dff-8366-5e84f0dee34c None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:29.108127 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 49/95] 10.222.0.102 () {56 vars in 1191 bytes} [Mon Aug 1 15:24:28 2022] GET /identity/v3/projects/608271161577443ea9dd232f7b3f34ba => generated 313 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:29.114004 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d923837-05bc-4dff-8366-5e84f0dee34c None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:29.156491 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:29.191539 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e681f0-160a-40c8-83f4-fc6480be086f None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:29.195121 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:29.231711 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672c20af-ae80-4c58-ac9e-8e5c70922b2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:29.232341 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672c20af-ae80-4c58-ac9e-8e5c70922b2f None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:29.232623 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672c20af-ae80-4c58-ac9e-8e5c70922b2f None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:29.232922 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672c20af-ae80-4c58-ac9e-8e5c70922b2f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:29.233712 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672c20af-ae80-4c58-ac9e-8e5c70922b2f None admin] RBAC: Adding query filter params (role.id=5acf9fe30ec74532a49ebed755ea61e4, scope.project.id=dfcf3ac155ec4ab1b51e9b6849baec64, user.id=d63a704c427d4f18a40f7ba2bdc48254) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:29.234341 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672c20af-ae80-4c58-ac9e-8e5c70922b2f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:29.235783 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672c20af-ae80-4c58-ac9e-8e5c70922b2f None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:29.245274 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 47/96] 10.222.0.102 () {56 vars in 1379 bytes} [Mon Aug 1 15:24:29 2022] GET /identity/v3/role_assignments?user.id=d63a704c427d4f18a40f7ba2bdc48254&scope.project.id=dfcf3ac155ec4ab1b51e9b6849baec64&role.id=5acf9fe30ec74532a49ebed755ea61e4 => generated 260 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:29.333622 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d923837-05bc-4dff-8366-5e84f0dee34c None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:29.379500 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14eb8f7e-118d-4569-b07d-3b5070b25864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:29.380151 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eb8f7e-118d-4569-b07d-3b5070b25864 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:29.380440 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eb8f7e-118d-4569-b07d-3b5070b25864 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:29.380721 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eb8f7e-118d-4569-b07d-3b5070b25864 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:29.381650 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14eb8f7e-118d-4569-b07d-3b5070b25864 None admin] RBAC: Adding query filter params (role.id=27f5093ac0674d799cdbd17c68482e32, scope.project.id=608271161577443ea9dd232f7b3f34ba, user.id=d63a704c427d4f18a40f7ba2bdc48254) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:29.381975 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14eb8f7e-118d-4569-b07d-3b5070b25864 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:29.383558 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14eb8f7e-118d-4569-b07d-3b5070b25864 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:29.390361 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 50/97] 10.222.0.102 () {56 vars in 1379 bytes} [Mon Aug 1 15:24:29 2022] GET /identity/v3/role_assignments?user.id=d63a704c427d4f18a40f7ba2bdc48254&scope.project.id=608271161577443ea9dd232f7b3f34ba&role.id=27f5093ac0674d799cdbd17c68482e32 => generated 260 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:30.936498 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c7c735-a795-4965-9f58-39f10e9cf823 None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:30.937022 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c7c735-a795-4965-9f58-39f10e9cf823 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:30.937097 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c7c735-a795-4965-9f58-39f10e9cf823 None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:30.938448 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 48/98] 10.222.0.102 () {54 vars in 931 bytes} [Mon Aug 1 15:24:30 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 15:24:30.945509 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1ec9ab-dfb0-4b01-9276-530383175c67 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:30.946519 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1ec9ab-dfb0-4b01-9276-530383175c67 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:30.946710 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1ec9ab-dfb0-4b01-9276-530383175c67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:30.978063 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-ba1ec9ab-dfb0-4b01-9276-530383175c67 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:24:30.979293 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-ba1ec9ab-dfb0-4b01-9276-530383175c67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:24:31.068405 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 51/99] 10.222.0.102 () {58 vars in 1028 bytes} [Mon Aug 1 15:24:30 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 15:24:31.104116 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c7c735-a795-4965-9f58-39f10e9cf823 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:31.221744 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c7c735-a795-4965-9f58-39f10e9cf823 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:31.257000 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0a32cd-bd9b-4a3d-906b-156e8d7a541d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:31.257831 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0a32cd-bd9b-4a3d-906b-156e8d7a541d None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:31.258133 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0a32cd-bd9b-4a3d-906b-156e8d7a541d None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:31.258938 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0a32cd-bd9b-4a3d-906b-156e8d7a541d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:31.260935 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:31.269826 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0a32cd-bd9b-4a3d-906b-156e8d7a541d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:24:31.275051 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-4e0a32cd-bd9b-4a3d-906b-156e8d7a541d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 01 15:24:31.275051 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:24:31.275051 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:24:31.275051 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:24:31.275051 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:24:31.275051 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:24:31.275051 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:24:31.275051 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:24:31.275051 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:24:31.275051 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:24:31.275051 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:24:31.275051 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:24:31.275051 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:24:31.275051 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:24:31.275051 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:24:31.275051 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:24:31.275911 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:24:31.275911 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:24:31.275911 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:24:31.275911 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:24:31.275911 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:24:31.275911 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:24:31.275911 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:24:31.275911 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:24:31.275911 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:24:31.275911 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:24:31.275911 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:24:31.275911 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 01 15:24:31.275911 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:24:31.275911 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:24:31.275911 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:24:31.275911 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:24:31.277115 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:24:31.277115 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:24:31.277115 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:24:31.277115 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:24:31.277115 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:24:31.277115 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:24:31.277115 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:24:31.277115 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:24:31.277115 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:24:31.277115 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:24:31.277115 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 01 15:24:31.277115 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 01 15:24:31.277115 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 49/100] 10.222.0.102 () {56 vars in 1104 bytes} [Mon Aug 1 15:24:31 2022] GET /identity/v3/roles/reader => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:24:31.282147 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1ec9ab-dfb0-4b01-9276-530383175c67 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:31.318017 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:31.437155 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1ec9ab-dfb0-4b01-9276-530383175c67 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:31.474420 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff08a30-2a58-444e-8a7f-805fa48dd98b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:31.475327 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff08a30-2a58-444e-8a7f-805fa48dd98b None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:31.475784 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff08a30-2a58-444e-8a7f-805fa48dd98b None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:31.476231 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff08a30-2a58-444e-8a7f-805fa48dd98b None admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:31.477682 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff08a30-2a58-444e-8a7f-805fa48dd98b None admin] RBAC: Adding query filter params (name=reader) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:31.478187 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff08a30-2a58-444e-8a7f-805fa48dd98b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:31.479746 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff08a30-2a58-444e-8a7f-805fa48dd98b None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:31.488678 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 52/101] 10.222.0.102 () {56 vars in 1106 bytes} [Mon Aug 1 15:24:31 2022] GET /identity/v3/roles?name=reader => generated 343 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:31.497948 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0a32cd-bd9b-4a3d-906b-156e8d7a541d None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:31.623044 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0a32cd-bd9b-4a3d-906b-156e8d7a541d None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:31.664862 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d247c717-9e6b-499c-98d6-408f923a3e6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:31.665812 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d247c717-9e6b-499c-98d6-408f923a3e6c None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:31.666272 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d247c717-9e6b-499c-98d6-408f923a3e6c None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:31.666739 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d247c717-9e6b-499c-98d6-408f923a3e6c None admin] PATH_INFO: `/v3/users/1529e1cc2932475a8f3b33c10ed2796a` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:31.687214 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d247c717-9e6b-499c-98d6-408f923a3e6c None admin] RBAC: Authorizing `identity:get_user(user_id=1529e1cc2932475a8f3b33c10ed2796a)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:31.689126 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d247c717-9e6b-499c-98d6-408f923a3e6c None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:31.691080 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 50/102] 10.222.0.102 () {56 vars in 1182 bytes} [Mon Aug 1 15:24:31 2022] GET /identity/v3/users/1529e1cc2932475a8f3b33c10ed2796a => generated 290 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:31.696533 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff08a30-2a58-444e-8a7f-805fa48dd98b None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:31.857265 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:31.869298 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff08a30-2a58-444e-8a7f-805fa48dd98b None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:31.907937 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ccbe16-6dbc-4a1a-b72c-4e8b0d2b6a9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:31.908576 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ccbe16-6dbc-4a1a-b72c-4e8b0d2b6a9c None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:31.908873 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ccbe16-6dbc-4a1a-b72c-4e8b0d2b6a9c None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:31.909169 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ccbe16-6dbc-4a1a-b72c-4e8b0d2b6a9c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:31.930165 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2264d5-69ae-4cd4-ada7-ce424b32eb5a None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:31.930452 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2264d5-69ae-4cd4-ada7-ce424b32eb5a None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:31.930732 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2264d5-69ae-4cd4-ada7-ce424b32eb5a None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:31.932361 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 51/103] 10.222.0.102 () {54 vars in 931 bytes} [Mon Aug 1 15:24:31 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 01 15:24:31.937349 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03572ff-aba8-409a-ac5c-ea5301a295cc None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:31.937891 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03572ff-aba8-409a-ac5c-ea5301a295cc None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:31.937891 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03572ff-aba8-409a-ac5c-ea5301a295cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:31.974876 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-e03572ff-aba8-409a-ac5c-ea5301a295cc None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:24:31.976170 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-e03572ff-aba8-409a-ac5c-ea5301a295cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:24:32.041457 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ccbe16-6dbc-4a1a-b72c-4e8b0d2b6a9c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:32.042957 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ccbe16-6dbc-4a1a-b72c-4e8b0d2b6a9c None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:32.067882 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:32.115686 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 52/104] 10.222.0.102 () {58 vars in 1028 bytes} [Mon Aug 1 15:24:31 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 01 15:24:32.117040 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3df8bb-99b3-4f9a-82a9-a06db1aead1e None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:32.117339 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3df8bb-99b3-4f9a-82a9-a06db1aead1e None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:32.117652 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3df8bb-99b3-4f9a-82a9-a06db1aead1e None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:32.119030 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 53/105] 10.222.0.102 () {54 vars in 931 bytes} [Mon Aug 1 15:24:32 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 15:24:32.120098 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b46b63-d370-4b09-9282-07c0858f42cb None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:32.120382 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b46b63-d370-4b09-9282-07c0858f42cb None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:32.120659 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b46b63-d370-4b09-9282-07c0858f42cb None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:32.121910 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 54/106] 10.222.0.102 () {54 vars in 931 bytes} [Mon Aug 1 15:24:32 2022] GET /identity => generated 271 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 15:24:32.130161 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c1eb29-7a03-4b3d-afe1-3a76ddf0b4c4 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:32.130481 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c1eb29-7a03-4b3d-afe1-3a76ddf0b4c4 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:32.130714 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c1eb29-7a03-4b3d-afe1-3a76ddf0b4c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:32.155023 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-99c1eb29-7a03-4b3d-afe1-3a76ddf0b4c4 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:24:32.156331 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-99c1eb29-7a03-4b3d-afe1-3a76ddf0b4c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:24:32.180519 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:32.196213 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 53/107] 10.222.0.102 () {58 vars in 1287 bytes} [Mon Aug 1 15:24:31 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 499 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 15:24:32.197652 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a592c7b-aa42-49e5-b394-e33ad411d8a0 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:32.198042 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a592c7b-aa42-49e5-b394-e33ad411d8a0 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:32.198510 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a592c7b-aa42-49e5-b394-e33ad411d8a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:32.221249 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-6a592c7b-aa42-49e5-b394-e33ad411d8a0 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:24:32.223053 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-6a592c7b-aa42-49e5-b394-e33ad411d8a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:24:32.235476 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 55/108] 10.222.0.102 () {58 vars in 1028 bytes} [Mon Aug 1 15:24:32 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 15:24:32.236320 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c1eb29-7a03-4b3d-afe1-3a76ddf0b4c4 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:32.294457 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 54/109] 10.222.0.102 () {58 vars in 1028 bytes} [Mon Aug 1 15:24:32 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 15:24:32.295380 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a592c7b-aa42-49e5-b394-e33ad411d8a0 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:32.357970 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c1eb29-7a03-4b3d-afe1-3a76ddf0b4c4 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:32.371095 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:32.391320 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a0e9c5-c1da-4987-917b-ca00a2118da3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:32.391988 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a0e9c5-c1da-4987-917b-ca00a2118da3 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:32.392223 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a0e9c5-c1da-4987-917b-ca00a2118da3 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:32.392499 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a0e9c5-c1da-4987-917b-ca00a2118da3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:32.402404 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a592c7b-aa42-49e5-b394-e33ad411d8a0 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:32.403070 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a0e9c5-c1da-4987-917b-ca00a2118da3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:24:32.408296 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-b0a0e9c5-c1da-4987-917b-ca00a2118da3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 01 15:24:32.408296 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:24:32.408296 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:24:32.408296 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:24:32.408296 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:24:32.408296 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:24:32.408296 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:24:32.408296 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:24:32.408296 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:24:32.408296 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:24:32.408296 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:24:32.408296 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:24:32.408296 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:24:32.408296 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:24:32.408296 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:24:32.408296 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:24:32.409368 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:24:32.409368 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:24:32.409368 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:24:32.409368 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:24:32.409368 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:24:32.409368 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:24:32.409368 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:24:32.409368 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:24:32.409368 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:24:32.409368 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:24:32.409368 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:24:32.409368 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 01 15:24:32.409368 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:24:32.409368 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:24:32.409368 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:24:32.409368 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:24:32.410150 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:24:32.410150 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:24:32.410150 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:24:32.410150 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:24:32.410150 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:24:32.410150 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:24:32.410150 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:24:32.410150 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:24:32.410150 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:24:32.410150 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:24:32.410150 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 01 15:24:32.410150 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 01 15:24:32.410150 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 56/110] 10.222.0.102 () {56 vars in 1104 bytes} [Mon Aug 1 15:24:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:24:32.411041 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2821636e-1027-44ad-9c4e-133d11b02143 None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:32.411542 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2821636e-1027-44ad-9c4e-133d11b02143 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:32.411542 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2821636e-1027-44ad-9c4e-133d11b02143 None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:32.416657 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 57/111] 10.222.0.102 () {54 vars in 931 bytes} [Mon Aug 1 15:24:32 2022] GET /identity => generated 271 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 15:24:32.417682 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e1b738-64e1-4e54-9ead-a6e03c675870 None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:32.417966 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e1b738-64e1-4e54-9ead-a6e03c675870 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:32.418237 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e1b738-64e1-4e54-9ead-a6e03c675870 None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:32.419957 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 58/112] 10.222.0.102 () {54 vars in 931 bytes} [Mon Aug 1 15:24:32 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 15:24:32.420751 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e1b738-64e1-4e54-9ead-a6e03c675870 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:32.422219 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:32.440128 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe00890-673c-4a1d-ace9-6c9790c62f12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:32.440788 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe00890-673c-4a1d-ace9-6c9790c62f12 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:32.441104 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe00890-673c-4a1d-ace9-6c9790c62f12 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:32.441385 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe00890-673c-4a1d-ace9-6c9790c62f12 None admin] PATH_INFO: `/v3/projects/dfcf3ac155ec4ab1b51e9b6849baec64` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:32.442582 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe00890-673c-4a1d-ace9-6c9790c62f12 None admin] RBAC: Authorizing `identity:get_project(project_id=dfcf3ac155ec4ab1b51e9b6849baec64)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:32.444130 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe00890-673c-4a1d-ace9-6c9790c62f12 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:32.446666 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 55/113] 10.222.0.102 () {56 vars in 1191 bytes} [Mon Aug 1 15:24:32 2022] GET /identity/v3/projects/dfcf3ac155ec4ab1b51e9b6849baec64 => generated 299 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:32.447502 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe00890-673c-4a1d-ace9-6c9790c62f12 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:32.524832 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e1b738-64e1-4e54-9ead-a6e03c675870 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:32.550699 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe00890-673c-4a1d-ace9-6c9790c62f12 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:32.557368 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568aca57-a7b5-4eb7-8308-6d9413013cd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:32.557998 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568aca57-a7b5-4eb7-8308-6d9413013cd9 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:32.558274 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568aca57-a7b5-4eb7-8308-6d9413013cd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:32.558545 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568aca57-a7b5-4eb7-8308-6d9413013cd9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:32.559674 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568aca57-a7b5-4eb7-8308-6d9413013cd9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:32.561253 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568aca57-a7b5-4eb7-8308-6d9413013cd9 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:32.562852 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 59/114] 10.222.0.102 () {56 vars in 1113 bytes} [Mon Aug 1 15:24:32 2022] GET /identity/v3/domains/default => generated 200 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:32.563673 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568aca57-a7b5-4eb7-8308-6d9413013cd9 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:32.584232 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522e1bfd-0ef8-4401-a5e4-9a74387cd53f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:32.584898 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522e1bfd-0ef8-4401-a5e4-9a74387cd53f None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:32.585186 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522e1bfd-0ef8-4401-a5e4-9a74387cd53f None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:32.585462 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522e1bfd-0ef8-4401-a5e4-9a74387cd53f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:32.596417 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522e1bfd-0ef8-4401-a5e4-9a74387cd53f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:24:32.601449 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-522e1bfd-0ef8-4401-a5e4-9a74387cd53f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 01 15:24:32.601449 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:24:32.601449 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:24:32.601449 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:24:32.601449 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:24:32.601449 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:24:32.601449 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:24:32.601449 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:24:32.601449 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:24:32.601449 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:24:32.601449 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:24:32.601449 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:24:32.601449 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:24:32.601449 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:24:32.601449 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:24:32.601449 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:24:32.602512 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:24:32.602512 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:24:32.602512 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:24:32.602512 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:24:32.602512 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:24:32.602512 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:24:32.602512 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:24:32.602512 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:24:32.602512 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:24:32.602512 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:24:32.602512 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:24:32.602512 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 01 15:24:32.602512 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:24:32.602512 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:24:32.602512 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:24:32.602512 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:24:32.603288 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:24:32.603288 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:24:32.603288 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:24:32.603288 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:24:32.603288 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:24:32.603288 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:24:32.603288 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:24:32.603288 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:24:32.603288 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:24:32.603288 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:24:32.603288 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 01 15:24:32.603288 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 01 15:24:32.603288 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 56/115] 10.222.0.102 () {56 vars in 1104 bytes} [Mon Aug 1 15:24:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:24:32.603920 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820fbfef-057b-40b2-b110-b0a9c9783883 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:32.604175 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820fbfef-057b-40b2-b110-b0a9c9783883 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:32.604450 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820fbfef-057b-40b2-b110-b0a9c9783883 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:32.609368 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:32.622395 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-820fbfef-057b-40b2-b110-b0a9c9783883 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:24:32.623542 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-820fbfef-057b-40b2-b110-b0a9c9783883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:24:32.664989 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:32.667993 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568aca57-a7b5-4eb7-8308-6d9413013cd9 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:32.691179 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 57/116] 10.222.0.102 () {58 vars in 1028 bytes} [Mon Aug 1 15:24:32 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 15:24:32.694690 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de1d33d-24fa-4024-bcc3-a0a68507cb13 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:32.694984 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de1d33d-24fa-4024-bcc3-a0a68507cb13 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:32.695579 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de1d33d-24fa-4024-bcc3-a0a68507cb13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:32.703424 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6a503c-16bf-4f74-9e16-b62b36fab0c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:32.704036 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6a503c-16bf-4f74-9e16-b62b36fab0c8 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:32.704313 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6a503c-16bf-4f74-9e16-b62b36fab0c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:32.704585 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6a503c-16bf-4f74-9e16-b62b36fab0c8 None admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:32.705324 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6a503c-16bf-4f74-9e16-b62b36fab0c8 None admin] RBAC: Adding query filter params (name=member) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:32.705628 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6a503c-16bf-4f74-9e16-b62b36fab0c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:32.706998 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6a503c-16bf-4f74-9e16-b62b36fab0c8 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:32.715557 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 60/117] 10.222.0.102 () {56 vars in 1106 bytes} [Mon Aug 1 15:24:32 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:32.716313 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-8de1d33d-24fa-4024-bcc3-a0a68507cb13 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:24:32.717706 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-8de1d33d-24fa-4024-bcc3-a0a68507cb13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:24:32.717811 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6a503c-16bf-4f74-9e16-b62b36fab0c8 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:32.782800 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 58/118] 10.222.0.102 () {58 vars in 1028 bytes} [Mon Aug 1 15:24:32 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 15:24:32.793372 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de1d33d-24fa-4024-bcc3-a0a68507cb13 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:32.826162 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6a503c-16bf-4f74-9e16-b62b36fab0c8 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:32.827949 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:32.859920 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108657cf-626f-4508-9cda-8b113e16aede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:32.860526 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108657cf-626f-4508-9cda-8b113e16aede None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:32.860810 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108657cf-626f-4508-9cda-8b113e16aede None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:32.861116 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108657cf-626f-4508-9cda-8b113e16aede None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:32.861905 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108657cf-626f-4508-9cda-8b113e16aede None admin] RBAC: Adding query filter params (role.id=d517cfa9ee3e4f2b946b50d2236338f3, scope.project.id=dfcf3ac155ec4ab1b51e9b6849baec64, user.id=1529e1cc2932475a8f3b33c10ed2796a) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:32.862211 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108657cf-626f-4508-9cda-8b113e16aede None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:32.863652 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108657cf-626f-4508-9cda-8b113e16aede None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:32.869479 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 61/119] 10.222.0.102 () {56 vars in 1379 bytes} [Mon Aug 1 15:24:32 2022] GET /identity/v3/role_assignments?user.id=1529e1cc2932475a8f3b33c10ed2796a&scope.project.id=dfcf3ac155ec4ab1b51e9b6849baec64&role.id=d517cfa9ee3e4f2b946b50d2236338f3 => generated 260 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:32.870252 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108657cf-626f-4508-9cda-8b113e16aede None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:32.896577 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de1d33d-24fa-4024-bcc3-a0a68507cb13 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:32.907547 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:32.937088 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7330878e-97d2-456a-a82d-7865364ac1b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:32.938475 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7330878e-97d2-456a-a82d-7865364ac1b2 None admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:32.939692 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7330878e-97d2-456a-a82d-7865364ac1b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:32.939978 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7330878e-97d2-456a-a82d-7865364ac1b2 None admin] PATH_INFO: `/v3/projects` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:32.941150 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7330878e-97d2-456a-a82d-7865364ac1b2 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:32.942650 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7330878e-97d2-456a-a82d-7865364ac1b2 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:32.990040 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108657cf-626f-4508-9cda-8b113e16aede None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:33.014152 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 59/120] 10.222.0.102 () {60 vars in 1146 bytes} [Mon Aug 1 15:24:32 2022] POST /identity/v3/projects => generated 303 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:24:33.021107 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7330878e-97d2-456a-a82d-7865364ac1b2 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:33.049624 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bc2dc4-65a2-4e2d-9c73-313b23dfaa0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:33.050555 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bc2dc4-65a2-4e2d-9c73-313b23dfaa0a None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:33.051346 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bc2dc4-65a2-4e2d-9c73-313b23dfaa0a None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:33.051699 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bc2dc4-65a2-4e2d-9c73-313b23dfaa0a None admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:33.052802 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bc2dc4-65a2-4e2d-9c73-313b23dfaa0a None admin] RBAC: Adding query filter params (name=member) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:33.053303 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bc2dc4-65a2-4e2d-9c73-313b23dfaa0a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:33.056160 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bc2dc4-65a2-4e2d-9c73-313b23dfaa0a None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:33.067456 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 62/121] 10.222.0.102 () {56 vars in 1106 bytes} [Mon Aug 1 15:24:32 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:33.068504 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bc2dc4-65a2-4e2d-9c73-313b23dfaa0a None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:33.108955 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:33.151750 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7330878e-97d2-456a-a82d-7865364ac1b2 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:33.202163 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b366c1c-0a34-497c-b0b7-ed4d09cdc038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:33.203071 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b366c1c-0a34-497c-b0b7-ed4d09cdc038 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:33.203357 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b366c1c-0a34-497c-b0b7-ed4d09cdc038 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:33.203630 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b366c1c-0a34-497c-b0b7-ed4d09cdc038 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:33.208057 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bc2dc4-65a2-4e2d-9c73-313b23dfaa0a None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:33.215873 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b366c1c-0a34-497c-b0b7-ed4d09cdc038 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:24:33.222755 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-0b366c1c-0a34-497c-b0b7-ed4d09cdc038 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 01 15:24:33.222755 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:24:33.222755 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:24:33.222755 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:24:33.222755 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:24:33.222755 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:24:33.222755 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:24:33.222755 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:24:33.222755 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:24:33.222755 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:24:33.222755 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:24:33.222755 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:24:33.222755 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:24:33.222755 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:24:33.222755 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:24:33.222755 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:24:33.223620 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:24:33.223620 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:24:33.223620 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:24:33.223620 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:24:33.223620 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:24:33.223620 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:24:33.223620 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:24:33.223620 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:24:33.223620 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:24:33.223620 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:24:33.223620 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:24:33.223620 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 01 15:24:33.223620 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:24:33.223620 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:24:33.223620 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:24:33.223620 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:24:33.224414 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:24:33.224414 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:24:33.224414 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:24:33.224414 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:24:33.224414 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:24:33.224414 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:24:33.224414 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:24:33.224414 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:24:33.224414 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:24:33.224414 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:24:33.224414 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 01 15:24:33.224414 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 01 15:24:33.236103 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 60/122] 10.222.0.102 () {56 vars in 1119 bytes} [Mon Aug 1 15:24:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:24:33.236103 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b366c1c-0a34-497c-b0b7-ed4d09cdc038 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:33.255465 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:33.256061 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7c07b7-2d49-4650-b052-a1a7d240a56f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:33.256712 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7c07b7-2d49-4650-b052-a1a7d240a56f None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:33.257020 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7c07b7-2d49-4650-b052-a1a7d240a56f None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:33.257309 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7c07b7-2d49-4650-b052-a1a7d240a56f None admin] PATH_INFO: `/v3/users/d63a704c427d4f18a40f7ba2bdc48254` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:33.258522 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7c07b7-2d49-4650-b052-a1a7d240a56f None admin] RBAC: Authorizing `identity:get_user(user_id=d63a704c427d4f18a40f7ba2bdc48254)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:33.260031 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7c07b7-2d49-4650-b052-a1a7d240a56f None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:33.261836 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 63/123] 10.222.0.102 () {56 vars in 1182 bytes} [Mon Aug 1 15:24:33 2022] GET /identity/v3/users/d63a704c427d4f18a40f7ba2bdc48254 => generated 276 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:33.262480 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7c07b7-2d49-4650-b052-a1a7d240a56f None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:33.368960 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:33.373459 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b366c1c-0a34-497c-b0b7-ed4d09cdc038 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:33.377489 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7c07b7-2d49-4650-b052-a1a7d240a56f None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:33.413101 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5253c15-df65-4b99-a721-0dbe72bfb7e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:33.414259 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5253c15-df65-4b99-a721-0dbe72bfb7e3 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:33.415256 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5253c15-df65-4b99-a721-0dbe72bfb7e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:33.415669 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5253c15-df65-4b99-a721-0dbe72bfb7e3 None admin] PATH_INFO: `/v3/users/d63a704c427d4f18a40f7ba2bdc48254` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:33.417079 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5253c15-df65-4b99-a721-0dbe72bfb7e3 None admin] RBAC: Authorizing `identity:get_user(user_id=d63a704c427d4f18a40f7ba2bdc48254)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:33.418664 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5253c15-df65-4b99-a721-0dbe72bfb7e3 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:33.419849 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee987c8-e253-489c-bb9a-ab0e85a09d40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:33.420744 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 64/124] 10.222.0.102 () {56 vars in 1182 bytes} [Mon Aug 1 15:24:33 2022] GET /identity/v3/users/d63a704c427d4f18a40f7ba2bdc48254 => generated 276 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:33.421348 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee987c8-e253-489c-bb9a-ab0e85a09d40 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:33.421710 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee987c8-e253-489c-bb9a-ab0e85a09d40 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:33.422063 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5253c15-df65-4b99-a721-0dbe72bfb7e3 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:33.422174 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee987c8-e253-489c-bb9a-ab0e85a09d40 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:33.435933 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee987c8-e253-489c-bb9a-ab0e85a09d40 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:24:33.441682 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-9ee987c8-e253-489c-bb9a-ab0e85a09d40 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 15:24:33.441682 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:24:33.441682 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:24:33.441682 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:24:33.441682 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:24:33.441682 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:24:33.441682 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:24:33.441682 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:24:33.441682 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:24:33.441682 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:24:33.441682 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:24:33.441682 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:24:33.441682 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:24:33.441682 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:24:33.441682 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:24:33.441682 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:24:33.442551 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:24:33.442551 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:24:33.442551 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:24:33.442551 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:24:33.442551 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:24:33.442551 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:24:33.442551 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:24:33.442551 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:24:33.442551 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:24:33.442551 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:24:33.442551 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:24:33.442551 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 01 15:24:33.442551 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:24:33.442551 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:24:33.442551 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:24:33.442551 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:24:33.443316 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:24:33.443316 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:24:33.443316 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:24:33.443316 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:24:33.443316 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:24:33.443316 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:24:33.443316 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:24:33.443316 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:24:33.443316 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:24:33.443316 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:24:33.443316 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 15:24:33.443316 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 01 15:24:33.445865 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 61/125] 10.222.0.102 () {56 vars in 1101 bytes} [Mon Aug 1 15:24:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:24:33.446828 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee987c8-e253-489c-bb9a-ab0e85a09d40 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:33.551327 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:33.573445 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5253c15-df65-4b99-a721-0dbe72bfb7e3 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:33.578028 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee987c8-e253-489c-bb9a-ab0e85a09d40 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:33.614478 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f478149f-eee2-4c85-95af-0b948f7f247b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:33.615448 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f478149f-eee2-4c85-95af-0b948f7f247b None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:33.615897 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f478149f-eee2-4c85-95af-0b948f7f247b None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:33.616318 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f478149f-eee2-4c85-95af-0b948f7f247b None admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:33.617528 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f478149f-eee2-4c85-95af-0b948f7f247b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:33.618059 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f478149f-eee2-4c85-95af-0b948f7f247b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:33.618919 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc921179-c772-443e-af10-ab1cbd3c58f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:33.619699 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc921179-c772-443e-af10-ab1cbd3c58f1 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:33.619917 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f478149f-eee2-4c85-95af-0b948f7f247b None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:33.620156 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc921179-c772-443e-af10-ab1cbd3c58f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:33.620549 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc921179-c772-443e-af10-ab1cbd3c58f1 None admin] PATH_INFO: `/v3/projects/608271161577443ea9dd232f7b3f34ba` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:33.622039 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc921179-c772-443e-af10-ab1cbd3c58f1 None admin] RBAC: Authorizing `identity:get_project(project_id=608271161577443ea9dd232f7b3f34ba)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:33.623875 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc921179-c772-443e-af10-ab1cbd3c58f1 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:33.625705 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 62/126] 10.222.0.102 () {56 vars in 1191 bytes} [Mon Aug 1 15:24:33 2022] GET /identity/v3/projects/608271161577443ea9dd232f7b3f34ba => generated 313 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:33.630898 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc921179-c772-443e-af10-ab1cbd3c58f1 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:33.634209 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 65/127] 10.222.0.102 () {56 vars in 1116 bytes} [Mon Aug 1 15:24:33 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:33.636105 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f478149f-eee2-4c85-95af-0b948f7f247b None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:33.684606 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:33.742235 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc921179-c772-443e-af10-ab1cbd3c58f1 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:33.755942 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f478149f-eee2-4c85-95af-0b948f7f247b None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:33.779000 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9e4c81-9cad-405a-9c50-69c0e2c2277d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:33.779769 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9e4c81-9cad-405a-9c50-69c0e2c2277d None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:33.780333 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9e4c81-9cad-405a-9c50-69c0e2c2277d None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:33.780536 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9e4c81-9cad-405a-9c50-69c0e2c2277d None admin] PATH_INFO: `/v3/projects/dfcf3ac155ec4ab1b51e9b6849baec64` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:33.781814 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9e4c81-9cad-405a-9c50-69c0e2c2277d None admin] RBAC: Authorizing `identity:get_project(project_id=dfcf3ac155ec4ab1b51e9b6849baec64)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:33.783424 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9e4c81-9cad-405a-9c50-69c0e2c2277d None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:33.785778 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 63/128] 10.222.0.102 () {56 vars in 1191 bytes} [Mon Aug 1 15:24:33 2022] GET /identity/v3/projects/dfcf3ac155ec4ab1b51e9b6849baec64 => generated 299 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:33.786844 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9e4c81-9cad-405a-9c50-69c0e2c2277d None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:33.796618 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7618dbb4-4061-4145-b8d6-a50da48e4ccb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:33.797527 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7618dbb4-4061-4145-b8d6-a50da48e4ccb None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:33.797955 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7618dbb4-4061-4145-b8d6-a50da48e4ccb None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:33.798388 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7618dbb4-4061-4145-b8d6-a50da48e4ccb None admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:33.799357 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7618dbb4-4061-4145-b8d6-a50da48e4ccb None admin] RBAC: Adding query filter params (name=admin) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:33.799804 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7618dbb4-4061-4145-b8d6-a50da48e4ccb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:33.801502 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7618dbb4-4061-4145-b8d6-a50da48e4ccb None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:33.804675 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:33.811983 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 66/129] 10.222.0.102 () {56 vars in 1104 bytes} [Mon Aug 1 15:24:33 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:33.813057 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7618dbb4-4061-4145-b8d6-a50da48e4ccb None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:33.917625 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9e4c81-9cad-405a-9c50-69c0e2c2277d None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:33.922448 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:33.944809 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7618dbb4-4061-4145-b8d6-a50da48e4ccb None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:33.953625 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad05ff7-eb02-4fc8-9e56-3df3ba028c4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:33.954311 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad05ff7-eb02-4fc8-9e56-3df3ba028c4b None admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:33.954596 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad05ff7-eb02-4fc8-9e56-3df3ba028c4b None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:33.954871 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad05ff7-eb02-4fc8-9e56-3df3ba028c4b None admin] PATH_INFO: `/v3/projects/608271161577443ea9dd232f7b3f34ba/users/d63a704c427d4f18a40f7ba2bdc48254/roles/27f5093ac0674d799cdbd17c68482e32` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:33.956821 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad05ff7-eb02-4fc8-9e56-3df3ba028c4b None admin] RBAC: Authorizing `identity:create_grant(project_id=608271161577443ea9dd232f7b3f34ba, user_id=d63a704c427d4f18a40f7ba2bdc48254, role_id=27f5093ac0674d799cdbd17c68482e32)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:33.958377 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad05ff7-eb02-4fc8-9e56-3df3ba028c4b None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:33.974742 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3927e632-75f6-45b7-9847-d7cffe0aadd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:33.976552 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3927e632-75f6-45b7-9847-d7cffe0aadd8 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:33.976552 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3927e632-75f6-45b7-9847-d7cffe0aadd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:33.976552 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3927e632-75f6-45b7-9847-d7cffe0aadd8 None admin] PATH_INFO: `/v3/users/d63a704c427d4f18a40f7ba2bdc48254` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:33.978162 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3927e632-75f6-45b7-9847-d7cffe0aadd8 None admin] RBAC: Authorizing `identity:get_user(user_id=d63a704c427d4f18a40f7ba2bdc48254)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:33.979688 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3927e632-75f6-45b7-9847-d7cffe0aadd8 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:33.981624 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 67/130] 10.222.0.102 () {56 vars in 1182 bytes} [Mon Aug 1 15:24:33 2022] GET /identity/v3/users/d63a704c427d4f18a40f7ba2bdc48254 => generated 276 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:33.982513 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3927e632-75f6-45b7-9847-d7cffe0aadd8 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:34.036724 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 64/131] 10.222.0.102 () {58 vars in 1444 bytes} [Mon Aug 1 15:24:33 2022] PUT /identity/v3/projects/608271161577443ea9dd232f7b3f34ba/users/d63a704c427d4f18a40f7ba2bdc48254/roles/27f5093ac0674d799cdbd17c68482e32 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:24:34.038799 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad05ff7-eb02-4fc8-9e56-3df3ba028c4b None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:34.133925 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3927e632-75f6-45b7-9847-d7cffe0aadd8 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:34.174957 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c2093d-8e03-4ee6-b9ce-52dca08bcc3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:34.176072 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c2093d-8e03-4ee6-b9ce-52dca08bcc3d None admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:34.176555 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c2093d-8e03-4ee6-b9ce-52dca08bcc3d None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:34.177065 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c2093d-8e03-4ee6-b9ce-52dca08bcc3d None admin] PATH_INFO: `/v3/projects/dfcf3ac155ec4ab1b51e9b6849baec64/users/d63a704c427d4f18a40f7ba2bdc48254/roles/27f5093ac0674d799cdbd17c68482e32` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:34.179368 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c2093d-8e03-4ee6-b9ce-52dca08bcc3d None admin] RBAC: Authorizing `identity:create_grant(project_id=dfcf3ac155ec4ab1b51e9b6849baec64, user_id=d63a704c427d4f18a40f7ba2bdc48254, role_id=27f5093ac0674d799cdbd17c68482e32)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:34.181282 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c2093d-8e03-4ee6-b9ce-52dca08bcc3d None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:34.216537 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:34.247595 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad05ff7-eb02-4fc8-9e56-3df3ba028c4b None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:34.286424 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8eefdd-933d-4ff3-9529-8c51ccd443b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:34.287082 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8eefdd-933d-4ff3-9529-8c51ccd443b8 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:34.287367 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8eefdd-933d-4ff3-9529-8c51ccd443b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:34.287649 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8eefdd-933d-4ff3-9529-8c51ccd443b8 None admin] PATH_INFO: `/v3/users/b6b2cd3e98284877b95b595df909c37d` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:34.288910 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8eefdd-933d-4ff3-9529-8c51ccd443b8 None admin] RBAC: Authorizing `identity:get_user(user_id=b6b2cd3e98284877b95b595df909c37d)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:34.291032 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8eefdd-933d-4ff3-9529-8c51ccd443b8 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:34.292901 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 65/132] 10.222.0.102 () {56 vars in 1182 bytes} [Mon Aug 1 15:24:34 2022] GET /identity/v3/users/b6b2cd3e98284877b95b595df909c37d => generated 248 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:34.293447 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8eefdd-933d-4ff3-9529-8c51ccd443b8 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:34.303754 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 68/133] 10.222.0.102 () {58 vars in 1444 bytes} [Mon Aug 1 15:24:33 2022] PUT /identity/v3/projects/dfcf3ac155ec4ab1b51e9b6849baec64/users/d63a704c427d4f18a40f7ba2bdc48254/roles/27f5093ac0674d799cdbd17c68482e32 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:24:34.308692 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c2093d-8e03-4ee6-b9ce-52dca08bcc3d None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:34.339449 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:34.449780 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c2093d-8e03-4ee6-b9ce-52dca08bcc3d None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:34.493778 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344a5529-820b-460b-ace1-73245206ade0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:34.495298 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344a5529-820b-460b-ace1-73245206ade0 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:34.495778 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344a5529-820b-460b-ace1-73245206ade0 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:34.496198 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344a5529-820b-460b-ace1-73245206ade0 None admin] PATH_INFO: `/v3/projects/dfcf3ac155ec4ab1b51e9b6849baec64` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:34.498304 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344a5529-820b-460b-ace1-73245206ade0 None admin] RBAC: Authorizing `identity:get_project(project_id=dfcf3ac155ec4ab1b51e9b6849baec64)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:34.500536 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344a5529-820b-460b-ace1-73245206ade0 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:34.502779 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 69/134] 10.222.0.102 () {56 vars in 1191 bytes} [Mon Aug 1 15:24:34 2022] GET /identity/v3/projects/dfcf3ac155ec4ab1b51e9b6849baec64 => generated 299 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:34.509505 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8eefdd-933d-4ff3-9529-8c51ccd443b8 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:34.510531 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344a5529-820b-460b-ace1-73245206ade0 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:34.596014 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfb5c2f-9705-4978-af72-b1a09a09a7ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:34.597792 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfb5c2f-9705-4978-af72-b1a09a09a7ca None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:34.598259 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfb5c2f-9705-4978-af72-b1a09a09a7ca None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:34.598718 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfb5c2f-9705-4978-af72-b1a09a09a7ca None admin] PATH_INFO: `/v3/projects/dfcf3ac155ec4ab1b51e9b6849baec64` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:34.601565 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfb5c2f-9705-4978-af72-b1a09a09a7ca None admin] RBAC: Authorizing `identity:get_project(project_id=dfcf3ac155ec4ab1b51e9b6849baec64)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:34.605840 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfb5c2f-9705-4978-af72-b1a09a09a7ca None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:34.607597 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 66/135] 10.222.0.102 () {56 vars in 1191 bytes} [Mon Aug 1 15:24:34 2022] GET /identity/v3/projects/dfcf3ac155ec4ab1b51e9b6849baec64 => generated 299 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:34.613314 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfb5c2f-9705-4978-af72-b1a09a09a7ca None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:34.642771 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:34.659809 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:34.678766 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344a5529-820b-460b-ace1-73245206ade0 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:34.722042 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8254421e-6c43-48bc-bbca-f7701103869e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:34.723546 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8254421e-6c43-48bc-bbca-f7701103869e None admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:34.724009 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8254421e-6c43-48bc-bbca-f7701103869e None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:34.724434 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8254421e-6c43-48bc-bbca-f7701103869e None admin] PATH_INFO: `/v3/projects/dfcf3ac155ec4ab1b51e9b6849baec64/users/b6b2cd3e98284877b95b595df909c37d/roles/de1374f966c04c27b579515b54334fd2` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:34.726838 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8254421e-6c43-48bc-bbca-f7701103869e None admin] RBAC: Authorizing `identity:create_grant(project_id=dfcf3ac155ec4ab1b51e9b6849baec64, user_id=b6b2cd3e98284877b95b595df909c37d, role_id=de1374f966c04c27b579515b54334fd2)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:34.728467 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8254421e-6c43-48bc-bbca-f7701103869e None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:34.801842 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfb5c2f-9705-4978-af72-b1a09a09a7ca None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:34.821170 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 70/136] 10.222.0.102 () {58 vars in 1444 bytes} [Mon Aug 1 15:24:34 2022] PUT /identity/v3/projects/dfcf3ac155ec4ab1b51e9b6849baec64/users/b6b2cd3e98284877b95b595df909c37d/roles/de1374f966c04c27b579515b54334fd2 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:24:34.840646 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a81ef1d-ee41-4dc6-8623-2012fe935c2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:34.841376 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a81ef1d-ee41-4dc6-8623-2012fe935c2e None admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:34.841657 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a81ef1d-ee41-4dc6-8623-2012fe935c2e None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:34.841931 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a81ef1d-ee41-4dc6-8623-2012fe935c2e None admin] PATH_INFO: `/v3/projects/dfcf3ac155ec4ab1b51e9b6849baec64/users/d63a704c427d4f18a40f7ba2bdc48254/roles/5acf9fe30ec74532a49ebed755ea61e4` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:34.844467 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a81ef1d-ee41-4dc6-8623-2012fe935c2e None admin] RBAC: Authorizing `identity:create_grant(project_id=dfcf3ac155ec4ab1b51e9b6849baec64, user_id=d63a704c427d4f18a40f7ba2bdc48254, role_id=5acf9fe30ec74532a49ebed755ea61e4)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:34.846107 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a81ef1d-ee41-4dc6-8623-2012fe935c2e None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:34.922599 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 67/137] 10.222.0.102 () {58 vars in 1444 bytes} [Mon Aug 1 15:24:34 2022] PUT /identity/v3/projects/dfcf3ac155ec4ab1b51e9b6849baec64/users/d63a704c427d4f18a40f7ba2bdc48254/roles/5acf9fe30ec74532a49ebed755ea61e4 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:24:35.279508 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4934d6fb-7022-4b03-9499-f44f5ec503d1 None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:35.280505 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4934d6fb-7022-4b03-9499-f44f5ec503d1 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:35.281024 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4934d6fb-7022-4b03-9499-f44f5ec503d1 None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:35.282592 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 71/138] 10.222.0.102 () {54 vars in 931 bytes} [Mon Aug 1 15:24:35 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 15:24:35.288837 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753a34f4-7bde-4949-84db-be999785a3cd None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:35.289825 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753a34f4-7bde-4949-84db-be999785a3cd None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:35.290023 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753a34f4-7bde-4949-84db-be999785a3cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:35.314308 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad39c615-0a86-4d0d-8392-c0e174419d51 None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:35.314622 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-753a34f4-7bde-4949-84db-be999785a3cd None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:24:35.315112 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad39c615-0a86-4d0d-8392-c0e174419d51 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:35.315615 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad39c615-0a86-4d0d-8392-c0e174419d51 None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:35.315869 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-753a34f4-7bde-4949-84db-be999785a3cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:24:35.317415 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 72/139] 10.222.0.102 () {54 vars in 931 bytes} [Mon Aug 1 15:24:35 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 01 15:24:35.328825 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a304a7-3a28-4258-adbc-49759fcbab4e None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:35.329137 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a304a7-3a28-4258-adbc-49759fcbab4e None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:35.329419 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a304a7-3a28-4258-adbc-49759fcbab4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:35.361886 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-51a304a7-3a28-4258-adbc-49759fcbab4e None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:24:35.363097 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-51a304a7-3a28-4258-adbc-49759fcbab4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:24:35.399440 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 68/140] 10.222.0.102 () {58 vars in 1028 bytes} [Mon Aug 1 15:24:35 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 15:24:35.399943 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:35.438441 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753a34f4-7bde-4949-84db-be999785a3cd None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:35.485725 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 73/141] 10.222.0.102 () {58 vars in 1028 bytes} [Mon Aug 1 15:24:35 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 15:24:35.573460 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753a34f4-7bde-4949-84db-be999785a3cd None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:35.576578 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a304a7-3a28-4258-adbc-49759fcbab4e None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:35.649603 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cb8e4c-6e00-4135-a1d8-08a10059a089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:35.650571 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cb8e4c-6e00-4135-a1d8-08a10059a089 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:35.651053 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cb8e4c-6e00-4135-a1d8-08a10059a089 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:35.651492 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cb8e4c-6e00-4135-a1d8-08a10059a089 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:35.666367 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cb8e4c-6e00-4135-a1d8-08a10059a089 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:24:35.677310 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-30cb8e4c-6e00-4135-a1d8-08a10059a089 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 01 15:24:35.677310 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:24:35.677310 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:24:35.677310 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:24:35.677310 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:24:35.677310 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:24:35.677310 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:24:35.677310 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:24:35.677310 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:24:35.677310 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:24:35.677310 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:24:35.677310 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:24:35.677310 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:24:35.677310 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:24:35.677310 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:24:35.677310 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:24:35.697112 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:24:35.697112 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:24:35.697112 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:24:35.697112 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:24:35.697112 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:24:35.697112 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:24:35.697112 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:24:35.697112 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:24:35.697112 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:24:35.697112 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:24:35.697112 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:24:35.697112 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 01 15:24:35.697112 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:24:35.697112 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:24:35.697112 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:24:35.697112 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:24:35.697948 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:24:35.697948 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:24:35.697948 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:24:35.697948 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:24:35.697948 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:24:35.697948 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:24:35.697948 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:24:35.697948 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:24:35.697948 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:24:35.697948 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:24:35.697948 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 01 15:24:35.697948 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 01 15:24:35.698534 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:35.698602 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 69/142] 10.222.0.102 () {56 vars in 1104 bytes} [Mon Aug 1 15:24:35 2022] GET /identity/v3/roles/reader => generated 84 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:24:35.698602 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cb8e4c-6e00-4135-a1d8-08a10059a089 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:35.704888 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a304a7-3a28-4258-adbc-49759fcbab4e None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:35.743458 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2054482-cb50-4c93-b679-17139baa53ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:35.743458 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2054482-cb50-4c93-b679-17139baa53ec None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:35.743458 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2054482-cb50-4c93-b679-17139baa53ec None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:35.743458 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2054482-cb50-4c93-b679-17139baa53ec None admin] PATH_INFO: `/v3/domains/default` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:35.743882 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2054482-cb50-4c93-b679-17139baa53ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:35.743882 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2054482-cb50-4c93-b679-17139baa53ec None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:35.744027 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 74/143] 10.222.0.102 () {56 vars in 1113 bytes} [Mon Aug 1 15:24:35 2022] GET /identity/v3/domains/default => generated 200 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:24:35.749728 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2054482-cb50-4c93-b679-17139baa53ec None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:35.795306 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:35.857570 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2054482-cb50-4c93-b679-17139baa53ec None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:35.881068 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cb8e4c-6e00-4135-a1d8-08a10059a089 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:35.897933 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f053a4-9581-4c58-a317-0ef1cf56cec6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:35.898565 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f053a4-9581-4c58-a317-0ef1cf56cec6 None admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:35.898935 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f053a4-9581-4c58-a317-0ef1cf56cec6 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:35.899212 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f053a4-9581-4c58-a317-0ef1cf56cec6 None admin] PATH_INFO: `/v3/users` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:35.899907 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f053a4-9581-4c58-a317-0ef1cf56cec6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:35.902231 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f053a4-9581-4c58-a317-0ef1cf56cec6 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:35.937373 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fbab5a-07f8-4a8b-88f0-bf6ad0197eae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:35.938093 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fbab5a-07f8-4a8b-88f0-bf6ad0197eae None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:35.938385 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fbab5a-07f8-4a8b-88f0-bf6ad0197eae None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:35.938671 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fbab5a-07f8-4a8b-88f0-bf6ad0197eae None admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:35.939517 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fbab5a-07f8-4a8b-88f0-bf6ad0197eae None admin] RBAC: Adding query filter params (name=reader) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:35.939833 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fbab5a-07f8-4a8b-88f0-bf6ad0197eae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:35.941370 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fbab5a-07f8-4a8b-88f0-bf6ad0197eae None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:35.950958 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 70/144] 10.222.0.102 () {56 vars in 1106 bytes} [Mon Aug 1 15:24:35 2022] GET /identity/v3/roles?name=reader => generated 343 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:24:35.957867 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fbab5a-07f8-4a8b-88f0-bf6ad0197eae None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:36.010448 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:36.016286 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 75/145] 10.222.0.102 () {60 vars in 1137 bytes} [Mon Aug 1 15:24:35 2022] POST /identity/v3/users => generated 284 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:24:36.104346 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fbab5a-07f8-4a8b-88f0-bf6ad0197eae None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:36.138739 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:36.157330 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81c562f-1677-4ac9-9767-9e9e72c02f0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:36.158013 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81c562f-1677-4ac9-9767-9e9e72c02f0e None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:36.158302 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81c562f-1677-4ac9-9767-9e9e72c02f0e None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:36.158584 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81c562f-1677-4ac9-9767-9e9e72c02f0e None admin] PATH_INFO: `/v3/users/1529e1cc2932475a8f3b33c10ed2796a` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:36.161039 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81c562f-1677-4ac9-9767-9e9e72c02f0e None admin] RBAC: Authorizing `identity:get_user(user_id=1529e1cc2932475a8f3b33c10ed2796a)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:36.162713 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81c562f-1677-4ac9-9767-9e9e72c02f0e None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:36.164501 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 71/146] 10.222.0.102 () {56 vars in 1182 bytes} [Mon Aug 1 15:24:35 2022] GET /identity/v3/users/1529e1cc2932475a8f3b33c10ed2796a => generated 290 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:36.170371 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f053a4-9581-4c58-a317-0ef1cf56cec6 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:36.306097 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f053a4-9581-4c58-a317-0ef1cf56cec6 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:36.343602 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99eb0169-e881-4b69-9df0-d44efc4c8822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:36.344261 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99eb0169-e881-4b69-9df0-d44efc4c8822 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:36.344593 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99eb0169-e881-4b69-9df0-d44efc4c8822 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:36.344900 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99eb0169-e881-4b69-9df0-d44efc4c8822 None admin] PATH_INFO: `/v3/projects/dfcf3ac155ec4ab1b51e9b6849baec64` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:36.346135 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99eb0169-e881-4b69-9df0-d44efc4c8822 None admin] RBAC: Authorizing `identity:get_project(project_id=dfcf3ac155ec4ab1b51e9b6849baec64)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:36.347727 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99eb0169-e881-4b69-9df0-d44efc4c8822 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:36.349452 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 76/147] 10.222.0.102 () {56 vars in 1191 bytes} [Mon Aug 1 15:24:36 2022] GET /identity/v3/projects/dfcf3ac155ec4ab1b51e9b6849baec64 => generated 299 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:36.358015 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81c562f-1677-4ac9-9767-9e9e72c02f0e None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:36.470485 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81c562f-1677-4ac9-9767-9e9e72c02f0e None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:36.513007 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0296a847-0024-46d8-8f8e-e8fe0c27388d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:36.513758 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0296a847-0024-46d8-8f8e-e8fe0c27388d None admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:36.514047 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0296a847-0024-46d8-8f8e-e8fe0c27388d None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:36.514327 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0296a847-0024-46d8-8f8e-e8fe0c27388d None admin] PATH_INFO: `/v3/projects/dfcf3ac155ec4ab1b51e9b6849baec64/users/1529e1cc2932475a8f3b33c10ed2796a/roles/d517cfa9ee3e4f2b946b50d2236338f3` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:36.516432 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0296a847-0024-46d8-8f8e-e8fe0c27388d None admin] RBAC: Authorizing `identity:create_grant(project_id=dfcf3ac155ec4ab1b51e9b6849baec64, user_id=1529e1cc2932475a8f3b33c10ed2796a, role_id=d517cfa9ee3e4f2b946b50d2236338f3)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:36.517943 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0296a847-0024-46d8-8f8e-e8fe0c27388d None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:36.607262 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 72/148] 10.222.0.102 () {58 vars in 1444 bytes} [Mon Aug 1 15:24:36 2022] PUT /identity/v3/projects/dfcf3ac155ec4ab1b51e9b6849baec64/users/1529e1cc2932475a8f3b33c10ed2796a/roles/d517cfa9ee3e4f2b946b50d2236338f3 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:24:37.038512 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6798a89c-2a1b-4106-a516-4b0714ab0b26 None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:37.038865 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6798a89c-2a1b-4106-a516-4b0714ab0b26 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:37.039074 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6798a89c-2a1b-4106-a516-4b0714ab0b26 None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:37.041208 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 77/149] 10.222.0.102 () {54 vars in 931 bytes} [Mon Aug 1 15:24:37 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 15:24:37.057556 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044ff54a-9532-4fc7-ac7c-cfbcfa041b37 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:37.057859 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044ff54a-9532-4fc7-ac7c-cfbcfa041b37 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:37.058123 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044ff54a-9532-4fc7-ac7c-cfbcfa041b37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:37.080430 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-044ff54a-9532-4fc7-ac7c-cfbcfa041b37 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:24:37.081679 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-044ff54a-9532-4fc7-ac7c-cfbcfa041b37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:24:37.137248 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:37.166300 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 73/150] 10.222.0.102 () {58 vars in 1028 bytes} [Mon Aug 1 15:24:37 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 15:24:37.191857 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6798a89c-2a1b-4106-a516-4b0714ab0b26 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:37.265373 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5e83d2-d5c6-4304-a15e-44c8b9239f18 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:37.265680 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5e83d2-d5c6-4304-a15e-44c8b9239f18 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:37.265932 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5e83d2-d5c6-4304-a15e-44c8b9239f18 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:37.267545 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 74/151] 10.222.0.102 () {54 vars in 931 bytes} [Mon Aug 1 15:24:37 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 15:24:37.272894 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b436f2a-a42b-4c67-ba26-8cd5a38710f8 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:37.273230 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b436f2a-a42b-4c67-ba26-8cd5a38710f8 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:37.273510 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b436f2a-a42b-4c67-ba26-8cd5a38710f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:37.285224 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:37.302487 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-1b436f2a-a42b-4c67-ba26-8cd5a38710f8 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:24:37.303829 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-1b436f2a-a42b-4c67-ba26-8cd5a38710f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:24:37.349941 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6798a89c-2a1b-4106-a516-4b0714ab0b26 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:37.390322 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 75/152] 10.222.0.102 () {58 vars in 1028 bytes} [Mon Aug 1 15:24:37 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 01 15:24:37.433588 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b436f2a-a42b-4c67-ba26-8cd5a38710f8 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:37.458212 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd5aae1-bca4-4ac5-8dcb-91bf3b9893db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:37.458872 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd5aae1-bca4-4ac5-8dcb-91bf3b9893db None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:37.459153 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd5aae1-bca4-4ac5-8dcb-91bf3b9893db None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:37.459451 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd5aae1-bca4-4ac5-8dcb-91bf3b9893db None admin] PATH_INFO: `/v3/roles/member` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:37.494309 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd5aae1-bca4-4ac5-8dcb-91bf3b9893db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:24:37.499816 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-cfd5aae1-bca4-4ac5-8dcb-91bf3b9893db None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 01 15:24:37.499816 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:24:37.499816 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:24:37.499816 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:24:37.499816 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:24:37.499816 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:24:37.499816 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:24:37.499816 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:24:37.499816 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:24:37.499816 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:24:37.499816 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:24:37.499816 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:24:37.499816 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:24:37.499816 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:24:37.499816 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:24:37.499816 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:24:37.500671 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:24:37.500671 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:24:37.500671 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:24:37.500671 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:24:37.500671 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:24:37.500671 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:24:37.500671 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:24:37.500671 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:24:37.500671 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:24:37.500671 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:24:37.500671 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:24:37.500671 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 01 15:24:37.500671 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:24:37.500671 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:24:37.500671 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:24:37.500671 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:24:37.501495 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:24:37.501495 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:24:37.501495 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:24:37.501495 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:24:37.501495 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:24:37.501495 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:24:37.501495 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:24:37.501495 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:24:37.501495 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:24:37.501495 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:24:37.501495 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 01 15:24:37.501495 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 01 15:24:37.505325 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 78/153] 10.222.0.102 () {56 vars in 1104 bytes} [Mon Aug 1 15:24:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:24:37.521909 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd5aae1-bca4-4ac5-8dcb-91bf3b9893db None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:37.579997 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b436f2a-a42b-4c67-ba26-8cd5a38710f8 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:37.598492 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:37.622715 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144b7fd0-dc00-4e12-b982-82bb6164b763 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:37.623373 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144b7fd0-dc00-4e12-b982-82bb6164b763 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:37.623659 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144b7fd0-dc00-4e12-b982-82bb6164b763 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:37.624049 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144b7fd0-dc00-4e12-b982-82bb6164b763 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:37.652577 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144b7fd0-dc00-4e12-b982-82bb6164b763 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:24:37.660534 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-144b7fd0-dc00-4e12-b982-82bb6164b763 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 01 15:24:37.660534 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:24:37.660534 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:24:37.660534 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:24:37.660534 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:24:37.660534 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:24:37.660534 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:24:37.660534 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:24:37.660534 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:24:37.660534 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:24:37.660534 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:24:37.660534 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:24:37.660534 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:24:37.660534 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:24:37.660534 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:24:37.660534 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:24:37.661632 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:24:37.661632 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:24:37.661632 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:24:37.661632 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:24:37.661632 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:24:37.661632 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:24:37.661632 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:24:37.661632 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:24:37.661632 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:24:37.661632 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:24:37.661632 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:24:37.661632 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 01 15:24:37.661632 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:24:37.661632 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:24:37.661632 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:24:37.661632 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:24:37.662461 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:24:37.662461 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:24:37.662461 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:24:37.662461 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:24:37.662461 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:24:37.662461 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:24:37.662461 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:24:37.662461 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:24:37.662461 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:24:37.662461 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:24:37.662461 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 01 15:24:37.662461 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 01 15:24:37.666247 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 76/154] 10.222.0.102 () {56 vars in 1104 bytes} [Mon Aug 1 15:24:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 15:24:37.672453 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144b7fd0-dc00-4e12-b982-82bb6164b763 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:37.776874 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd5aae1-bca4-4ac5-8dcb-91bf3b9893db None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:37.812767 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:37.821737 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144b7fd0-dc00-4e12-b982-82bb6164b763 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:37.837560 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8b376d-3373-4007-9c84-5892cc965aaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:37.838197 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8b376d-3373-4007-9c84-5892cc965aaf None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:37.838479 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8b376d-3373-4007-9c84-5892cc965aaf None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:37.838756 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8b376d-3373-4007-9c84-5892cc965aaf None admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:37.839480 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8b376d-3373-4007-9c84-5892cc965aaf None admin] RBAC: Adding query filter params (name=member) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:37.839781 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8b376d-3373-4007-9c84-5892cc965aaf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:37.841208 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8b376d-3373-4007-9c84-5892cc965aaf None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:37.853157 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 79/155] 10.222.0.102 () {56 vars in 1106 bytes} [Mon Aug 1 15:24:37 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:37.865543 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b495d87-a853-40a4-ad88-844a0323303c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:37.866180 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b495d87-a853-40a4-ad88-844a0323303c None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:37.866463 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b495d87-a853-40a4-ad88-844a0323303c None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:37.866737 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b495d87-a853-40a4-ad88-844a0323303c None admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:37.867511 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b495d87-a853-40a4-ad88-844a0323303c None admin] RBAC: Adding query filter params (name=member) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:37.867814 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b495d87-a853-40a4-ad88-844a0323303c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:37.869233 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b495d87-a853-40a4-ad88-844a0323303c None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:37.879364 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8b376d-3373-4007-9c84-5892cc965aaf None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:37.881195 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 77/156] 10.222.0.102 () {56 vars in 1106 bytes} [Mon Aug 1 15:24:37 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:37.889172 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b495d87-a853-40a4-ad88-844a0323303c None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:37.961900 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:38.117759 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b495d87-a853-40a4-ad88-844a0323303c None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:38.124646 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8b376d-3373-4007-9c84-5892cc965aaf None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:38.173496 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86210acc-ecd2-4971-8141-5eb598eb5148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:38.174514 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86210acc-ecd2-4971-8141-5eb598eb5148 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:38.175013 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86210acc-ecd2-4971-8141-5eb598eb5148 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:38.175477 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86210acc-ecd2-4971-8141-5eb598eb5148 None admin] PATH_INFO: `/v3/users/d63a704c427d4f18a40f7ba2bdc48254` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:38.177010 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86210acc-ecd2-4971-8141-5eb598eb5148 None admin] RBAC: Authorizing `identity:get_user(user_id=d63a704c427d4f18a40f7ba2bdc48254)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:38.178682 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86210acc-ecd2-4971-8141-5eb598eb5148 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:38.181049 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 78/157] 10.222.0.102 () {56 vars in 1182 bytes} [Mon Aug 1 15:24:37 2022] GET /identity/v3/users/d63a704c427d4f18a40f7ba2bdc48254 => generated 276 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:38.182796 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc86c64-ff4d-4f14-b221-a5d2771840af None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:38.183771 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc86c64-ff4d-4f14-b221-a5d2771840af None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:38.184699 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc86c64-ff4d-4f14-b221-a5d2771840af None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:38.188412 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f667b5e-d73d-400c-99aa-18e3dc079f10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:38.189344 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f667b5e-d73d-400c-99aa-18e3dc079f10 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:38.189837 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f667b5e-d73d-400c-99aa-18e3dc079f10 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:38.190329 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f667b5e-d73d-400c-99aa-18e3dc079f10 None admin] PATH_INFO: `/v3/users/d63a704c427d4f18a40f7ba2bdc48254` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:38.191316 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 79/158] 10.222.0.102 () {54 vars in 931 bytes} [Mon Aug 1 15:24:38 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 15:24:38.192203 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f667b5e-d73d-400c-99aa-18e3dc079f10 None admin] RBAC: Authorizing `identity:get_user(user_id=d63a704c427d4f18a40f7ba2bdc48254)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:38.194811 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43ed394-793a-4004-8b4a-9f16af6fc4fe None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:38.195476 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f667b5e-d73d-400c-99aa-18e3dc079f10 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:38.196507 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43ed394-793a-4004-8b4a-9f16af6fc4fe None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:38.196999 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43ed394-793a-4004-8b4a-9f16af6fc4fe None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:38.200472 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 80/159] 10.222.0.102 () {54 vars in 931 bytes} [Mon Aug 1 15:24:38 2022] GET /identity => generated 271 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 15:24:38.205154 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 80/160] 10.222.0.102 () {56 vars in 1182 bytes} [Mon Aug 1 15:24:37 2022] GET /identity/v3/users/d63a704c427d4f18a40f7ba2bdc48254 => generated 276 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:38.206661 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05178895-f60d-4140-8222-c8bff20978e6 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:38.207490 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43ed394-793a-4004-8b4a-9f16af6fc4fe None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:38.208398 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05178895-f60d-4140-8222-c8bff20978e6 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:38.209343 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05178895-f60d-4140-8222-c8bff20978e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:38.247988 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-05178895-f60d-4140-8222-c8bff20978e6 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:24:38.249666 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-05178895-f60d-4140-8222-c8bff20978e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:24:38.375174 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:38.409456 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 81/161] 10.222.0.102 () {58 vars in 1028 bytes} [Mon Aug 1 15:24:38 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 15:24:38.410982 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05178895-f60d-4140-8222-c8bff20978e6 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:38.457882 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:38.470529 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43ed394-793a-4004-8b4a-9f16af6fc4fe None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:38.556379 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54aac264-9dac-42f8-a3ef-bfa2f6ae855a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:38.557344 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aac264-9dac-42f8-a3ef-bfa2f6ae855a None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:38.557771 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aac264-9dac-42f8-a3ef-bfa2f6ae855a None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:38.558186 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aac264-9dac-42f8-a3ef-bfa2f6ae855a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:38.616754 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05178895-f60d-4140-8222-c8bff20978e6 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:38.698959 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38af8b44-c5e1-4fa1-b1f2-4b2e7d8e5c37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:38.699613 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38af8b44-c5e1-4fa1-b1f2-4b2e7d8e5c37 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:38.699882 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38af8b44-c5e1-4fa1-b1f2-4b2e7d8e5c37 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:38.700168 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38af8b44-c5e1-4fa1-b1f2-4b2e7d8e5c37 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:38.727511 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54aac264-9dac-42f8-a3ef-bfa2f6ae855a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:38.729039 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54aac264-9dac-42f8-a3ef-bfa2f6ae855a None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:38.823556 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:38.848731 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38af8b44-c5e1-4fa1-b1f2-4b2e7d8e5c37 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:38.850324 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38af8b44-c5e1-4fa1-b1f2-4b2e7d8e5c37 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:38.870263 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:38.883747 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 81/162] 10.222.0.102 () {58 vars in 1287 bytes} [Mon Aug 1 15:24:38 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 683 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 15:24:38.890289 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54add718-ed8d-4e38-8f68-e3160533b777 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:38.890574 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54add718-ed8d-4e38-8f68-e3160533b777 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:38.890993 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54add718-ed8d-4e38-8f68-e3160533b777 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:38.923093 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-54add718-ed8d-4e38-8f68-e3160533b777 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:24:38.925101 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-54add718-ed8d-4e38-8f68-e3160533b777 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:24:39.052349 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 82/163] 10.222.0.102 () {58 vars in 1028 bytes} [Mon Aug 1 15:24:38 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 15:24:39.052700 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54add718-ed8d-4e38-8f68-e3160533b777 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:39.100073 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 82/164] 10.222.0.102 () {58 vars in 1287 bytes} [Mon Aug 1 15:24:38 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 690 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 15:24:39.100779 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38af8b44-c5e1-4fa1-b1f2-4b2e7d8e5c37 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:39.173008 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54add718-ed8d-4e38-8f68-e3160533b777 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:39.219543 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:39.228059 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb34578d-1a08-474b-8440-bc3f142c3b38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:39.230054 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb34578d-1a08-474b-8440-bc3f142c3b38 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:39.230740 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb34578d-1a08-474b-8440-bc3f142c3b38 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:39.231841 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb34578d-1a08-474b-8440-bc3f142c3b38 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:39.232319 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:39.258546 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb34578d-1a08-474b-8440-bc3f142c3b38 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:24:39.266645 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-bb34578d-1a08-474b-8440-bc3f142c3b38 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 15:24:39.266645 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:24:39.266645 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:24:39.266645 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:24:39.266645 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:24:39.266645 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:24:39.266645 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:24:39.266645 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:24:39.266645 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:24:39.266645 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:24:39.266645 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:24:39.266645 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:24:39.266645 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:24:39.266645 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:24:39.266645 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:24:39.266645 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:24:39.267757 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:24:39.267757 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:24:39.267757 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:24:39.267757 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:24:39.267757 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:24:39.267757 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:24:39.267757 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:24:39.267757 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:24:39.267757 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:24:39.267757 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:24:39.267757 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:24:39.267757 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 01 15:24:39.267757 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:24:39.267757 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:24:39.267757 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:24:39.267757 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:24:39.268796 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:24:39.268796 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:24:39.268796 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:24:39.268796 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:24:39.268796 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:24:39.268796 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:24:39.268796 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:24:39.268796 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:24:39.268796 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:24:39.268796 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:24:39.268796 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 15:24:39.268796 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 01 15:24:39.271512 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38af8b44-c5e1-4fa1-b1f2-4b2e7d8e5c37 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:39.276626 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 83/165] 10.222.0.102 () {56 vars in 1101 bytes} [Mon Aug 1 15:24:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:24:39.277688 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb34578d-1a08-474b-8440-bc3f142c3b38 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:39.341627 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7229423b-aed3-4e22-963d-27654aa5203b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:39.342551 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7229423b-aed3-4e22-963d-27654aa5203b None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:39.343230 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7229423b-aed3-4e22-963d-27654aa5203b None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:39.345682 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7229423b-aed3-4e22-963d-27654aa5203b None admin] PATH_INFO: `/v3/projects/dfcf3ac155ec4ab1b51e9b6849baec64` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:39.347141 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7229423b-aed3-4e22-963d-27654aa5203b None admin] RBAC: Authorizing `identity:get_project(project_id=dfcf3ac155ec4ab1b51e9b6849baec64)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:39.348763 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7229423b-aed3-4e22-963d-27654aa5203b None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:39.353752 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 83/166] 10.222.0.102 () {56 vars in 1191 bytes} [Mon Aug 1 15:24:39 2022] GET /identity/v3/projects/dfcf3ac155ec4ab1b51e9b6849baec64 => generated 299 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:39.358479 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7229423b-aed3-4e22-963d-27654aa5203b None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:39.465041 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb34578d-1a08-474b-8440-bc3f142c3b38 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:39.504466 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55364f9-0a30-45e0-b250-cc37f7119d0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:39.505493 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55364f9-0a30-45e0-b250-cc37f7119d0b None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:39.505938 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55364f9-0a30-45e0-b250-cc37f7119d0b None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:39.506424 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55364f9-0a30-45e0-b250-cc37f7119d0b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:39.518859 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55364f9-0a30-45e0-b250-cc37f7119d0b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:24:39.524489 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-f55364f9-0a30-45e0-b250-cc37f7119d0b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 01 15:24:39.524489 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:24:39.524489 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:24:39.524489 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:24:39.524489 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:24:39.524489 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:24:39.524489 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:24:39.524489 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:24:39.524489 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:24:39.524489 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:24:39.524489 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:24:39.524489 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:24:39.524489 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:24:39.524489 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:24:39.524489 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:24:39.524489 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:24:39.525684 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:24:39.525684 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:24:39.525684 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:24:39.525684 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:24:39.525684 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:24:39.525684 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:24:39.525684 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:24:39.525684 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:24:39.525684 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:24:39.525684 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:24:39.525684 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:24:39.525684 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 01 15:24:39.525684 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:24:39.525684 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:24:39.525684 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:24:39.525684 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:24:39.526657 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:24:39.526657 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:24:39.526657 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:24:39.526657 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:24:39.526657 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:24:39.526657 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:24:39.526657 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:24:39.526657 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:24:39.526657 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:24:39.526657 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:24:39.526657 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 01 15:24:39.526657 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 01 15:24:39.528630 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 84/167] 10.222.0.102 () {56 vars in 1119 bytes} [Mon Aug 1 15:24:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:24:39.529635 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55364f9-0a30-45e0-b250-cc37f7119d0b None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:39.583923 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7229423b-aed3-4e22-963d-27654aa5203b None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:39.588294 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:39.642481 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55364f9-0a30-45e0-b250-cc37f7119d0b None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:39.681602 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d2cb22-15dc-4d94-ab28-8e7cc679e767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:39.684567 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c812b9fb-afb7-4321-a16c-b27f13d4b261 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:39.684712 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d2cb22-15dc-4d94-ab28-8e7cc679e767 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:39.684811 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c812b9fb-afb7-4321-a16c-b27f13d4b261 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:39.684935 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d2cb22-15dc-4d94-ab28-8e7cc679e767 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:39.685020 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c812b9fb-afb7-4321-a16c-b27f13d4b261 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:39.685122 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d2cb22-15dc-4d94-ab28-8e7cc679e767 None admin] PATH_INFO: `/v3/projects/608271161577443ea9dd232f7b3f34ba` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:39.685207 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c812b9fb-afb7-4321-a16c-b27f13d4b261 None admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:39.685207 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c812b9fb-afb7-4321-a16c-b27f13d4b261 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:39.685376 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d2cb22-15dc-4d94-ab28-8e7cc679e767 None admin] RBAC: Authorizing `identity:get_project(project_id=608271161577443ea9dd232f7b3f34ba)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:39.685458 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c812b9fb-afb7-4321-a16c-b27f13d4b261 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:39.685619 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d2cb22-15dc-4d94-ab28-8e7cc679e767 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:39.686919 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c812b9fb-afb7-4321-a16c-b27f13d4b261 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:39.687467 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 84/168] 10.222.0.102 () {56 vars in 1191 bytes} [Mon Aug 1 15:24:39 2022] GET /identity/v3/projects/608271161577443ea9dd232f7b3f34ba => generated 313 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:39.688242 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d2cb22-15dc-4d94-ab28-8e7cc679e767 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:39.703099 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 85/169] 10.222.0.102 () {56 vars in 1104 bytes} [Mon Aug 1 15:24:39 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:39.703952 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c812b9fb-afb7-4321-a16c-b27f13d4b261 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:39.728641 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:39.846450 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c812b9fb-afb7-4321-a16c-b27f13d4b261 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:39.972825 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:39.973935 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d2cb22-15dc-4d94-ab28-8e7cc679e767 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:39.974097 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfecb80-0957-4efc-8857-12891e08d544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:39.974097 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfecb80-0957-4efc-8857-12891e08d544 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:39.974097 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfecb80-0957-4efc-8857-12891e08d544 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:39.974097 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfecb80-0957-4efc-8857-12891e08d544 None admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:39.974600 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfecb80-0957-4efc-8857-12891e08d544 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:39.974600 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfecb80-0957-4efc-8857-12891e08d544 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:39.974600 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfecb80-0957-4efc-8857-12891e08d544 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:39.986496 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e403b92d-d029-4fc2-b189-9da936fb4eb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:39.987117 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e403b92d-d029-4fc2-b189-9da936fb4eb5 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:39.987393 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e403b92d-d029-4fc2-b189-9da936fb4eb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:39.987662 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e403b92d-d029-4fc2-b189-9da936fb4eb5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:39.988457 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e403b92d-d029-4fc2-b189-9da936fb4eb5 None admin] RBAC: Adding query filter params (role.id=27f5093ac0674d799cdbd17c68482e32, scope.project.id=dfcf3ac155ec4ab1b51e9b6849baec64, user.id=d63a704c427d4f18a40f7ba2bdc48254) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:39.993363 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e403b92d-d029-4fc2-b189-9da936fb4eb5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:39.994826 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e403b92d-d029-4fc2-b189-9da936fb4eb5 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:39.997024 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 86/170] 10.222.0.102 () {56 vars in 1116 bytes} [Mon Aug 1 15:24:39 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:39.997937 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfecb80-0957-4efc-8857-12891e08d544 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:40.019492 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 85/171] 10.222.0.102 () {56 vars in 1379 bytes} [Mon Aug 1 15:24:39 2022] GET /identity/v3/role_assignments?user.id=d63a704c427d4f18a40f7ba2bdc48254&scope.project.id=dfcf3ac155ec4ab1b51e9b6849baec64&role.id=27f5093ac0674d799cdbd17c68482e32 => generated 610 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:40.020362 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e403b92d-d029-4fc2-b189-9da936fb4eb5 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:40.209015 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:40.222754 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfecb80-0957-4efc-8857-12891e08d544 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:40.247375 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e403b92d-d029-4fc2-b189-9da936fb4eb5 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:40.293319 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09632b13-8f19-43d6-8851-a2203c7c6fb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:40.294325 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09632b13-8f19-43d6-8851-a2203c7c6fb5 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:40.294817 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09632b13-8f19-43d6-8851-a2203c7c6fb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:40.295287 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09632b13-8f19-43d6-8851-a2203c7c6fb5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:40.296924 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09632b13-8f19-43d6-8851-a2203c7c6fb5 None admin] RBAC: Adding query filter params (role.id=27f5093ac0674d799cdbd17c68482e32, scope.project.id=608271161577443ea9dd232f7b3f34ba, user.id=d63a704c427d4f18a40f7ba2bdc48254) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:40.300086 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09632b13-8f19-43d6-8851-a2203c7c6fb5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:40.302896 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09632b13-8f19-43d6-8851-a2203c7c6fb5 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:40.313454 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 87/172] 10.222.0.102 () {56 vars in 1379 bytes} [Mon Aug 1 15:24:39 2022] GET /identity/v3/role_assignments?user.id=d63a704c427d4f18a40f7ba2bdc48254&scope.project.id=608271161577443ea9dd232f7b3f34ba&role.id=27f5093ac0674d799cdbd17c68482e32 => generated 610 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:40.314663 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1d3a63-7b99-42eb-81f2-f86130aee0ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:40.315091 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09632b13-8f19-43d6-8851-a2203c7c6fb5 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:40.315326 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1d3a63-7b99-42eb-81f2-f86130aee0ac None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:40.315610 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1d3a63-7b99-42eb-81f2-f86130aee0ac None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:40.315887 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1d3a63-7b99-42eb-81f2-f86130aee0ac None admin] PATH_INFO: `/v3/users/b6b2cd3e98284877b95b595df909c37d` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:40.317108 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1d3a63-7b99-42eb-81f2-f86130aee0ac None admin] RBAC: Authorizing `identity:get_user(user_id=b6b2cd3e98284877b95b595df909c37d)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:40.318572 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1d3a63-7b99-42eb-81f2-f86130aee0ac None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:40.325084 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 86/173] 10.222.0.102 () {56 vars in 1182 bytes} [Mon Aug 1 15:24:40 2022] GET /identity/v3/users/b6b2cd3e98284877b95b595df909c37d => generated 248 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:40.325084 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60e77c4-67e3-4d25-86a0-64d74aa2880f None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:40.325084 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60e77c4-67e3-4d25-86a0-64d74aa2880f None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:40.325084 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60e77c4-67e3-4d25-86a0-64d74aa2880f None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:40.325084 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 87/174] 10.222.0.102 () {54 vars in 931 bytes} [Mon Aug 1 15:24:40 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 15:24:40.325084 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efffe72f-b313-4c7e-ba2a-b98fca2d999f None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:40.325558 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efffe72f-b313-4c7e-ba2a-b98fca2d999f None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:40.325810 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efffe72f-b313-4c7e-ba2a-b98fca2d999f None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:40.328154 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 88/175] 10.222.0.102 () {54 vars in 931 bytes} [Mon Aug 1 15:24:40 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 15:24:40.330107 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4345fa-a060-419b-946c-cfd2160afe9f None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:40.330618 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4345fa-a060-419b-946c-cfd2160afe9f None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:40.330990 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4345fa-a060-419b-946c-cfd2160afe9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:40.370227 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-3c4345fa-a060-419b-946c-cfd2160afe9f None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:24:40.371680 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-3c4345fa-a060-419b-946c-cfd2160afe9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:24:40.391645 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:40.514795 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09632b13-8f19-43d6-8851-a2203c7c6fb5 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:40.527394 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 89/176] 10.222.0.102 () {58 vars in 1028 bytes} [Mon Aug 1 15:24:40 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 15:24:40.528695 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50aa3ee8-b138-4ab9-bbeb-ff01d19eec59 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:40.529012 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50aa3ee8-b138-4ab9-bbeb-ff01d19eec59 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:40.529341 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50aa3ee8-b138-4ab9-bbeb-ff01d19eec59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:40.561926 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-50aa3ee8-b138-4ab9-bbeb-ff01d19eec59 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:24:40.563156 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-50aa3ee8-b138-4ab9-bbeb-ff01d19eec59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:24:40.584117 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4343ebc8-dbe9-47b3-b7da-3dd4e9e014d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:40.584778 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4343ebc8-dbe9-47b3-b7da-3dd4e9e014d4 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:40.585078 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4343ebc8-dbe9-47b3-b7da-3dd4e9e014d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:40.585346 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4343ebc8-dbe9-47b3-b7da-3dd4e9e014d4 None admin] PATH_INFO: `/v3/users/d63a704c427d4f18a40f7ba2bdc48254` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:40.586643 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4343ebc8-dbe9-47b3-b7da-3dd4e9e014d4 None admin] RBAC: Authorizing `identity:get_user(user_id=d63a704c427d4f18a40f7ba2bdc48254)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:40.588084 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4343ebc8-dbe9-47b3-b7da-3dd4e9e014d4 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:40.589723 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 88/177] 10.222.0.102 () {56 vars in 1182 bytes} [Mon Aug 1 15:24:40 2022] GET /identity/v3/users/d63a704c427d4f18a40f7ba2bdc48254 => generated 276 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:40.590488 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4343ebc8-dbe9-47b3-b7da-3dd4e9e014d4 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:40.656878 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 90/178] 10.222.0.102 () {58 vars in 1028 bytes} [Mon Aug 1 15:24:40 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 15:24:40.656878 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50aa3ee8-b138-4ab9-bbeb-ff01d19eec59 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:40.671832 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:40.720644 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4343ebc8-dbe9-47b3-b7da-3dd4e9e014d4 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:40.729219 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:40.765243 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e8a64a-985c-47c9-9fd2-954035123c6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:40.765800 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e8a64a-985c-47c9-9fd2-954035123c6f None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:40.766086 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e8a64a-985c-47c9-9fd2-954035123c6f None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:40.766364 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e8a64a-985c-47c9-9fd2-954035123c6f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:40.778833 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50aa3ee8-b138-4ab9-bbeb-ff01d19eec59 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:40.814000 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24314ca2-5eb3-4ce2-9118-e56e2d145a2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:40.814643 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24314ca2-5eb3-4ce2-9118-e56e2d145a2d None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:40.814921 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24314ca2-5eb3-4ce2-9118-e56e2d145a2d None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:40.815193 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24314ca2-5eb3-4ce2-9118-e56e2d145a2d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:40.825657 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24314ca2-5eb3-4ce2-9118-e56e2d145a2d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:24:40.830865 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-24314ca2-5eb3-4ce2-9118-e56e2d145a2d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 01 15:24:40.830865 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:24:40.830865 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:24:40.830865 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:24:40.830865 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:24:40.830865 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:24:40.830865 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:24:40.830865 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:24:40.830865 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:24:40.830865 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:24:40.830865 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:24:40.830865 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:24:40.830865 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:24:40.830865 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:24:40.830865 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:24:40.830865 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:24:40.831757 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:24:40.831757 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:24:40.831757 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:24:40.831757 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:24:40.831757 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:24:40.831757 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:24:40.831757 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:24:40.831757 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:24:40.831757 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:24:40.831757 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:24:40.831757 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:24:40.831757 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 01 15:24:40.831757 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:24:40.831757 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:24:40.831757 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:24:40.831757 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:24:40.838185 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:24:40.838185 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:24:40.838185 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:24:40.838185 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:24:40.838185 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:24:40.838185 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:24:40.838185 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:24:40.838185 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:24:40.838185 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:24:40.838185 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:24:40.838185 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 01 15:24:40.838185 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 01 15:24:40.838185 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 91/179] 10.222.0.102 () {56 vars in 1104 bytes} [Mon Aug 1 15:24:40 2022] GET /identity/v3/roles/reader => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:24:40.838185 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24314ca2-5eb3-4ce2-9118-e56e2d145a2d None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:40.851089 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e8a64a-985c-47c9-9fd2-954035123c6f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:40.853490 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e8a64a-985c-47c9-9fd2-954035123c6f None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:40.923013 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:40.948119 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24314ca2-5eb3-4ce2-9118-e56e2d145a2d None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:40.958210 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 89/180] 10.222.0.102 () {58 vars in 1287 bytes} [Mon Aug 1 15:24:40 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 15:24:40.959566 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a43139d-2950-48fe-a56e-922a35e2e702 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:40.959856 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a43139d-2950-48fe-a56e-922a35e2e702 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:40.960132 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a43139d-2950-48fe-a56e-922a35e2e702 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:40.961957 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 90/181] 10.222.0.102 () {54 vars in 931 bytes} [Mon Aug 1 15:24:40 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 15:24:40.965619 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a43139d-2950-48fe-a56e-922a35e2e702 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:40.974343 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:40.986901 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8128b355-cc68-4114-835f-ee856fd1ff2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:40.987510 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8128b355-cc68-4114-835f-ee856fd1ff2c None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:40.987786 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8128b355-cc68-4114-835f-ee856fd1ff2c None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:40.988055 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8128b355-cc68-4114-835f-ee856fd1ff2c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:41.057803 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8128b355-cc68-4114-835f-ee856fd1ff2c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:41.059233 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8128b355-cc68-4114-835f-ee856fd1ff2c None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:41.069534 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a43139d-2950-48fe-a56e-922a35e2e702 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:41.104105 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a791f5b-5670-49e3-9a16-1372aa73497d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:41.104743 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a791f5b-5670-49e3-9a16-1372aa73497d None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:41.105048 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a791f5b-5670-49e3-9a16-1372aa73497d None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:41.105320 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a791f5b-5670-49e3-9a16-1372aa73497d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:41.115090 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a791f5b-5670-49e3-9a16-1372aa73497d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:24:41.120166 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-4a791f5b-5670-49e3-9a16-1372aa73497d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 15:24:41.120166 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:24:41.120166 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:24:41.120166 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:24:41.120166 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:24:41.120166 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:24:41.120166 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:24:41.120166 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:24:41.120166 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:24:41.120166 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:24:41.120166 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:24:41.120166 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:24:41.120166 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:24:41.120166 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:24:41.120166 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:24:41.120166 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:24:41.121328 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:24:41.121328 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:24:41.121328 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:24:41.121328 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:24:41.121328 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:24:41.121328 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:24:41.121328 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:24:41.121328 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:24:41.121328 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:24:41.121328 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:24:41.121328 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:24:41.121328 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 01 15:24:41.121328 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:24:41.121328 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:24:41.121328 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:24:41.121328 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:24:41.122125 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:24:41.122125 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:24:41.122125 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:24:41.122125 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:24:41.122125 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:24:41.122125 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:24:41.122125 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:24:41.122125 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:24:41.122125 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:24:41.122125 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:24:41.122125 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 15:24:41.122125 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 01 15:24:41.122125 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 91/182] 10.222.0.102 () {56 vars in 1101 bytes} [Mon Aug 1 15:24:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:24:41.122125 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a791f5b-5670-49e3-9a16-1372aa73497d None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:41.137207 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:41.162598 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 92/183] 10.222.0.102 () {58 vars in 1287 bytes} [Mon Aug 1 15:24:40 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 15:24:41.163931 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe12f3d-70e7-49f1-807e-525b3dd1b11f None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:41.164247 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe12f3d-70e7-49f1-807e-525b3dd1b11f None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:41.165145 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe12f3d-70e7-49f1-807e-525b3dd1b11f None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:41.166577 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 93/184] 10.222.0.102 () {54 vars in 931 bytes} [Mon Aug 1 15:24:41 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 15:24:41.167284 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe12f3d-70e7-49f1-807e-525b3dd1b11f None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:41.190093 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:41.224556 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a791f5b-5670-49e3-9a16-1372aa73497d None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:41.257873 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3deb8d4-4172-4941-ad50-2973aceeef95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:41.259006 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3deb8d4-4172-4941-ad50-2973aceeef95 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:41.259312 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3deb8d4-4172-4941-ad50-2973aceeef95 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:41.259584 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3deb8d4-4172-4941-ad50-2973aceeef95 None admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:41.260299 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3deb8d4-4172-4941-ad50-2973aceeef95 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:41.260604 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3deb8d4-4172-4941-ad50-2973aceeef95 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:41.262050 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3deb8d4-4172-4941-ad50-2973aceeef95 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:41.267189 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe12f3d-70e7-49f1-807e-525b3dd1b11f None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:41.270002 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 92/185] 10.222.0.102 () {56 vars in 1106 bytes} [Mon Aug 1 15:24:41 2022] GET /identity/v3/roles?name=reader => generated 343 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:41.271228 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd47142-d830-4513-80ce-0dc588a5f3aa None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:41.271531 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd47142-d830-4513-80ce-0dc588a5f3aa None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:41.271799 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd47142-d830-4513-80ce-0dc588a5f3aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:41.289783 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-2cd47142-d830-4513-80ce-0dc588a5f3aa None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:24:41.290977 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-2cd47142-d830-4513-80ce-0dc588a5f3aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:24:41.304191 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36c378c-dd30-4977-b00e-6f851dc856f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:41.304833 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36c378c-dd30-4977-b00e-6f851dc856f2 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:41.305139 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36c378c-dd30-4977-b00e-6f851dc856f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:41.305409 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36c378c-dd30-4977-b00e-6f851dc856f2 None admin] PATH_INFO: `/v3/projects/dfcf3ac155ec4ab1b51e9b6849baec64` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:41.306553 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36c378c-dd30-4977-b00e-6f851dc856f2 None admin] RBAC: Authorizing `identity:get_project(project_id=dfcf3ac155ec4ab1b51e9b6849baec64)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:41.308053 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36c378c-dd30-4977-b00e-6f851dc856f2 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:41.309688 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 94/186] 10.222.0.102 () {56 vars in 1191 bytes} [Mon Aug 1 15:24:41 2022] GET /identity/v3/projects/dfcf3ac155ec4ab1b51e9b6849baec64 => generated 299 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:41.310440 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36c378c-dd30-4977-b00e-6f851dc856f2 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:41.357217 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:41.361540 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 93/187] 10.222.0.102 () {58 vars in 1028 bytes} [Mon Aug 1 15:24:41 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 15:24:41.362529 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd47142-d830-4513-80ce-0dc588a5f3aa None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:41.416341 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36c378c-dd30-4977-b00e-6f851dc856f2 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:41.420296 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:41.450054 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e075d7a8-3fb3-4a63-9ac6-11f92351f790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:41.450656 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e075d7a8-3fb3-4a63-9ac6-11f92351f790 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:41.450936 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e075d7a8-3fb3-4a63-9ac6-11f92351f790 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:41.451198 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e075d7a8-3fb3-4a63-9ac6-11f92351f790 None admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:41.452297 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e075d7a8-3fb3-4a63-9ac6-11f92351f790 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:41.452628 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e075d7a8-3fb3-4a63-9ac6-11f92351f790 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:41.454036 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e075d7a8-3fb3-4a63-9ac6-11f92351f790 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:41.461186 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd47142-d830-4513-80ce-0dc588a5f3aa None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:41.462872 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 95/188] 10.222.0.102 () {56 vars in 1104 bytes} [Mon Aug 1 15:24:41 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:41.463995 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db54aa1-089c-4d40-9b6f-71d08ccd8410 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:41.464271 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db54aa1-089c-4d40-9b6f-71d08ccd8410 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:41.464568 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db54aa1-089c-4d40-9b6f-71d08ccd8410 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:41.482548 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-1db54aa1-089c-4d40-9b6f-71d08ccd8410 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:24:41.483871 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-1db54aa1-089c-4d40-9b6f-71d08ccd8410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:24:41.499170 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef193f3-aa54-43b1-b43f-f78105ec7a43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:41.499810 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef193f3-aa54-43b1-b43f-f78105ec7a43 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:41.500088 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef193f3-aa54-43b1-b43f-f78105ec7a43 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:41.500368 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef193f3-aa54-43b1-b43f-f78105ec7a43 None admin] PATH_INFO: `/v3/projects/dfcf3ac155ec4ab1b51e9b6849baec64` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:41.501533 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef193f3-aa54-43b1-b43f-f78105ec7a43 None admin] RBAC: Authorizing `identity:get_project(project_id=dfcf3ac155ec4ab1b51e9b6849baec64)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:41.502966 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef193f3-aa54-43b1-b43f-f78105ec7a43 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:41.509993 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 94/189] 10.222.0.102 () {56 vars in 1191 bytes} [Mon Aug 1 15:24:41 2022] GET /identity/v3/projects/dfcf3ac155ec4ab1b51e9b6849baec64 => generated 299 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:41.509993 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef193f3-aa54-43b1-b43f-f78105ec7a43 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:41.554576 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 96/190] 10.222.0.102 () {58 vars in 1028 bytes} [Mon Aug 1 15:24:41 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 15:24:41.555305 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db54aa1-089c-4d40-9b6f-71d08ccd8410 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:41.590095 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:41.615485 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef193f3-aa54-43b1-b43f-f78105ec7a43 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:41.642208 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:41.650949 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f6a270-b9ba-4be4-8b7b-5e1cbb98eb15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:41.654598 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f6a270-b9ba-4be4-8b7b-5e1cbb98eb15 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:41.654598 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f6a270-b9ba-4be4-8b7b-5e1cbb98eb15 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:41.654598 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f6a270-b9ba-4be4-8b7b-5e1cbb98eb15 None admin] PATH_INFO: `/v3/users/1529e1cc2932475a8f3b33c10ed2796a` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:41.654598 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f6a270-b9ba-4be4-8b7b-5e1cbb98eb15 None admin] RBAC: Authorizing `identity:get_user(user_id=1529e1cc2932475a8f3b33c10ed2796a)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:41.654947 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f6a270-b9ba-4be4-8b7b-5e1cbb98eb15 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:41.656583 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 95/191] 10.222.0.102 () {56 vars in 1182 bytes} [Mon Aug 1 15:24:41 2022] GET /identity/v3/users/1529e1cc2932475a8f3b33c10ed2796a => generated 290 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:41.657104 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db54aa1-089c-4d40-9b6f-71d08ccd8410 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:41.657532 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f6a270-b9ba-4be4-8b7b-5e1cbb98eb15 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:41.693986 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd792f1-26eb-4980-8379-59f92bf9350b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:41.694598 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd792f1-26eb-4980-8379-59f92bf9350b None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:41.694874 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd792f1-26eb-4980-8379-59f92bf9350b None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:41.695143 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd792f1-26eb-4980-8379-59f92bf9350b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:41.696521 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd792f1-26eb-4980-8379-59f92bf9350b None admin] RBAC: Adding query filter params (role.id=de1374f966c04c27b579515b54334fd2, scope.project.id=dfcf3ac155ec4ab1b51e9b6849baec64, user.id=b6b2cd3e98284877b95b595df909c37d) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:41.696829 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd792f1-26eb-4980-8379-59f92bf9350b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:41.698279 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd792f1-26eb-4980-8379-59f92bf9350b None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:41.704271 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 97/192] 10.222.0.102 () {56 vars in 1379 bytes} [Mon Aug 1 15:24:41 2022] GET /identity/v3/role_assignments?user.id=b6b2cd3e98284877b95b595df909c37d&scope.project.id=dfcf3ac155ec4ab1b51e9b6849baec64&role.id=de1374f966c04c27b579515b54334fd2 => generated 610 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:41.705080 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd792f1-26eb-4980-8379-59f92bf9350b None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:41.764218 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f6a270-b9ba-4be4-8b7b-5e1cbb98eb15 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:41.800655 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206181c7-785a-4af1-b20a-f2d17f49c98f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:41.801347 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206181c7-785a-4af1-b20a-f2d17f49c98f None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:41.801623 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206181c7-785a-4af1-b20a-f2d17f49c98f None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:41.801890 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206181c7-785a-4af1-b20a-f2d17f49c98f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:41.803148 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206181c7-785a-4af1-b20a-f2d17f49c98f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:41.804621 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206181c7-785a-4af1-b20a-f2d17f49c98f None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:41.806850 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 96/193] 10.222.0.102 () {56 vars in 1113 bytes} [Mon Aug 1 15:24:41 2022] GET /identity/v3/domains/default => generated 200 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:41.807642 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206181c7-785a-4af1-b20a-f2d17f49c98f None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:41.834297 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:41.838818 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd792f1-26eb-4980-8379-59f92bf9350b None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:41.883140 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce0afe0-c206-420c-8a39-903e077d6032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:41.884215 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce0afe0-c206-420c-8a39-903e077d6032 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:41.884488 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce0afe0-c206-420c-8a39-903e077d6032 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:41.884799 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce0afe0-c206-420c-8a39-903e077d6032 None admin] PATH_INFO: `/v3/users/d35aada0d6b54d4fba6bb5c14e95fa1a` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:41.889405 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:41.904834 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce0afe0-c206-420c-8a39-903e077d6032 None admin] RBAC: Authorizing `identity:get_user(user_id=d35aada0d6b54d4fba6bb5c14e95fa1a)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:41.906357 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce0afe0-c206-420c-8a39-903e077d6032 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:41.908137 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 98/194] 10.222.0.102 () {56 vars in 1182 bytes} [Mon Aug 1 15:24:41 2022] GET /identity/v3/users/d35aada0d6b54d4fba6bb5c14e95fa1a => generated 284 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:41.908989 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce0afe0-c206-420c-8a39-903e077d6032 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:41.937128 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206181c7-785a-4af1-b20a-f2d17f49c98f None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:41.971584 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecd83c8-9988-44a5-872d-1e0aff7f4ab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:41.972239 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecd83c8-9988-44a5-872d-1e0aff7f4ab7 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:41.972518 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecd83c8-9988-44a5-872d-1e0aff7f4ab7 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:41.972791 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecd83c8-9988-44a5-872d-1e0aff7f4ab7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:41.973591 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecd83c8-9988-44a5-872d-1e0aff7f4ab7 None admin] RBAC: Adding query filter params (role.id=5acf9fe30ec74532a49ebed755ea61e4, scope.project.id=dfcf3ac155ec4ab1b51e9b6849baec64, user.id=d63a704c427d4f18a40f7ba2bdc48254) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:41.973915 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecd83c8-9988-44a5-872d-1e0aff7f4ab7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:41.975350 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecd83c8-9988-44a5-872d-1e0aff7f4ab7 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:41.981787 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 97/195] 10.222.0.102 () {56 vars in 1379 bytes} [Mon Aug 1 15:24:41 2022] GET /identity/v3/role_assignments?user.id=d63a704c427d4f18a40f7ba2bdc48254&scope.project.id=dfcf3ac155ec4ab1b51e9b6849baec64&role.id=5acf9fe30ec74532a49ebed755ea61e4 => generated 610 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:41.982372 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecd83c8-9988-44a5-872d-1e0aff7f4ab7 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:42.025562 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce0afe0-c206-420c-8a39-903e077d6032 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:42.067571 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b6e51f-f9b4-462c-b16c-53d011e7ddfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:42.068561 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b6e51f-f9b4-462c-b16c-53d011e7ddfc None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:42.069066 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b6e51f-f9b4-462c-b16c-53d011e7ddfc None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:42.069484 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b6e51f-f9b4-462c-b16c-53d011e7ddfc None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:42.083962 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b6e51f-f9b4-462c-b16c-53d011e7ddfc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:24:42.089786 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-63b6e51f-f9b4-462c-b16c-53d011e7ddfc None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 01 15:24:42.089786 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:24:42.089786 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:24:42.089786 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:24:42.089786 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:24:42.089786 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:24:42.089786 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:24:42.089786 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:24:42.089786 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:24:42.089786 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:24:42.089786 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:24:42.089786 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:24:42.089786 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:24:42.089786 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:24:42.089786 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:24:42.089786 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:24:42.090927 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:24:42.090927 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:24:42.090927 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:24:42.090927 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:24:42.090927 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:24:42.090927 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:24:42.090927 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:24:42.090927 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:24:42.090927 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:24:42.090927 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:24:42.090927 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:24:42.090927 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 01 15:24:42.090927 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:24:42.090927 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:24:42.090927 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:24:42.090927 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:24:42.091902 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:24:42.091902 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:24:42.091902 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:24:42.091902 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:24:42.091902 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:24:42.091902 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:24:42.091902 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:24:42.091902 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:24:42.091902 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:24:42.091902 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:24:42.091902 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 01 15:24:42.091902 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 01 15:24:42.092667 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecd83c8-9988-44a5-872d-1e0aff7f4ab7 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:42.094281 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 99/196] 10.222.0.102 () {56 vars in 1119 bytes} [Mon Aug 1 15:24:41 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:24:42.095361 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b6e51f-f9b4-462c-b16c-53d011e7ddfc None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:42.119470 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:42.122215 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:42.130980 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e67a59-8aa4-4768-92dd-0d7e868489f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:42.131610 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e67a59-8aa4-4768-92dd-0d7e868489f1 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:42.131964 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e67a59-8aa4-4768-92dd-0d7e868489f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:42.132156 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e67a59-8aa4-4768-92dd-0d7e868489f1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:42.208425 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e67a59-8aa4-4768-92dd-0d7e868489f1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:42.210104 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e67a59-8aa4-4768-92dd-0d7e868489f1 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:42.217915 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b6e51f-f9b4-462c-b16c-53d011e7ddfc None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:42.253126 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b33dcfd-b226-44ff-9a45-7e8d33749d5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:42.253734 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b33dcfd-b226-44ff-9a45-7e8d33749d5c None admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:42.254005 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b33dcfd-b226-44ff-9a45-7e8d33749d5c None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:42.254269 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b33dcfd-b226-44ff-9a45-7e8d33749d5c None admin] PATH_INFO: `/v3/users` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:42.254971 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b33dcfd-b226-44ff-9a45-7e8d33749d5c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:42.256424 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b33dcfd-b226-44ff-9a45-7e8d33749d5c None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:42.309415 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 98/197] 10.222.0.102 () {58 vars in 1287 bytes} [Mon Aug 1 15:24:41 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 15:24:42.310261 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e67a59-8aa4-4768-92dd-0d7e868489f1 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:42.337283 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:42.371867 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 100/198] 10.222.0.102 () {60 vars in 1137 bytes} [Mon Aug 1 15:24:42 2022] POST /identity/v3/users => generated 298 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:24:42.372694 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b33dcfd-b226-44ff-9a45-7e8d33749d5c None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:42.416527 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e67a59-8aa4-4768-92dd-0d7e868489f1 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:42.451980 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:42.462464 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41124c1-564f-415d-8d78-121f358dc59b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:42.462464 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41124c1-564f-415d-8d78-121f358dc59b None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:42.462464 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41124c1-564f-415d-8d78-121f358dc59b None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:42.462464 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41124c1-564f-415d-8d78-121f358dc59b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:42.484654 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b33dcfd-b226-44ff-9a45-7e8d33749d5c None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:42.526274 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8409f024-e47f-4b87-a160-e019aec7f309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:42.527030 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8409f024-e47f-4b87-a160-e019aec7f309 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:42.527314 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8409f024-e47f-4b87-a160-e019aec7f309 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:42.527588 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8409f024-e47f-4b87-a160-e019aec7f309 None admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:42.528311 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8409f024-e47f-4b87-a160-e019aec7f309 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:42.528614 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8409f024-e47f-4b87-a160-e019aec7f309 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:42.530072 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8409f024-e47f-4b87-a160-e019aec7f309 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:42.538777 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 101/199] 10.222.0.102 () {56 vars in 1116 bytes} [Mon Aug 1 15:24:42 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:42.540274 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8409f024-e47f-4b87-a160-e019aec7f309 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:42.548339 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41124c1-564f-415d-8d78-121f358dc59b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:42.549876 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41124c1-564f-415d-8d78-121f358dc59b None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:42.580627 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:42.671619 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8409f024-e47f-4b87-a160-e019aec7f309 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:42.672124 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 99/200] 10.222.0.102 () {58 vars in 1287 bytes} [Mon Aug 1 15:24:42 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 15:24:42.672945 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41124c1-564f-415d-8d78-121f358dc59b None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:42.716924 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57be2dea-2224-451d-a4e2-696fc241cef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:42.717569 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57be2dea-2224-451d-a4e2-696fc241cef7 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:42.717809 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57be2dea-2224-451d-a4e2-696fc241cef7 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:42.718091 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57be2dea-2224-451d-a4e2-696fc241cef7 None admin] PATH_INFO: `/v3/projects/dfcf3ac155ec4ab1b51e9b6849baec64` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:42.719821 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57be2dea-2224-451d-a4e2-696fc241cef7 None admin] RBAC: Authorizing `identity:get_project(project_id=dfcf3ac155ec4ab1b51e9b6849baec64)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:42.721993 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57be2dea-2224-451d-a4e2-696fc241cef7 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:42.724162 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 102/201] 10.222.0.102 () {56 vars in 1191 bytes} [Mon Aug 1 15:24:42 2022] GET /identity/v3/projects/dfcf3ac155ec4ab1b51e9b6849baec64 => generated 299 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:42.725043 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57be2dea-2224-451d-a4e2-696fc241cef7 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:42.728779 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:42.785379 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41124c1-564f-415d-8d78-121f358dc59b None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:42.812993 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:42.822544 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3fe5f0-1425-4d14-9f20-711176423dba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:42.823258 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3fe5f0-1425-4d14-9f20-711176423dba None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:42.824674 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3fe5f0-1425-4d14-9f20-711176423dba None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:42.824674 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3fe5f0-1425-4d14-9f20-711176423dba None admin] PATH_INFO: `/v3/users/d35aada0d6b54d4fba6bb5c14e95fa1a` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:42.825055 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3fe5f0-1425-4d14-9f20-711176423dba None admin] RBAC: Authorizing `identity:get_user(user_id=d35aada0d6b54d4fba6bb5c14e95fa1a)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:42.826739 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3fe5f0-1425-4d14-9f20-711176423dba None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:42.828440 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 100/202] 10.222.0.102 () {56 vars in 1182 bytes} [Mon Aug 1 15:24:42 2022] GET /identity/v3/users/d35aada0d6b54d4fba6bb5c14e95fa1a => generated 284 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:42.829218 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3fe5f0-1425-4d14-9f20-711176423dba None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:42.868954 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57be2dea-2224-451d-a4e2-696fc241cef7 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:42.917311 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8123598a-1b3b-4b3e-9c62-e71a7dc28b98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:42.918499 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8123598a-1b3b-4b3e-9c62-e71a7dc28b98 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:42.918968 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8123598a-1b3b-4b3e-9c62-e71a7dc28b98 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:42.919448 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8123598a-1b3b-4b3e-9c62-e71a7dc28b98 None admin] PATH_INFO: `/v3/projects/5db9d563233a43d8b5d7983c087936d2` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:42.921150 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8123598a-1b3b-4b3e-9c62-e71a7dc28b98 None admin] RBAC: Authorizing `identity:get_project(project_id=5db9d563233a43d8b5d7983c087936d2)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:42.922809 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8123598a-1b3b-4b3e-9c62-e71a7dc28b98 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:42.925125 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 103/203] 10.222.0.102 () {56 vars in 1191 bytes} [Mon Aug 1 15:24:42 2022] GET /identity/v3/projects/5db9d563233a43d8b5d7983c087936d2 => generated 303 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:42.926086 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8123598a-1b3b-4b3e-9c62-e71a7dc28b98 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:42.957844 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3fe5f0-1425-4d14-9f20-711176423dba None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:42.995305 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a1ac4b-0ef8-4e5c-a584-2b712acc7cad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:42.995692 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a1ac4b-0ef8-4e5c-a584-2b712acc7cad None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:42.995978 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a1ac4b-0ef8-4e5c-a584-2b712acc7cad None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:42.996254 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a1ac4b-0ef8-4e5c-a584-2b712acc7cad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:42.997094 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a1ac4b-0ef8-4e5c-a584-2b712acc7cad None admin] RBAC: Adding query filter params (role.id=d517cfa9ee3e4f2b946b50d2236338f3, scope.project.id=dfcf3ac155ec4ab1b51e9b6849baec64, user.id=1529e1cc2932475a8f3b33c10ed2796a) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:42.997408 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a1ac4b-0ef8-4e5c-a584-2b712acc7cad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:42.998929 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a1ac4b-0ef8-4e5c-a584-2b712acc7cad None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:43.004436 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:43.012876 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 101/204] 10.222.0.102 () {56 vars in 1379 bytes} [Mon Aug 1 15:24:42 2022] GET /identity/v3/role_assignments?user.id=1529e1cc2932475a8f3b33c10ed2796a&scope.project.id=dfcf3ac155ec4ab1b51e9b6849baec64&role.id=d517cfa9ee3e4f2b946b50d2236338f3 => generated 610 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:43.012876 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a1ac4b-0ef8-4e5c-a584-2b712acc7cad None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:43.068299 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8123598a-1b3b-4b3e-9c62-e71a7dc28b98 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:43.140263 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:43.152961 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d502d542-ee76-4634-9946-8162b28d26f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:43.153596 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d502d542-ee76-4634-9946-8162b28d26f6 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:43.153879 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d502d542-ee76-4634-9946-8162b28d26f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:43.154152 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d502d542-ee76-4634-9946-8162b28d26f6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:43.216539 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a1ac4b-0ef8-4e5c-a584-2b712acc7cad None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:43.257875 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6791e4-a2d6-4c09-a862-30eeae04bcd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:43.258194 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6791e4-a2d6-4c09-a862-30eeae04bcd5 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:43.258962 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6791e4-a2d6-4c09-a862-30eeae04bcd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:43.259237 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6791e4-a2d6-4c09-a862-30eeae04bcd5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:43.260048 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6791e4-a2d6-4c09-a862-30eeae04bcd5 None admin] RBAC: Adding query filter params (role.id=de1374f966c04c27b579515b54334fd2, scope.project.id=5db9d563233a43d8b5d7983c087936d2, user.id=d35aada0d6b54d4fba6bb5c14e95fa1a) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:43.260366 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6791e4-a2d6-4c09-a862-30eeae04bcd5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:43.261849 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6791e4-a2d6-4c09-a862-30eeae04bcd5 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:43.262109 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d502d542-ee76-4634-9946-8162b28d26f6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:43.263843 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d502d542-ee76-4634-9946-8162b28d26f6 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:43.268806 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 102/205] 10.222.0.102 () {56 vars in 1379 bytes} [Mon Aug 1 15:24:43 2022] GET /identity/v3/role_assignments?user.id=d35aada0d6b54d4fba6bb5c14e95fa1a&scope.project.id=5db9d563233a43d8b5d7983c087936d2&role.id=de1374f966c04c27b579515b54334fd2 => generated 260 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:43.346448 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:43.384792 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 104/206] 10.222.0.102 () {58 vars in 1287 bytes} [Mon Aug 1 15:24:42 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 15:24:43.392048 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6791e4-a2d6-4c09-a862-30eeae04bcd5 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:43.508659 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6791e4-a2d6-4c09-a862-30eeae04bcd5 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:43.531114 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:43.543971 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94817410-8a74-4e1f-b304-a626b4d5520b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:43.544959 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94817410-8a74-4e1f-b304-a626b4d5520b None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:43.545408 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94817410-8a74-4e1f-b304-a626b4d5520b None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:43.554696 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94817410-8a74-4e1f-b304-a626b4d5520b None admin] PATH_INFO: `/v3/projects/5db9d563233a43d8b5d7983c087936d2` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:43.554696 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94817410-8a74-4e1f-b304-a626b4d5520b None admin] RBAC: Authorizing `identity:get_project(project_id=5db9d563233a43d8b5d7983c087936d2)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:43.554696 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94817410-8a74-4e1f-b304-a626b4d5520b None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:43.554696 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 103/207] 10.222.0.102 () {56 vars in 1191 bytes} [Mon Aug 1 15:24:43 2022] GET /identity/v3/projects/5db9d563233a43d8b5d7983c087936d2 => generated 303 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:43.557134 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d502d542-ee76-4634-9946-8162b28d26f6 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:43.660364 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d502d542-ee76-4634-9946-8162b28d26f6 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:43.697765 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40629374-96bd-47e3-b0bf-570af92addbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:43.699222 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40629374-96bd-47e3-b0bf-570af92addbe None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:43.699717 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40629374-96bd-47e3-b0bf-570af92addbe None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:43.700183 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40629374-96bd-47e3-b0bf-570af92addbe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:43.701499 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40629374-96bd-47e3-b0bf-570af92addbe None admin] RBAC: Adding query filter params (role.id=5acf9fe30ec74532a49ebed755ea61e4, scope.project.id=5db9d563233a43d8b5d7983c087936d2, user.id=d35aada0d6b54d4fba6bb5c14e95fa1a) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:43.702098 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40629374-96bd-47e3-b0bf-570af92addbe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:43.703819 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40629374-96bd-47e3-b0bf-570af92addbe None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:43.710484 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 105/208] 10.222.0.102 () {56 vars in 1379 bytes} [Mon Aug 1 15:24:43 2022] GET /identity/v3/role_assignments?user.id=d35aada0d6b54d4fba6bb5c14e95fa1a&scope.project.id=5db9d563233a43d8b5d7983c087936d2&role.id=5acf9fe30ec74532a49ebed755ea61e4 => generated 260 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:44.616586 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51f3e92-7273-41ca-b9ad-104ac46352c7 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:44.617161 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51f3e92-7273-41ca-b9ad-104ac46352c7 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:44.617238 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51f3e92-7273-41ca-b9ad-104ac46352c7 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:44.619216 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 104/209] 10.222.0.102 () {54 vars in 931 bytes} [Mon Aug 1 15:24:44 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 15:24:44.624281 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01644aa6-35df-4435-9e73-5bc61e52cc6b None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:44.624570 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01644aa6-35df-4435-9e73-5bc61e52cc6b None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:44.624895 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01644aa6-35df-4435-9e73-5bc61e52cc6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:44.647332 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-01644aa6-35df-4435-9e73-5bc61e52cc6b None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:24:44.648838 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-01644aa6-35df-4435-9e73-5bc61e52cc6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:24:44.676701 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:44.685996 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb61e47b-db49-45da-a029-cb640f42cad8 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:44.686334 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb61e47b-db49-45da-a029-cb640f42cad8 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:44.686697 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb61e47b-db49-45da-a029-cb640f42cad8 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:44.688136 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 105/210] 10.222.0.102 () {54 vars in 931 bytes} [Mon Aug 1 15:24:44 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 01 15:24:44.693374 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa43cd6-bcba-4b9b-8ca4-1860457c555d None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:44.693740 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa43cd6-bcba-4b9b-8ca4-1860457c555d None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:44.694093 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa43cd6-bcba-4b9b-8ca4-1860457c555d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:44.714864 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-5fa43cd6-bcba-4b9b-8ca4-1860457c555d None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:24:44.716058 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-5fa43cd6-bcba-4b9b-8ca4-1860457c555d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:24:44.723457 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 106/211] 10.222.0.102 () {58 vars in 1028 bytes} [Mon Aug 1 15:24:44 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 15:24:44.752698 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01644aa6-35df-4435-9e73-5bc61e52cc6b None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:44.799233 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 106/212] 10.222.0.102 () {58 vars in 1028 bytes} [Mon Aug 1 15:24:44 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 01 15:24:44.829780 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa43cd6-bcba-4b9b-8ca4-1860457c555d None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:44.895751 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01644aa6-35df-4435-9e73-5bc61e52cc6b None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:44.944200 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c6a769-8903-4791-95ad-15b03f77e73e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:44.946201 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c6a769-8903-4791-95ad-15b03f77e73e None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:44.946647 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c6a769-8903-4791-95ad-15b03f77e73e None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:44.947053 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c6a769-8903-4791-95ad-15b03f77e73e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:44.951189 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa43cd6-bcba-4b9b-8ca4-1860457c555d None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:44.961139 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c6a769-8903-4791-95ad-15b03f77e73e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:24:44.969101 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-a7c6a769-8903-4791-95ad-15b03f77e73e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 01 15:24:44.969101 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:24:44.969101 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:24:44.969101 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:24:44.969101 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:24:44.969101 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:24:44.969101 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:24:44.969101 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:24:44.969101 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:24:44.969101 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:24:44.969101 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:24:44.969101 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:24:44.969101 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:24:44.969101 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:24:44.969101 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:24:44.969101 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:24:44.970164 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:24:44.970164 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:24:44.970164 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:24:44.970164 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:24:44.970164 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:24:44.970164 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:24:44.970164 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:24:44.970164 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:24:44.970164 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:24:44.970164 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:24:44.970164 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:24:44.970164 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 01 15:24:44.970164 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:24:44.970164 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:24:44.970164 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:24:44.970164 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:24:44.971136 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:24:44.971136 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:24:44.971136 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:24:44.971136 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:24:44.971136 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:24:44.971136 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:24:44.971136 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:24:44.971136 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:24:44.971136 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:24:44.971136 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:24:44.971136 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 01 15:24:44.971136 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 01 15:24:44.974087 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 107/213] 10.222.0.102 () {56 vars in 1104 bytes} [Mon Aug 1 15:24:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 15:24:44.979768 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c6a769-8903-4791-95ad-15b03f77e73e None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:44.980699 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:45.000352 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8b3a22-7670-476b-bb74-e7056b9f3e12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:45.001181 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8b3a22-7670-476b-bb74-e7056b9f3e12 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:45.001459 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8b3a22-7670-476b-bb74-e7056b9f3e12 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:45.001726 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8b3a22-7670-476b-bb74-e7056b9f3e12 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:45.003146 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8b3a22-7670-476b-bb74-e7056b9f3e12 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:45.004783 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8b3a22-7670-476b-bb74-e7056b9f3e12 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:45.012146 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 107/214] 10.222.0.102 () {56 vars in 1113 bytes} [Mon Aug 1 15:24:44 2022] GET /identity/v3/domains/default => generated 200 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:45.012995 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8b3a22-7670-476b-bb74-e7056b9f3e12 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:45.015840 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:45.100746 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c6a769-8903-4791-95ad-15b03f77e73e None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:45.136632 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8b3a22-7670-476b-bb74-e7056b9f3e12 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:45.147014 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ab789c-d9cb-4ca6-adaa-a53c7c85a27d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:45.148403 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ab789c-d9cb-4ca6-adaa-a53c7c85a27d None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:45.149457 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ab789c-d9cb-4ca6-adaa-a53c7c85a27d None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:45.149949 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ab789c-d9cb-4ca6-adaa-a53c7c85a27d None admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:45.151491 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ab789c-d9cb-4ca6-adaa-a53c7c85a27d None admin] RBAC: Adding query filter params (name=member) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:45.152042 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ab789c-d9cb-4ca6-adaa-a53c7c85a27d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:45.154389 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ab789c-d9cb-4ca6-adaa-a53c7c85a27d None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:45.165759 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 108/215] 10.222.0.102 () {56 vars in 1106 bytes} [Mon Aug 1 15:24:44 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:45.171613 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ab789c-d9cb-4ca6-adaa-a53c7c85a27d None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:45.182063 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107a13e5-a389-4929-a201-5d137ac2f14b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:45.182810 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107a13e5-a389-4929-a201-5d137ac2f14b None admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:45.183195 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107a13e5-a389-4929-a201-5d137ac2f14b None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:45.183563 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107a13e5-a389-4929-a201-5d137ac2f14b None admin] PATH_INFO: `/v3/users` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:45.184512 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107a13e5-a389-4929-a201-5d137ac2f14b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:45.186066 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107a13e5-a389-4929-a201-5d137ac2f14b None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:45.276789 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:45.279439 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 108/216] 10.222.0.102 () {60 vars in 1137 bytes} [Mon Aug 1 15:24:45 2022] POST /identity/v3/users => generated 298 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:24:45.298730 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ab789c-d9cb-4ca6-adaa-a53c7c85a27d None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:45.340534 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58baa36d-90ad-4f5d-9331-42b04a0594d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:45.341249 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58baa36d-90ad-4f5d-9331-42b04a0594d0 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:45.341532 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58baa36d-90ad-4f5d-9331-42b04a0594d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:45.341808 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58baa36d-90ad-4f5d-9331-42b04a0594d0 None admin] PATH_INFO: `/v3/users/ebf3562f36284490ab836787837bd909` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:45.360018 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58baa36d-90ad-4f5d-9331-42b04a0594d0 None admin] RBAC: Authorizing `identity:get_user(user_id=ebf3562f36284490ab836787837bd909)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:45.361609 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58baa36d-90ad-4f5d-9331-42b04a0594d0 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:45.363881 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 109/217] 10.222.0.102 () {56 vars in 1182 bytes} [Mon Aug 1 15:24:45 2022] GET /identity/v3/users/ebf3562f36284490ab836787837bd909 => generated 298 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:45.373869 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107a13e5-a389-4929-a201-5d137ac2f14b None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:45.374472 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2473e379-4b10-4ed3-b9a1-027d34f8d636 None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:45.374763 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2473e379-4b10-4ed3-b9a1-027d34f8d636 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:45.375036 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2473e379-4b10-4ed3-b9a1-027d34f8d636 None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:45.376540 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 110/218] 10.222.0.102 () {54 vars in 931 bytes} [Mon Aug 1 15:24:45 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 15:24:45.381888 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e656bf-34e0-478f-b291-39c6be866985 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:45.382169 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e656bf-34e0-478f-b291-39c6be866985 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:45.382444 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e656bf-34e0-478f-b291-39c6be866985 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:45.409562 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-d0e656bf-34e0-478f-b291-39c6be866985 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:24:45.411561 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-d0e656bf-34e0-478f-b291-39c6be866985 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:24:45.432996 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:45.497861 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107a13e5-a389-4929-a201-5d137ac2f14b None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:45.502252 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 111/219] 10.222.0.102 () {58 vars in 1028 bytes} [Mon Aug 1 15:24:45 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 01 15:24:45.527661 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e656bf-34e0-478f-b291-39c6be866985 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:45.541286 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d59f8c0-47c9-4088-80e5-9ef80715127c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:45.541930 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d59f8c0-47c9-4088-80e5-9ef80715127c None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:45.542207 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d59f8c0-47c9-4088-80e5-9ef80715127c None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:45.542476 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d59f8c0-47c9-4088-80e5-9ef80715127c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:45.620937 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:45.631955 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d59f8c0-47c9-4088-80e5-9ef80715127c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:45.637572 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d59f8c0-47c9-4088-80e5-9ef80715127c None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:45.653497 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e656bf-34e0-478f-b291-39c6be866985 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:45.691610 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:45.700770 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f81807-f283-4b51-a101-17b6a87d48d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:45.702156 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f81807-f283-4b51-a101-17b6a87d48d1 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:45.702492 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f81807-f283-4b51-a101-17b6a87d48d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:45.702768 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f81807-f283-4b51-a101-17b6a87d48d1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:45.716526 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f81807-f283-4b51-a101-17b6a87d48d1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:24:45.723547 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-05f81807-f283-4b51-a101-17b6a87d48d1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 15:24:45.723547 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:24:45.723547 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:24:45.723547 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:24:45.723547 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:24:45.723547 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:24:45.723547 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:24:45.723547 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:24:45.723547 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:24:45.723547 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:24:45.723547 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:24:45.723547 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:24:45.723547 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:24:45.723547 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:24:45.723547 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:24:45.723547 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:24:45.725107 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:24:45.725107 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:24:45.725107 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:24:45.725107 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:24:45.725107 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:24:45.725107 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:24:45.725107 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:24:45.725107 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:24:45.725107 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:24:45.725107 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:24:45.725107 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:24:45.725107 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 01 15:24:45.725107 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:24:45.725107 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:24:45.725107 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:24:45.725107 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:24:45.726054 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:24:45.726054 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:24:45.726054 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:24:45.726054 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:24:45.726054 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:24:45.726054 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:24:45.726054 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:24:45.726054 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:24:45.726054 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:24:45.726054 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:24:45.726054 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 15:24:45.726054 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 01 15:24:45.726054 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 112/220] 10.222.0.102 () {56 vars in 1101 bytes} [Mon Aug 1 15:24:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 15:24:45.734276 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f81807-f283-4b51-a101-17b6a87d48d1 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:45.760948 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 109/221] 10.222.0.102 () {58 vars in 1287 bytes} [Mon Aug 1 15:24:45 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 15:24:45.773693 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d59f8c0-47c9-4088-80e5-9ef80715127c None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:45.866127 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f81807-f283-4b51-a101-17b6a87d48d1 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:45.900580 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d59f8c0-47c9-4088-80e5-9ef80715127c None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:45.913465 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8c5118-c0c3-4a95-ae4f-6c583d391efd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:45.914415 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8c5118-c0c3-4a95-ae4f-6c583d391efd None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:45.914876 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8c5118-c0c3-4a95-ae4f-6c583d391efd None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:45.915326 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8c5118-c0c3-4a95-ae4f-6c583d391efd None admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:45.916224 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8c5118-c0c3-4a95-ae4f-6c583d391efd None admin] RBAC: Adding query filter params (name=admin) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:45.916719 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8c5118-c0c3-4a95-ae4f-6c583d391efd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:45.918318 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8c5118-c0c3-4a95-ae4f-6c583d391efd None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:45.920103 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:45.927873 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 113/222] 10.222.0.102 () {56 vars in 1104 bytes} [Mon Aug 1 15:24:45 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:45.929385 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50059dc2-5c40-4c32-b5e2-3f0f6991314a None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:45.933345 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50059dc2-5c40-4c32-b5e2-3f0f6991314a None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:45.933345 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50059dc2-5c40-4c32-b5e2-3f0f6991314a None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:45.933345 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 114/223] 10.222.0.102 () {54 vars in 931 bytes} [Mon Aug 1 15:24:45 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 15:24:45.936160 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50059dc2-5c40-4c32-b5e2-3f0f6991314a None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:45.943628 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7861169-6f99-4941-b6b2-fa0d5b39a9f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:45.944214 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7861169-6f99-4941-b6b2-fa0d5b39a9f8 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:45.944491 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7861169-6f99-4941-b6b2-fa0d5b39a9f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:45.944765 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7861169-6f99-4941-b6b2-fa0d5b39a9f8 None admin] PATH_INFO: `/v3/projects/5db9d563233a43d8b5d7983c087936d2` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:45.947034 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7861169-6f99-4941-b6b2-fa0d5b39a9f8 None admin] RBAC: Authorizing `identity:get_project(project_id=5db9d563233a43d8b5d7983c087936d2)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:45.948902 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7861169-6f99-4941-b6b2-fa0d5b39a9f8 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:45.951773 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 110/224] 10.222.0.102 () {56 vars in 1191 bytes} [Mon Aug 1 15:24:45 2022] GET /identity/v3/projects/5db9d563233a43d8b5d7983c087936d2 => generated 303 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:45.953122 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfc6732-514b-412d-9d64-16f21642d4ba None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:45.953407 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfc6732-514b-412d-9d64-16f21642d4ba None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:45.953682 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfc6732-514b-412d-9d64-16f21642d4ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:45.977494 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-7bfc6732-514b-412d-9d64-16f21642d4ba None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:24:45.979454 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-7bfc6732-514b-412d-9d64-16f21642d4ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:24:45.988130 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:46.056644 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 111/225] 10.222.0.102 () {58 vars in 1028 bytes} [Mon Aug 1 15:24:45 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 15:24:46.057714 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfc6732-514b-412d-9d64-16f21642d4ba None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:46.065704 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50059dc2-5c40-4c32-b5e2-3f0f6991314a None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:46.121703 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9416404c-8e89-4882-9333-68a04c2f831e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:46.122351 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9416404c-8e89-4882-9333-68a04c2f831e None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:46.122632 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9416404c-8e89-4882-9333-68a04c2f831e None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:46.122908 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9416404c-8e89-4882-9333-68a04c2f831e None admin] PATH_INFO: `/v3/users/d35aada0d6b54d4fba6bb5c14e95fa1a` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:46.124097 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9416404c-8e89-4882-9333-68a04c2f831e None admin] RBAC: Authorizing `identity:get_user(user_id=d35aada0d6b54d4fba6bb5c14e95fa1a)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:46.125652 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9416404c-8e89-4882-9333-68a04c2f831e None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:46.132061 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 115/226] 10.222.0.102 () {56 vars in 1182 bytes} [Mon Aug 1 15:24:45 2022] GET /identity/v3/users/d35aada0d6b54d4fba6bb5c14e95fa1a => generated 284 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:46.132913 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9416404c-8e89-4882-9333-68a04c2f831e None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:46.173576 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfc6732-514b-412d-9d64-16f21642d4ba None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:46.210200 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:46.211266 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7e583d-37eb-4881-b817-bf765441f694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:46.211898 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7e583d-37eb-4881-b817-bf765441f694 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:46.212177 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7e583d-37eb-4881-b817-bf765441f694 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:46.212450 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7e583d-37eb-4881-b817-bf765441f694 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:46.213352 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7e583d-37eb-4881-b817-bf765441f694 None admin] RBAC: Adding query filter params (role.id=27f5093ac0674d799cdbd17c68482e32, scope.project.id=5db9d563233a43d8b5d7983c087936d2, user.id=ebf3562f36284490ab836787837bd909) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:46.213665 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7e583d-37eb-4881-b817-bf765441f694 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:46.215127 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7e583d-37eb-4881-b817-bf765441f694 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:46.221274 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 112/227] 10.222.0.102 () {56 vars in 1379 bytes} [Mon Aug 1 15:24:46 2022] GET /identity/v3/role_assignments?user.id=ebf3562f36284490ab836787837bd909&scope.project.id=5db9d563233a43d8b5d7983c087936d2&role.id=27f5093ac0674d799cdbd17c68482e32 => generated 260 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:46.227571 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7e583d-37eb-4881-b817-bf765441f694 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:46.243424 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:46.252153 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9416404c-8e89-4882-9333-68a04c2f831e None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:46.294714 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff066818-c10e-4168-a8d4-4136666505f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:46.295378 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff066818-c10e-4168-a8d4-4136666505f9 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:46.295659 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff066818-c10e-4168-a8d4-4136666505f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:46.295934 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff066818-c10e-4168-a8d4-4136666505f9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:46.308790 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff066818-c10e-4168-a8d4-4136666505f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:24:46.315331 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-ff066818-c10e-4168-a8d4-4136666505f9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 01 15:24:46.315331 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:24:46.315331 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:24:46.315331 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:24:46.315331 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:24:46.315331 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:24:46.315331 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:24:46.315331 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:24:46.315331 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:24:46.315331 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:24:46.315331 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:24:46.315331 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:24:46.315331 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:24:46.315331 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:24:46.315331 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:24:46.315331 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:24:46.316267 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:24:46.316267 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:24:46.316267 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:24:46.316267 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:24:46.316267 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:24:46.316267 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:24:46.316267 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:24:46.316267 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:24:46.316267 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:24:46.316267 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:24:46.316267 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:24:46.316267 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 01 15:24:46.316267 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:24:46.316267 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:24:46.316267 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:24:46.316267 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:24:46.317097 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:24:46.317097 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:24:46.317097 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:24:46.317097 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:24:46.317097 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:24:46.317097 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:24:46.317097 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:24:46.317097 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:24:46.317097 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:24:46.317097 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:24:46.317097 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 01 15:24:46.317097 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 01 15:24:46.317097 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 116/228] 10.222.0.102 () {56 vars in 1119 bytes} [Mon Aug 1 15:24:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:24:46.324285 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff066818-c10e-4168-a8d4-4136666505f9 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:46.442673 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff066818-c10e-4168-a8d4-4136666505f9 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:46.484284 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d314214-a783-47ed-954a-cbf98620336c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:46.484837 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d314214-a783-47ed-954a-cbf98620336c None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:46.485144 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d314214-a783-47ed-954a-cbf98620336c None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:46.485558 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d314214-a783-47ed-954a-cbf98620336c None admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:46.486339 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d314214-a783-47ed-954a-cbf98620336c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:46.486853 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d314214-a783-47ed-954a-cbf98620336c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:46.488952 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d314214-a783-47ed-954a-cbf98620336c None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:46.497032 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7e583d-37eb-4881-b817-bf765441f694 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:46.497179 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:46.504710 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 117/229] 10.222.0.102 () {56 vars in 1116 bytes} [Mon Aug 1 15:24:46 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:24:46.507088 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d314214-a783-47ed-954a-cbf98620336c None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:46.534805 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f19ad0d-5fda-4839-be87-efdd7513ac05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:46.535454 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f19ad0d-5fda-4839-be87-efdd7513ac05 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:46.535737 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f19ad0d-5fda-4839-be87-efdd7513ac05 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:46.536009 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f19ad0d-5fda-4839-be87-efdd7513ac05 None admin] PATH_INFO: `/v3/projects/5db9d563233a43d8b5d7983c087936d2` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:46.537492 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f19ad0d-5fda-4839-be87-efdd7513ac05 None admin] RBAC: Authorizing `identity:get_project(project_id=5db9d563233a43d8b5d7983c087936d2)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:46.538979 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f19ad0d-5fda-4839-be87-efdd7513ac05 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:46.541074 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 113/230] 10.222.0.102 () {56 vars in 1191 bytes} [Mon Aug 1 15:24:46 2022] GET /identity/v3/projects/5db9d563233a43d8b5d7983c087936d2 => generated 303 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:46.546828 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f19ad0d-5fda-4839-be87-efdd7513ac05 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:46.641672 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d314214-a783-47ed-954a-cbf98620336c None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:46.667765 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:46.696637 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08987312-e9cc-4b49-ad0e-99056eeb3c69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:46.697659 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08987312-e9cc-4b49-ad0e-99056eeb3c69 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:46.698571 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08987312-e9cc-4b49-ad0e-99056eeb3c69 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:46.699264 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08987312-e9cc-4b49-ad0e-99056eeb3c69 None admin] PATH_INFO: `/v3/users/d35aada0d6b54d4fba6bb5c14e95fa1a` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:46.702432 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08987312-e9cc-4b49-ad0e-99056eeb3c69 None admin] RBAC: Authorizing `identity:get_user(user_id=d35aada0d6b54d4fba6bb5c14e95fa1a)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:46.708505 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08987312-e9cc-4b49-ad0e-99056eeb3c69 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:46.712469 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 118/231] 10.222.0.102 () {56 vars in 1182 bytes} [Mon Aug 1 15:24:46 2022] GET /identity/v3/users/d35aada0d6b54d4fba6bb5c14e95fa1a => generated 284 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:46.716466 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08987312-e9cc-4b49-ad0e-99056eeb3c69 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:46.737409 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f19ad0d-5fda-4839-be87-efdd7513ac05 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:46.776679 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd24baf2-6a6a-4cb3-9a31-4fd7d8736ed2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:46.777852 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd24baf2-6a6a-4cb3-9a31-4fd7d8736ed2 None admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:46.778311 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd24baf2-6a6a-4cb3-9a31-4fd7d8736ed2 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:46.778905 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd24baf2-6a6a-4cb3-9a31-4fd7d8736ed2 None admin] PATH_INFO: `/v3/projects/5db9d563233a43d8b5d7983c087936d2/users/d35aada0d6b54d4fba6bb5c14e95fa1a/roles/de1374f966c04c27b579515b54334fd2` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:46.781327 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd24baf2-6a6a-4cb3-9a31-4fd7d8736ed2 None admin] RBAC: Authorizing `identity:create_grant(project_id=5db9d563233a43d8b5d7983c087936d2, user_id=d35aada0d6b54d4fba6bb5c14e95fa1a, role_id=de1374f966c04c27b579515b54334fd2)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:46.783733 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd24baf2-6a6a-4cb3-9a31-4fd7d8736ed2 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:46.823171 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:46.863273 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 114/232] 10.222.0.102 () {58 vars in 1444 bytes} [Mon Aug 1 15:24:46 2022] PUT /identity/v3/projects/5db9d563233a43d8b5d7983c087936d2/users/d35aada0d6b54d4fba6bb5c14e95fa1a/roles/de1374f966c04c27b579515b54334fd2 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 15:24:46.888953 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08987312-e9cc-4b49-ad0e-99056eeb3c69 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:46.927765 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea4fa33-d0a5-43c2-b0ee-c638650fe7de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:46.928650 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea4fa33-d0a5-43c2-b0ee-c638650fe7de None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:46.929120 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea4fa33-d0a5-43c2-b0ee-c638650fe7de None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:46.929528 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea4fa33-d0a5-43c2-b0ee-c638650fe7de None admin] PATH_INFO: `/v3/projects/5db9d563233a43d8b5d7983c087936d2` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:46.931435 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea4fa33-d0a5-43c2-b0ee-c638650fe7de None admin] RBAC: Authorizing `identity:get_project(project_id=5db9d563233a43d8b5d7983c087936d2)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:46.933063 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea4fa33-d0a5-43c2-b0ee-c638650fe7de None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:46.935274 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 119/233] 10.222.0.102 () {56 vars in 1191 bytes} [Mon Aug 1 15:24:46 2022] GET /identity/v3/projects/5db9d563233a43d8b5d7983c087936d2 => generated 303 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:24:46.940686 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd24baf2-6a6a-4cb3-9a31-4fd7d8736ed2 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:47.105015 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd24baf2-6a6a-4cb3-9a31-4fd7d8736ed2 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:47.141681 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5250740-8ac4-407e-9b67-d6348983940c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:47.142363 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5250740-8ac4-407e-9b67-d6348983940c None admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:47.142644 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5250740-8ac4-407e-9b67-d6348983940c None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:47.142919 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5250740-8ac4-407e-9b67-d6348983940c None admin] PATH_INFO: `/v3/projects/5db9d563233a43d8b5d7983c087936d2/users/d35aada0d6b54d4fba6bb5c14e95fa1a/roles/5acf9fe30ec74532a49ebed755ea61e4` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:47.145156 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5250740-8ac4-407e-9b67-d6348983940c None admin] RBAC: Authorizing `identity:create_grant(project_id=5db9d563233a43d8b5d7983c087936d2, user_id=d35aada0d6b54d4fba6bb5c14e95fa1a, role_id=5acf9fe30ec74532a49ebed755ea61e4)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:47.146625 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5250740-8ac4-407e-9b67-d6348983940c None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:47.149205 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:47.240607 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 115/234] 10.222.0.102 () {58 vars in 1444 bytes} [Mon Aug 1 15:24:46 2022] PUT /identity/v3/projects/5db9d563233a43d8b5d7983c087936d2/users/d35aada0d6b54d4fba6bb5c14e95fa1a/roles/5acf9fe30ec74532a49ebed755ea61e4 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:24:47.894364 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09de1005-ec5d-424f-970f-b247e184e105 None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:47.894364 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09de1005-ec5d-424f-970f-b247e184e105 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:47.894364 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09de1005-ec5d-424f-970f-b247e184e105 None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:47.894364 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 120/235] 10.222.0.102 () {54 vars in 931 bytes} [Mon Aug 1 15:24:47 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 15:24:47.900318 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec286e09-03cf-4d70-aa3c-ff31a8a9b945 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:47.900708 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec286e09-03cf-4d70-aa3c-ff31a8a9b945 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:47.900907 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec286e09-03cf-4d70-aa3c-ff31a8a9b945 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:47.930085 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-ec286e09-03cf-4d70-aa3c-ff31a8a9b945 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:24:47.931289 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-ec286e09-03cf-4d70-aa3c-ff31a8a9b945 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:24:48.015519 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 116/236] 10.222.0.102 () {58 vars in 1028 bytes} [Mon Aug 1 15:24:47 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 15:24:48.049911 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09de1005-ec5d-424f-970f-b247e184e105 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:48.143129 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253d90ed-01e2-444a-af08-224d66b1bb04 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:48.143740 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253d90ed-01e2-444a-af08-224d66b1bb04 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:48.144221 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253d90ed-01e2-444a-af08-224d66b1bb04 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:48.146043 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 117/237] 10.222.0.102 () {54 vars in 931 bytes} [Mon Aug 1 15:24:48 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 15:24:48.154455 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1545c298-d4ee-4dce-b931-399dff1c8a3b None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:48.155025 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1545c298-d4ee-4dce-b931-399dff1c8a3b None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:48.155482 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1545c298-d4ee-4dce-b931-399dff1c8a3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:48.191778 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-1545c298-d4ee-4dce-b931-399dff1c8a3b None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:24:48.193383 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-1545c298-d4ee-4dce-b931-399dff1c8a3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:24:48.200944 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09de1005-ec5d-424f-970f-b247e184e105 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:48.242776 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:48.267487 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4fea5a-314f-430f-acd5-17427021a431 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:48.268448 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4fea5a-314f-430f-acd5-17427021a431 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:48.268916 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4fea5a-314f-430f-acd5-17427021a431 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:48.269394 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4fea5a-314f-430f-acd5-17427021a431 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:48.288308 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4fea5a-314f-430f-acd5-17427021a431 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:24:48.294901 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-db4fea5a-314f-430f-acd5-17427021a431 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 01 15:24:48.294901 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:24:48.294901 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:24:48.294901 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:24:48.294901 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:24:48.294901 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:24:48.294901 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:24:48.294901 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:24:48.294901 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:24:48.294901 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:24:48.294901 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:24:48.294901 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:24:48.294901 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:24:48.294901 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:24:48.294901 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:24:48.294901 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:24:48.295975 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:24:48.295975 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:24:48.295975 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:24:48.295975 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:24:48.295975 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:24:48.295975 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:24:48.295975 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:24:48.295975 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:24:48.295975 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:24:48.295975 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:24:48.295975 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:24:48.295975 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 01 15:24:48.295975 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:24:48.295975 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:24:48.295975 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:24:48.295975 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:24:48.296980 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:24:48.296980 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:24:48.296980 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:24:48.296980 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:24:48.296980 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:24:48.296980 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:24:48.296980 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:24:48.296980 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:24:48.296980 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:24:48.296980 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:24:48.296980 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 01 15:24:48.296980 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 01 15:24:48.301757 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 121/238] 10.222.0.102 () {56 vars in 1104 bytes} [Mon Aug 1 15:24:48 2022] GET /identity/v3/roles/reader => generated 84 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:24:48.308910 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4fea5a-314f-430f-acd5-17427021a431 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:48.330922 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 118/239] 10.222.0.102 () {58 vars in 1028 bytes} [Mon Aug 1 15:24:48 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 01 15:24:48.355766 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1545c298-d4ee-4dce-b931-399dff1c8a3b None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:48.432476 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:48.500329 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4fea5a-314f-430f-acd5-17427021a431 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:48.518362 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1545c298-d4ee-4dce-b931-399dff1c8a3b None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:48.538979 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe50913-c1bf-4975-8aa0-9e889405613a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:48.539711 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe50913-c1bf-4975-8aa0-9e889405613a None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:48.540061 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe50913-c1bf-4975-8aa0-9e889405613a None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:48.540429 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe50913-c1bf-4975-8aa0-9e889405613a None admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:48.541284 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe50913-c1bf-4975-8aa0-9e889405613a None admin] RBAC: Adding query filter params (name=reader) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:48.541656 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe50913-c1bf-4975-8aa0-9e889405613a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:48.543348 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe50913-c1bf-4975-8aa0-9e889405613a None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:48.556931 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 122/240] 10.222.0.102 () {56 vars in 1106 bytes} [Mon Aug 1 15:24:48 2022] GET /identity/v3/roles?name=reader => generated 343 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:48.558778 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3d130e-b804-4455-aeda-35cf2db77738 None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:48.559064 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3d130e-b804-4455-aeda-35cf2db77738 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:48.559338 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3d130e-b804-4455-aeda-35cf2db77738 None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:48.560719 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 123/241] 10.222.0.102 () {54 vars in 931 bytes} [Mon Aug 1 15:24:48 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 15:24:48.561691 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3d130e-b804-4455-aeda-35cf2db77738 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:48.562326 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c075174-6d57-4125-8c44-bebc7635dd63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:48.562858 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c075174-6d57-4125-8c44-bebc7635dd63 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:48.562972 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c075174-6d57-4125-8c44-bebc7635dd63 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:48.563721 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c075174-6d57-4125-8c44-bebc7635dd63 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:48.564642 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c075174-6d57-4125-8c44-bebc7635dd63 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:48.566170 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c075174-6d57-4125-8c44-bebc7635dd63 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:48.569775 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 119/242] 10.222.0.102 () {56 vars in 1113 bytes} [Mon Aug 1 15:24:48 2022] GET /identity/v3/domains/default => generated 200 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:24:48.571847 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7678e25-a7c3-451a-8f96-9f4ac8f371d4 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:48.572185 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7678e25-a7c3-451a-8f96-9f4ac8f371d4 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:48.572464 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7678e25-a7c3-451a-8f96-9f4ac8f371d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:48.595126 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-c7678e25-a7c3-451a-8f96-9f4ac8f371d4 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:24:48.596369 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-c7678e25-a7c3-451a-8f96-9f4ac8f371d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:24:48.616658 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:48.681705 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 120/243] 10.222.0.102 () {58 vars in 1028 bytes} [Mon Aug 1 15:24:48 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 15:24:48.682352 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7678e25-a7c3-451a-8f96-9f4ac8f371d4 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:48.682460 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3d130e-b804-4455-aeda-35cf2db77738 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:48.720456 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b11bce-2a04-42d5-b1bb-4f3c5566e3ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:48.721308 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b11bce-2a04-42d5-b1bb-4f3c5566e3ef None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:48.721595 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b11bce-2a04-42d5-b1bb-4f3c5566e3ef None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:48.721871 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b11bce-2a04-42d5-b1bb-4f3c5566e3ef None admin] PATH_INFO: `/v3/users/0b62f2357a2c4ef3967ffebb01bc405d` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:48.738390 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b11bce-2a04-42d5-b1bb-4f3c5566e3ef None admin] RBAC: Authorizing `identity:get_user(user_id=0b62f2357a2c4ef3967ffebb01bc405d)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:48.740024 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b11bce-2a04-42d5-b1bb-4f3c5566e3ef None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:48.742262 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 124/244] 10.222.0.102 () {56 vars in 1182 bytes} [Mon Aug 1 15:24:48 2022] GET /identity/v3/users/0b62f2357a2c4ef3967ffebb01bc405d => generated 298 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:48.743148 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b11bce-2a04-42d5-b1bb-4f3c5566e3ef None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:48.745393 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:48.808481 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7678e25-a7c3-451a-8f96-9f4ac8f371d4 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:48.857296 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f744d32-878e-4207-afff-df55ccd60256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:48.858016 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f744d32-878e-4207-afff-df55ccd60256 None admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:48.858290 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f744d32-878e-4207-afff-df55ccd60256 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:48.858389 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b11bce-2a04-42d5-b1bb-4f3c5566e3ef None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:48.858558 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f744d32-878e-4207-afff-df55ccd60256 None admin] PATH_INFO: `/v3/users` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:48.859239 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f744d32-878e-4207-afff-df55ccd60256 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:48.859941 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:48.861448 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f744d32-878e-4207-afff-df55ccd60256 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:48.902993 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dd6822-c728-4cb7-84fc-e0310482d8b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:48.903736 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dd6822-c728-4cb7-84fc-e0310482d8b3 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:48.903916 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dd6822-c728-4cb7-84fc-e0310482d8b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:48.904182 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dd6822-c728-4cb7-84fc-e0310482d8b3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:48.919202 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7dd6822-c728-4cb7-84fc-e0310482d8b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:24:48.925043 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-c7dd6822-c728-4cb7-84fc-e0310482d8b3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 01 15:24:48.925043 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:24:48.925043 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:24:48.925043 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:24:48.925043 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:24:48.925043 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:24:48.925043 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:24:48.925043 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:24:48.925043 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:24:48.925043 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:24:48.925043 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:24:48.925043 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:24:48.925043 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:24:48.925043 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:24:48.925043 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:24:48.925043 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:24:48.928168 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:24:48.928168 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:24:48.928168 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:24:48.928168 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:24:48.928168 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:24:48.928168 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:24:48.928168 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:24:48.928168 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:24:48.928168 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:24:48.928168 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:24:48.928168 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:24:48.928168 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 01 15:24:48.928168 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:24:48.928168 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:24:48.928168 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:24:48.928168 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:24:48.928998 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:24:48.928998 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:24:48.928998 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:24:48.928998 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:24:48.928998 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:24:48.928998 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:24:48.928998 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:24:48.928998 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:24:48.928998 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:24:48.928998 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:24:48.928998 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 01 15:24:48.928998 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 01 15:24:48.928998 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 125/246] 10.222.0.102 () {56 vars in 1104 bytes} [Mon Aug 1 15:24:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:24:48.929660 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 121/246] 10.222.0.102 () {60 vars in 1137 bytes} [Mon Aug 1 15:24:48 2022] POST /identity/v3/users => generated 294 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:24:48.931089 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dd6822-c728-4cb7-84fc-e0310482d8b3 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:48.933056 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f744d32-878e-4207-afff-df55ccd60256 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:49.056691 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f744d32-878e-4207-afff-df55ccd60256 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:49.070071 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:49.098034 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420b78ca-6146-4c39-aa31-da5603056e7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:49.099254 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420b78ca-6146-4c39-aa31-da5603056e7f None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:49.099254 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420b78ca-6146-4c39-aa31-da5603056e7f None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:49.099612 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420b78ca-6146-4c39-aa31-da5603056e7f None admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:49.100967 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420b78ca-6146-4c39-aa31-da5603056e7f None admin] RBAC: Adding query filter params (name=member) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:49.101379 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420b78ca-6146-4c39-aa31-da5603056e7f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:49.103067 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420b78ca-6146-4c39-aa31-da5603056e7f None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:49.113513 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 122/247] 10.222.0.102 () {56 vars in 1106 bytes} [Mon Aug 1 15:24:48 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:49.122244 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420b78ca-6146-4c39-aa31-da5603056e7f None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:49.165487 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dd6822-c728-4cb7-84fc-e0310482d8b3 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:49.222683 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ed1782-9b93-4c87-a5aa-6ec5eee7a6d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:49.223318 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ed1782-9b93-4c87-a5aa-6ec5eee7a6d1 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:49.223620 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ed1782-9b93-4c87-a5aa-6ec5eee7a6d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:49.223895 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ed1782-9b93-4c87-a5aa-6ec5eee7a6d1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:49.259007 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:49.286104 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420b78ca-6146-4c39-aa31-da5603056e7f None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:49.312425 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ed1782-9b93-4c87-a5aa-6ec5eee7a6d1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:49.312932 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ed1782-9b93-4c87-a5aa-6ec5eee7a6d1 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:49.339831 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2640a7e5-aaa8-4f10-a2ac-2285e0da938f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:49.340837 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2640a7e5-aaa8-4f10-a2ac-2285e0da938f None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:49.341344 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2640a7e5-aaa8-4f10-a2ac-2285e0da938f None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:49.341943 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2640a7e5-aaa8-4f10-a2ac-2285e0da938f None admin] PATH_INFO: `/v3/users/ebf3562f36284490ab836787837bd909` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:49.343648 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2640a7e5-aaa8-4f10-a2ac-2285e0da938f None admin] RBAC: Authorizing `identity:get_user(user_id=ebf3562f36284490ab836787837bd909)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:49.346046 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2640a7e5-aaa8-4f10-a2ac-2285e0da938f None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:49.347867 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 123/248] 10.222.0.102 () {56 vars in 1182 bytes} [Mon Aug 1 15:24:49 2022] GET /identity/v3/users/ebf3562f36284490ab836787837bd909 => generated 298 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:49.349098 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c483de7-f17d-4060-8ec8-cec73927e8ad None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:49.349385 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c483de7-f17d-4060-8ec8-cec73927e8ad None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:49.349661 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c483de7-f17d-4060-8ec8-cec73927e8ad None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:49.350949 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 124/249] 10.222.0.102 () {54 vars in 931 bytes} [Mon Aug 1 15:24:49 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 15:24:49.354839 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c483de7-f17d-4060-8ec8-cec73927e8ad None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:49.414111 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:49.457593 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 126/250] 10.222.0.102 () {58 vars in 1287 bytes} [Mon Aug 1 15:24:48 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 530 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 15:24:49.462181 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6319e9cd-26c9-491f-9ee8-087d35852f54 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:49.465288 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6319e9cd-26c9-491f-9ee8-087d35852f54 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:49.465572 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6319e9cd-26c9-491f-9ee8-087d35852f54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:49.484228 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-6319e9cd-26c9-491f-9ee8-087d35852f54 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:24:49.485483 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-6319e9cd-26c9-491f-9ee8-087d35852f54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:24:49.497498 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c483de7-f17d-4060-8ec8-cec73927e8ad None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:49.540782 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1252779-7a5d-4d9e-a339-954e92248d93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:49.541459 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1252779-7a5d-4d9e-a339-954e92248d93 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:49.541745 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1252779-7a5d-4d9e-a339-954e92248d93 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:49.542019 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1252779-7a5d-4d9e-a339-954e92248d93 None admin] PATH_INFO: `/v3/projects/5db9d563233a43d8b5d7983c087936d2` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:49.543192 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1252779-7a5d-4d9e-a339-954e92248d93 None admin] RBAC: Authorizing `identity:get_project(project_id=5db9d563233a43d8b5d7983c087936d2)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:49.544645 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1252779-7a5d-4d9e-a339-954e92248d93 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:49.547462 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 125/251] 10.222.0.102 () {56 vars in 1191 bytes} [Mon Aug 1 15:24:49 2022] GET /identity/v3/projects/5db9d563233a43d8b5d7983c087936d2 => generated 303 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:24:49.547462 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1252779-7a5d-4d9e-a339-954e92248d93 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:49.560606 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:49.574193 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 127/252] 10.222.0.102 () {58 vars in 1028 bytes} [Mon Aug 1 15:24:49 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 15:24:49.574193 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6319e9cd-26c9-491f-9ee8-087d35852f54 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:49.675150 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1252779-7a5d-4d9e-a339-954e92248d93 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:49.684637 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:49.731154 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742121e7-5ef0-4d46-83c1-9b7427a37f62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:49.732688 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742121e7-5ef0-4d46-83c1-9b7427a37f62 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:49.733251 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742121e7-5ef0-4d46-83c1-9b7427a37f62 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:49.733748 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742121e7-5ef0-4d46-83c1-9b7427a37f62 None admin] PATH_INFO: `/v3/projects/5db9d563233a43d8b5d7983c087936d2` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:49.736037 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742121e7-5ef0-4d46-83c1-9b7427a37f62 None admin] RBAC: Authorizing `identity:get_project(project_id=5db9d563233a43d8b5d7983c087936d2)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:49.737762 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742121e7-5ef0-4d46-83c1-9b7427a37f62 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:49.739688 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 126/253] 10.222.0.102 () {56 vars in 1191 bytes} [Mon Aug 1 15:24:49 2022] GET /identity/v3/projects/5db9d563233a43d8b5d7983c087936d2 => generated 303 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:49.741421 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742121e7-5ef0-4d46-83c1-9b7427a37f62 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:49.752687 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6319e9cd-26c9-491f-9ee8-087d35852f54 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:49.830552 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0efec8-b9a2-40a3-b933-f3df0f929322 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:49.831156 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0efec8-b9a2-40a3-b933-f3df0f929322 None admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:49.831432 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0efec8-b9a2-40a3-b933-f3df0f929322 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:49.831703 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0efec8-b9a2-40a3-b933-f3df0f929322 None admin] PATH_INFO: `/v3/projects/5db9d563233a43d8b5d7983c087936d2/users/ebf3562f36284490ab836787837bd909/roles/27f5093ac0674d799cdbd17c68482e32` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:49.833699 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0efec8-b9a2-40a3-b933-f3df0f929322 None admin] RBAC: Authorizing `identity:create_grant(project_id=5db9d563233a43d8b5d7983c087936d2, user_id=ebf3562f36284490ab836787837bd909, role_id=27f5093ac0674d799cdbd17c68482e32)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:49.835157 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0efec8-b9a2-40a3-b933-f3df0f929322 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:49.895741 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742121e7-5ef0-4d46-83c1-9b7427a37f62 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:49.901511 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 128/254] 10.222.0.102 () {58 vars in 1444 bytes} [Mon Aug 1 15:24:49 2022] PUT /identity/v3/projects/5db9d563233a43d8b5d7983c087936d2/users/ebf3562f36284490ab836787837bd909/roles/27f5093ac0674d799cdbd17c68482e32 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:24:49.902819 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0efec8-b9a2-40a3-b933-f3df0f929322 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:49.953522 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238dd567-c467-4297-aae4-6f8e61ca9106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:49.954494 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238dd567-c467-4297-aae4-6f8e61ca9106 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:49.954885 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238dd567-c467-4297-aae4-6f8e61ca9106 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:49.955312 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238dd567-c467-4297-aae4-6f8e61ca9106 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:49.971985 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238dd567-c467-4297-aae4-6f8e61ca9106 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:24:49.979337 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-238dd567-c467-4297-aae4-6f8e61ca9106 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 15:24:49.979337 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:24:49.979337 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:24:49.979337 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:24:49.979337 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:24:49.979337 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:24:49.979337 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:24:49.979337 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:24:49.979337 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:24:49.979337 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:24:49.979337 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:24:49.979337 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:24:49.979337 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:24:49.979337 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:24:49.979337 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:24:49.979337 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:24:49.980325 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:24:49.980325 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:24:49.980325 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:24:49.980325 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:24:49.980325 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:24:49.980325 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:24:49.980325 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:24:49.980325 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:24:49.980325 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:24:49.980325 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:24:49.980325 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:24:49.980325 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 01 15:24:49.980325 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:24:49.980325 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:24:49.980325 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:24:49.980325 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:24:49.981155 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:24:49.981155 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:24:49.981155 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:24:49.981155 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:24:49.981155 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:24:49.981155 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:24:49.981155 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:24:49.981155 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:24:49.981155 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:24:49.981155 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:24:49.981155 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 15:24:49.981155 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 01 15:24:49.981768 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 127/255] 10.222.0.102 () {56 vars in 1101 bytes} [Mon Aug 1 15:24:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:24:49.983853 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55126877-d78c-4d5a-8e10-17b7ddc3edba None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:49.984301 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55126877-d78c-4d5a-8e10-17b7ddc3edba None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:49.984458 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:49.984907 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55126877-d78c-4d5a-8e10-17b7ddc3edba None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:49.987258 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 128/256] 10.222.0.102 () {54 vars in 931 bytes} [Mon Aug 1 15:24:49 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 15:24:49.988118 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55126877-d78c-4d5a-8e10-17b7ddc3edba None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:50.037981 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0efec8-b9a2-40a3-b933-f3df0f929322 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:50.052739 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:50.096061 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653c2949-4ff5-42c7-8a69-8a3117882b9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:50.096814 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653c2949-4ff5-42c7-8a69-8a3117882b9d None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:50.097328 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653c2949-4ff5-42c7-8a69-8a3117882b9d None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:50.097620 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653c2949-4ff5-42c7-8a69-8a3117882b9d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:50.098684 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653c2949-4ff5-42c7-8a69-8a3117882b9d None admin] RBAC: Adding query filter params (role.id=d517cfa9ee3e4f2b946b50d2236338f3, scope.project.id=5db9d563233a43d8b5d7983c087936d2, user.id=0b62f2357a2c4ef3967ffebb01bc405d) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:50.099412 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653c2949-4ff5-42c7-8a69-8a3117882b9d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:50.101473 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653c2949-4ff5-42c7-8a69-8a3117882b9d None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:50.110385 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 129/257] 10.222.0.102 () {56 vars in 1379 bytes} [Mon Aug 1 15:24:49 2022] GET /identity/v3/role_assignments?user.id=0b62f2357a2c4ef3967ffebb01bc405d&scope.project.id=5db9d563233a43d8b5d7983c087936d2&role.id=d517cfa9ee3e4f2b946b50d2236338f3 => generated 260 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:50.111982 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba5a5fe-08af-488f-872b-3dc1ce817288 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:50.113193 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba5a5fe-08af-488f-872b-3dc1ce817288 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:50.113486 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba5a5fe-08af-488f-872b-3dc1ce817288 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:50.155356 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-8ba5a5fe-08af-488f-872b-3dc1ce817288 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:24:50.156589 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-8ba5a5fe-08af-488f-872b-3dc1ce817288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:24:50.186719 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55126877-d78c-4d5a-8e10-17b7ddc3edba None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:50.241410 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be99a808-ac2f-4370-93c9-8c49963213bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:50.242588 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be99a808-ac2f-4370-93c9-8c49963213bd None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:50.243084 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be99a808-ac2f-4370-93c9-8c49963213bd None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:50.243548 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be99a808-ac2f-4370-93c9-8c49963213bd None admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:50.244556 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be99a808-ac2f-4370-93c9-8c49963213bd None admin] RBAC: Adding query filter params (name=admin) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:50.245055 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be99a808-ac2f-4370-93c9-8c49963213bd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:50.246739 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be99a808-ac2f-4370-93c9-8c49963213bd None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:50.252871 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 130/258] 10.222.0.102 () {58 vars in 1028 bytes} [Mon Aug 1 15:24:50 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 15:24:50.268706 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 129/259] 10.222.0.102 () {56 vars in 1104 bytes} [Mon Aug 1 15:24:49 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:50.274384 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba5a5fe-08af-488f-872b-3dc1ce817288 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:50.282405 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be99a808-ac2f-4370-93c9-8c49963213bd None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:50.357597 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:50.405269 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:50.409208 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be99a808-ac2f-4370-93c9-8c49963213bd None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:50.449686 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba5a5fe-08af-488f-872b-3dc1ce817288 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:50.450473 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65328334-8f91-4d7d-bc07-f856e08ca7cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:50.451136 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65328334-8f91-4d7d-bc07-f856e08ca7cd None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:50.451671 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65328334-8f91-4d7d-bc07-f856e08ca7cd None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:50.451946 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65328334-8f91-4d7d-bc07-f856e08ca7cd None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:50.469842 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65328334-8f91-4d7d-bc07-f856e08ca7cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:24:50.475968 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-65328334-8f91-4d7d-bc07-f856e08ca7cd None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 01 15:24:50.475968 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:24:50.475968 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:24:50.475968 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:24:50.475968 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:24:50.475968 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:24:50.475968 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:24:50.475968 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:24:50.475968 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:24:50.475968 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:24:50.475968 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:24:50.475968 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:24:50.475968 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:24:50.475968 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:24:50.475968 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:24:50.475968 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:24:50.477426 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:24:50.477426 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:24:50.477426 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:24:50.477426 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:24:50.477426 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:24:50.477426 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:24:50.477426 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:24:50.477426 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:24:50.477426 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:24:50.477426 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:24:50.477426 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:24:50.477426 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 01 15:24:50.477426 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:24:50.477426 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:24:50.477426 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:24:50.477426 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:24:50.478243 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:24:50.478243 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:24:50.478243 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:24:50.478243 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:24:50.478243 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:24:50.478243 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:24:50.478243 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:24:50.478243 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:24:50.478243 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:24:50.478243 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:24:50.478243 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 01 15:24:50.478243 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 01 15:24:50.481638 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 130/260] 10.222.0.102 () {56 vars in 1119 bytes} [Mon Aug 1 15:24:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 15:24:50.488542 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65328334-8f91-4d7d-bc07-f856e08ca7cd None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:50.500890 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e965db9-de40-45a6-99c7-be30e2423f62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:50.502498 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e965db9-de40-45a6-99c7-be30e2423f62 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:50.502981 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e965db9-de40-45a6-99c7-be30e2423f62 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:50.503449 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e965db9-de40-45a6-99c7-be30e2423f62 None admin] PATH_INFO: `/v3/users/d35aada0d6b54d4fba6bb5c14e95fa1a` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:50.504985 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e965db9-de40-45a6-99c7-be30e2423f62 None admin] RBAC: Authorizing `identity:get_user(user_id=d35aada0d6b54d4fba6bb5c14e95fa1a)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:50.506747 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e965db9-de40-45a6-99c7-be30e2423f62 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:50.510858 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 131/261] 10.222.0.102 () {56 vars in 1182 bytes} [Mon Aug 1 15:24:50 2022] GET /identity/v3/users/d35aada0d6b54d4fba6bb5c14e95fa1a => generated 284 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:50.517105 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e965db9-de40-45a6-99c7-be30e2423f62 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:50.690218 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e965db9-de40-45a6-99c7-be30e2423f62 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:50.706213 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:50.724767 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65328334-8f91-4d7d-bc07-f856e08ca7cd None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:50.738987 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e06f94-8ee6-4724-9125-f332c4378619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:50.739619 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e06f94-8ee6-4724-9125-f332c4378619 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:50.739892 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e06f94-8ee6-4724-9125-f332c4378619 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:50.740153 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e06f94-8ee6-4724-9125-f332c4378619 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:50.820812 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5cc67d-235d-407b-8fdc-c981bf6d0e9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:50.821474 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5cc67d-235d-407b-8fdc-c981bf6d0e9c None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:50.821757 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5cc67d-235d-407b-8fdc-c981bf6d0e9c None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:50.822031 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5cc67d-235d-407b-8fdc-c981bf6d0e9c None admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:50.822792 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5cc67d-235d-407b-8fdc-c981bf6d0e9c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:50.823099 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5cc67d-235d-407b-8fdc-c981bf6d0e9c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:50.824500 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5cc67d-235d-407b-8fdc-c981bf6d0e9c None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:50.839984 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 131/262] 10.222.0.102 () {56 vars in 1116 bytes} [Mon Aug 1 15:24:50 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 352 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:24:50.849981 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5cc67d-235d-407b-8fdc-c981bf6d0e9c None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:50.866614 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e06f94-8ee6-4724-9125-f332c4378619 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:50.868195 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e06f94-8ee6-4724-9125-f332c4378619 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:50.914799 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:51.012384 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 132/263] 10.222.0.102 () {58 vars in 1287 bytes} [Mon Aug 1 15:24:50 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 496 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 15:24:51.017856 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e06f94-8ee6-4724-9125-f332c4378619 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:51.058064 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:51.114118 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5cc67d-235d-407b-8fdc-c981bf6d0e9c None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:51.175002 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a98c92-572a-4903-81b8-f5ed0a4c9d37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:51.175659 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a98c92-572a-4903-81b8-f5ed0a4c9d37 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:51.175939 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a98c92-572a-4903-81b8-f5ed0a4c9d37 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:51.176210 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a98c92-572a-4903-81b8-f5ed0a4c9d37 None admin] PATH_INFO: `/v3/users/d35aada0d6b54d4fba6bb5c14e95fa1a` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:51.181516 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a98c92-572a-4903-81b8-f5ed0a4c9d37 None admin] RBAC: Authorizing `identity:get_user(user_id=d35aada0d6b54d4fba6bb5c14e95fa1a)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:51.183229 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a98c92-572a-4903-81b8-f5ed0a4c9d37 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:51.185029 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 132/264] 10.222.0.102 () {56 vars in 1182 bytes} [Mon Aug 1 15:24:50 2022] GET /identity/v3/users/d35aada0d6b54d4fba6bb5c14e95fa1a => generated 284 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:24:51.190596 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a98c92-572a-4903-81b8-f5ed0a4c9d37 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:51.267114 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e06f94-8ee6-4724-9125-f332c4378619 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:51.348214 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:51.361839 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c4052d-86d9-47eb-a6a5-b486c602e976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:51.362497 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c4052d-86d9-47eb-a6a5-b486c602e976 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:51.362776 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c4052d-86d9-47eb-a6a5-b486c602e976 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:51.363049 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c4052d-86d9-47eb-a6a5-b486c602e976 None admin] PATH_INFO: `/v3/projects/5db9d563233a43d8b5d7983c087936d2` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:51.364235 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c4052d-86d9-47eb-a6a5-b486c602e976 None admin] RBAC: Authorizing `identity:get_project(project_id=5db9d563233a43d8b5d7983c087936d2)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:51.365752 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c4052d-86d9-47eb-a6a5-b486c602e976 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:51.368135 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 133/265] 10.222.0.102 () {56 vars in 1191 bytes} [Mon Aug 1 15:24:51 2022] GET /identity/v3/projects/5db9d563233a43d8b5d7983c087936d2 => generated 303 bytes in 350 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:51.371821 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a98c92-572a-4903-81b8-f5ed0a4c9d37 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:51.378046 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c4052d-86d9-47eb-a6a5-b486c602e976 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:51.428654 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d620a5-afef-47a8-883f-c00d081cddaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:51.429368 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d620a5-afef-47a8-883f-c00d081cddaf None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:51.429647 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d620a5-afef-47a8-883f-c00d081cddaf None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:51.430105 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d620a5-afef-47a8-883f-c00d081cddaf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:51.573512 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d620a5-afef-47a8-883f-c00d081cddaf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:51.574919 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d620a5-afef-47a8-883f-c00d081cddaf None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:51.612663 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:51.659054 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c4052d-86d9-47eb-a6a5-b486c602e976 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:51.681354 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:51.698862 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 133/266] 10.222.0.102 () {58 vars in 1287 bytes} [Mon Aug 1 15:24:51 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 508 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 01 15:24:51.704927 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d620a5-afef-47a8-883f-c00d081cddaf None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:51.734687 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e54201f-ebfb-41c8-b054-c1a952b60ef8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:51.735496 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e54201f-ebfb-41c8-b054-c1a952b60ef8 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:51.735659 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e54201f-ebfb-41c8-b054-c1a952b60ef8 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:51.735940 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e54201f-ebfb-41c8-b054-c1a952b60ef8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:51.736741 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e54201f-ebfb-41c8-b054-c1a952b60ef8 None admin] RBAC: Adding query filter params (role.id=de1374f966c04c27b579515b54334fd2, scope.project.id=5db9d563233a43d8b5d7983c087936d2, user.id=d35aada0d6b54d4fba6bb5c14e95fa1a) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:51.737078 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e54201f-ebfb-41c8-b054-c1a952b60ef8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:51.738537 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e54201f-ebfb-41c8-b054-c1a952b60ef8 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:51.759424 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 134/267] 10.222.0.102 () {56 vars in 1379 bytes} [Mon Aug 1 15:24:51 2022] GET /identity/v3/role_assignments?user.id=d35aada0d6b54d4fba6bb5c14e95fa1a&scope.project.id=5db9d563233a43d8b5d7983c087936d2&role.id=de1374f966c04c27b579515b54334fd2 => generated 610 bytes in 382 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:51.817634 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d620a5-afef-47a8-883f-c00d081cddaf None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:51.855762 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91aec3c1-5510-438e-a745-0274b994b626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:51.856709 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aec3c1-5510-438e-a745-0274b994b626 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:51.857276 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aec3c1-5510-438e-a745-0274b994b626 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:51.857696 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aec3c1-5510-438e-a745-0274b994b626 None admin] PATH_INFO: `/v3/projects/5db9d563233a43d8b5d7983c087936d2` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:51.859201 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91aec3c1-5510-438e-a745-0274b994b626 None admin] RBAC: Authorizing `identity:get_project(project_id=5db9d563233a43d8b5d7983c087936d2)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:51.860880 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91aec3c1-5510-438e-a745-0274b994b626 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:51.862779 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 134/268] 10.222.0.102 () {56 vars in 1191 bytes} [Mon Aug 1 15:24:51 2022] GET /identity/v3/projects/5db9d563233a43d8b5d7983c087936d2 => generated 303 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:24:51.878962 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e54201f-ebfb-41c8-b054-c1a952b60ef8 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:52.049516 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e54201f-ebfb-41c8-b054-c1a952b60ef8 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:52.071990 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051897fe-71ae-4e07-9420-35f5e519610a None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:52.072645 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051897fe-71ae-4e07-9420-35f5e519610a None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:52.073221 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051897fe-71ae-4e07-9420-35f5e519610a None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:52.075357 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 135/269] 10.222.0.102 () {54 vars in 931 bytes} [Mon Aug 1 15:24:52 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 15:24:52.083208 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6773d1b9-8df3-4cd0-89b6-4ae163e6e778 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:52.083804 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6773d1b9-8df3-4cd0-89b6-4ae163e6e778 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:52.084379 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6773d1b9-8df3-4cd0-89b6-4ae163e6e778 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:52.111518 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6e0cff-ecfc-4642-a060-9c05d832de8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:52.112044 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6e0cff-ecfc-4642-a060-9c05d832de8e None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:52.112338 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6e0cff-ecfc-4642-a060-9c05d832de8e None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:52.112588 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6e0cff-ecfc-4642-a060-9c05d832de8e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:52.113399 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6e0cff-ecfc-4642-a060-9c05d832de8e None admin] RBAC: Adding query filter params (role.id=5acf9fe30ec74532a49ebed755ea61e4, scope.project.id=5db9d563233a43d8b5d7983c087936d2, user.id=d35aada0d6b54d4fba6bb5c14e95fa1a) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:52.113700 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6e0cff-ecfc-4642-a060-9c05d832de8e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:52.115156 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6e0cff-ecfc-4642-a060-9c05d832de8e None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:52.121850 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 135/270] 10.222.0.102 () {56 vars in 1379 bytes} [Mon Aug 1 15:24:51 2022] GET /identity/v3/role_assignments?user.id=d35aada0d6b54d4fba6bb5c14e95fa1a&scope.project.id=5db9d563233a43d8b5d7983c087936d2&role.id=5acf9fe30ec74532a49ebed755ea61e4 => generated 610 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:52.128435 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-6773d1b9-8df3-4cd0-89b6-4ae163e6e778 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:24:52.130444 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-6773d1b9-8df3-4cd0-89b6-4ae163e6e778 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:24:52.206863 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:52.227381 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 136/271] 10.222.0.102 () {58 vars in 1028 bytes} [Mon Aug 1 15:24:52 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 01 15:24:52.250989 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6e0cff-ecfc-4642-a060-9c05d832de8e None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:52.265763 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:52.388452 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6e0cff-ecfc-4642-a060-9c05d832de8e None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:52.393434 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d192a7-ce9a-4431-ab81-a9b3a253c624 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:52.393723 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d192a7-ce9a-4431-ab81-a9b3a253c624 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:52.393994 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d192a7-ce9a-4431-ab81-a9b3a253c624 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:52.395619 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 137/272] 10.222.0.102 () {54 vars in 931 bytes} [Mon Aug 1 15:24:52 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 01 15:24:52.402870 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c420b4e7-01e5-4f48-8724-f9a5bb6fcf44 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:52.403157 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c420b4e7-01e5-4f48-8724-f9a5bb6fcf44 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:52.403427 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c420b4e7-01e5-4f48-8724-f9a5bb6fcf44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:52.439216 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-c420b4e7-01e5-4f48-8724-f9a5bb6fcf44 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:24:52.440526 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-c420b4e7-01e5-4f48-8724-f9a5bb6fcf44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:24:52.449688 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e0b37a-2895-4139-94a3-5cb0fa42bfad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:52.450397 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e0b37a-2895-4139-94a3-5cb0fa42bfad None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:52.450713 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e0b37a-2895-4139-94a3-5cb0fa42bfad None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:52.451046 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e0b37a-2895-4139-94a3-5cb0fa42bfad None admin] PATH_INFO: `/v3/roles/member` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:52.466524 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e0b37a-2895-4139-94a3-5cb0fa42bfad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:24:52.473245 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-98e0b37a-2895-4139-94a3-5cb0fa42bfad None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 01 15:24:52.473245 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:24:52.473245 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:24:52.473245 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:24:52.473245 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:24:52.473245 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:24:52.473245 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:24:52.473245 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:24:52.473245 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:24:52.473245 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:24:52.473245 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:24:52.473245 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:24:52.473245 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:24:52.473245 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:24:52.473245 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:24:52.473245 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:24:52.474181 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:24:52.474181 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:24:52.474181 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:24:52.474181 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:24:52.474181 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:24:52.474181 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:24:52.474181 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:24:52.474181 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:24:52.474181 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:24:52.474181 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:24:52.474181 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:24:52.474181 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 01 15:24:52.474181 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:24:52.474181 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:24:52.474181 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:24:52.474181 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:24:52.474968 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:24:52.474968 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:24:52.474968 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:24:52.474968 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:24:52.474968 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:24:52.474968 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:24:52.474968 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:24:52.474968 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:24:52.474968 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:24:52.474968 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:24:52.474968 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 01 15:24:52.474968 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 01 15:24:52.475571 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 136/273] 10.222.0.102 () {56 vars in 1104 bytes} [Mon Aug 1 15:24:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:24:52.481222 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e0b37a-2895-4139-94a3-5cb0fa42bfad None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:52.549113 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 138/274] 10.222.0.102 () {58 vars in 1028 bytes} [Mon Aug 1 15:24:52 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 01 15:24:52.574896 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c420b4e7-01e5-4f48-8724-f9a5bb6fcf44 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:52.592066 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:52.641315 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e0b37a-2895-4139-94a3-5cb0fa42bfad None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:52.689371 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a14092d-24da-41e5-a755-5089db5efbb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:52.690268 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a14092d-24da-41e5-a755-5089db5efbb9 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:52.691039 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a14092d-24da-41e5-a755-5089db5efbb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:52.691325 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a14092d-24da-41e5-a755-5089db5efbb9 None admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:52.692335 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a14092d-24da-41e5-a755-5089db5efbb9 None admin] RBAC: Adding query filter params (name=member) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:52.692644 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a14092d-24da-41e5-a755-5089db5efbb9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:52.694323 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a14092d-24da-41e5-a755-5089db5efbb9 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:52.702902 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c420b4e7-01e5-4f48-8724-f9a5bb6fcf44 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:52.707835 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 137/275] 10.222.0.102 () {56 vars in 1106 bytes} [Mon Aug 1 15:24:52 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:52.714369 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a14092d-24da-41e5-a755-5089db5efbb9 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:52.720956 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:52.744023 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f57b676-3c56-44cb-857d-22496d8a61bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:52.744692 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f57b676-3c56-44cb-857d-22496d8a61bf None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:52.744968 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f57b676-3c56-44cb-857d-22496d8a61bf None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:52.745303 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f57b676-3c56-44cb-857d-22496d8a61bf None admin] PATH_INFO: `/v3/domains/default` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:52.746525 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f57b676-3c56-44cb-857d-22496d8a61bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:52.748051 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f57b676-3c56-44cb-857d-22496d8a61bf None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:52.750109 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 139/276] 10.222.0.102 () {56 vars in 1113 bytes} [Mon Aug 1 15:24:52 2022] GET /identity/v3/domains/default => generated 200 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:24:52.756086 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f57b676-3c56-44cb-857d-22496d8a61bf None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:52.843093 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a14092d-24da-41e5-a755-5089db5efbb9 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:52.883778 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:52.890999 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d360ad5e-01a2-4b11-8f00-3ec794890639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:52.891713 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d360ad5e-01a2-4b11-8f00-3ec794890639 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:52.891943 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d360ad5e-01a2-4b11-8f00-3ec794890639 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:52.892216 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d360ad5e-01a2-4b11-8f00-3ec794890639 None admin] PATH_INFO: `/v3/users/ee80663e06104a5aa82e9772fdd0efa4` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:52.903380 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f57b676-3c56-44cb-857d-22496d8a61bf None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:52.909143 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d360ad5e-01a2-4b11-8f00-3ec794890639 None admin] RBAC: Authorizing `identity:get_user(user_id=ee80663e06104a5aa82e9772fdd0efa4)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:52.910620 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d360ad5e-01a2-4b11-8f00-3ec794890639 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:52.912429 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 138/277] 10.222.0.102 () {56 vars in 1182 bytes} [Mon Aug 1 15:24:52 2022] GET /identity/v3/users/ee80663e06104a5aa82e9772fdd0efa4 => generated 294 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:52.918172 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d360ad5e-01a2-4b11-8f00-3ec794890639 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:52.963831 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d1cc94-1c69-471b-b979-b2a4a086a799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:52.964907 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d1cc94-1c69-471b-b979-b2a4a086a799 None admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:52.965432 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d1cc94-1c69-471b-b979-b2a4a086a799 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:52.965799 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d1cc94-1c69-471b-b979-b2a4a086a799 None admin] PATH_INFO: `/v3/users` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:52.966594 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d1cc94-1c69-471b-b979-b2a4a086a799 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:52.968165 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d1cc94-1c69-471b-b979-b2a4a086a799 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:53.030497 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d360ad5e-01a2-4b11-8f00-3ec794890639 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:53.066643 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249ebb01-9473-4324-b127-f011547d8144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:53.067308 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249ebb01-9473-4324-b127-f011547d8144 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:53.067536 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249ebb01-9473-4324-b127-f011547d8144 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:53.067799 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249ebb01-9473-4324-b127-f011547d8144 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:53.068046 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 140/278] 10.222.0.102 () {60 vars in 1137 bytes} [Mon Aug 1 15:24:52 2022] POST /identity/v3/users => generated 294 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:24:53.069363 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e273c7-e05d-4d94-804f-a1577ea353ab None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:53.069648 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e273c7-e05d-4d94-804f-a1577ea353ab None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:53.070156 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e273c7-e05d-4d94-804f-a1577ea353ab None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:53.072058 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 141/279] 10.222.0.102 () {54 vars in 931 bytes} [Mon Aug 1 15:24:53 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 15:24:53.074201 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249ebb01-9473-4324-b127-f011547d8144 None admin] RBAC: Adding query filter params (role.id=27f5093ac0674d799cdbd17c68482e32, user.id=ee80663e06104a5aa82e9772fdd0efa4, scope.system=all) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:53.075003 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249ebb01-9473-4324-b127-f011547d8144 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:53.078106 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249ebb01-9473-4324-b127-f011547d8144 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:53.078345 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ede3156-4a65-4aec-b5db-0d48a1d32e72 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:53.078585 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ede3156-4a65-4aec-b5db-0d48a1d32e72 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:53.078863 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ede3156-4a65-4aec-b5db-0d48a1d32e72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:53.093964 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 139/280] 10.222.0.102 () {56 vars in 1313 bytes} [Mon Aug 1 15:24:52 2022] GET /identity/v3/role_assignments?user.id=ee80663e06104a5aa82e9772fdd0efa4&scope.system=all&role.id=27f5093ac0674d799cdbd17c68482e32 => generated 227 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:53.107159 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-2ede3156-4a65-4aec-b5db-0d48a1d32e72 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:24:53.108430 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-2ede3156-4a65-4aec-b5db-0d48a1d32e72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:24:53.136615 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b7ec96-b029-4189-aeb8-c83927532d55 None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:53.136952 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b7ec96-b029-4189-aeb8-c83927532d55 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:53.137186 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b7ec96-b029-4189-aeb8-c83927532d55 None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:53.140152 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 140/281] 10.222.0.102 () {54 vars in 931 bytes} [Mon Aug 1 15:24:53 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 01 15:24:53.144884 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285690ea-eeca-4760-9c6b-8c5d4bafad0b None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:53.145120 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285690ea-eeca-4760-9c6b-8c5d4bafad0b None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:53.145349 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285690ea-eeca-4760-9c6b-8c5d4bafad0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:53.148604 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:53.166419 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-285690ea-eeca-4760-9c6b-8c5d4bafad0b None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:24:53.167897 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-285690ea-eeca-4760-9c6b-8c5d4bafad0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:24:53.205811 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 142/282] 10.222.0.102 () {58 vars in 1028 bytes} [Mon Aug 1 15:24:53 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 01 15:24:53.233980 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ede3156-4a65-4aec-b5db-0d48a1d32e72 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:53.240558 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:53.267920 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 141/283] 10.222.0.102 () {58 vars in 1028 bytes} [Mon Aug 1 15:24:53 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 01 15:24:53.290531 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285690ea-eeca-4760-9c6b-8c5d4bafad0b None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:53.364511 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ede3156-4a65-4aec-b5db-0d48a1d32e72 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:53.414989 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05feb1be-b633-4eb8-94b9-5804ec7fdb93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:53.415673 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05feb1be-b633-4eb8-94b9-5804ec7fdb93 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:53.415944 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05feb1be-b633-4eb8-94b9-5804ec7fdb93 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:53.416218 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05feb1be-b633-4eb8-94b9-5804ec7fdb93 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:53.424736 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285690ea-eeca-4760-9c6b-8c5d4bafad0b None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:53.429058 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05feb1be-b633-4eb8-94b9-5804ec7fdb93 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:24:53.435202 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-05feb1be-b633-4eb8-94b9-5804ec7fdb93 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 01 15:24:53.435202 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:24:53.435202 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:24:53.435202 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:24:53.435202 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:24:53.435202 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:24:53.435202 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:24:53.435202 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:24:53.435202 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:24:53.435202 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:24:53.435202 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:24:53.435202 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:24:53.435202 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:24:53.435202 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:24:53.435202 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:24:53.435202 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:24:53.436318 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:24:53.436318 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:24:53.436318 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:24:53.436318 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:24:53.436318 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:24:53.436318 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:24:53.436318 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:24:53.436318 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:24:53.436318 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:24:53.436318 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:24:53.436318 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:24:53.436318 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 01 15:24:53.436318 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:24:53.436318 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:24:53.436318 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:24:53.436318 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:24:53.437297 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:24:53.437297 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:24:53.437297 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:24:53.437297 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:24:53.437297 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:24:53.437297 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:24:53.437297 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:24:53.437297 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:24:53.437297 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:24:53.437297 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:24:53.437297 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 01 15:24:53.437297 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 01 15:24:53.437297 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 143/284] 10.222.0.102 () {56 vars in 1104 bytes} [Mon Aug 1 15:24:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:24:53.444106 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05feb1be-b633-4eb8-94b9-5804ec7fdb93 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:53.473282 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf61afd-1872-4969-9df4-be7a473557f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:53.474399 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf61afd-1872-4969-9df4-be7a473557f4 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:53.474855 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf61afd-1872-4969-9df4-be7a473557f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:53.475329 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf61afd-1872-4969-9df4-be7a473557f4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:53.481442 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:53.487390 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf61afd-1872-4969-9df4-be7a473557f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:24:53.492320 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-ecf61afd-1872-4969-9df4-be7a473557f4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 01 15:24:53.492320 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:24:53.492320 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:24:53.492320 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:24:53.492320 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:24:53.492320 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:24:53.492320 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:24:53.492320 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:24:53.492320 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:24:53.492320 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:24:53.492320 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:24:53.492320 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:24:53.492320 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:24:53.492320 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:24:53.492320 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:24:53.492320 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:24:53.499448 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:24:53.499448 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:24:53.499448 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:24:53.499448 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:24:53.499448 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:24:53.499448 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:24:53.499448 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:24:53.499448 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:24:53.499448 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:24:53.499448 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:24:53.499448 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:24:53.499448 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 01 15:24:53.499448 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:24:53.499448 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:24:53.499448 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:24:53.499448 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:24:53.500239 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:24:53.500239 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:24:53.500239 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:24:53.500239 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:24:53.500239 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:24:53.500239 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:24:53.500239 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:24:53.500239 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:24:53.500239 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:24:53.500239 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:24:53.500239 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 01 15:24:53.500239 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 01 15:24:53.500239 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 142/285] 10.222.0.102 () {56 vars in 1104 bytes} [Mon Aug 1 15:24:53 2022] GET /identity/v3/roles/reader => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 15:24:53.500968 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf61afd-1872-4969-9df4-be7a473557f4 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:53.578277 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:53.582144 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05feb1be-b633-4eb8-94b9-5804ec7fdb93 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:53.621258 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52eb4258-03e5-436d-802c-3ba6b84f3f11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:53.622294 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eb4258-03e5-436d-802c-3ba6b84f3f11 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:53.622742 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eb4258-03e5-436d-802c-3ba6b84f3f11 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:53.623154 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eb4258-03e5-436d-802c-3ba6b84f3f11 None admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:53.624060 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52eb4258-03e5-436d-802c-3ba6b84f3f11 None admin] RBAC: Adding query filter params (name=member) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:53.624501 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52eb4258-03e5-436d-802c-3ba6b84f3f11 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:53.627117 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52eb4258-03e5-436d-802c-3ba6b84f3f11 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:53.646351 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 144/286] 10.222.0.102 () {56 vars in 1106 bytes} [Mon Aug 1 15:24:53 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:24:53.653450 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52eb4258-03e5-436d-802c-3ba6b84f3f11 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:53.677006 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf61afd-1872-4969-9df4-be7a473557f4 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:53.751654 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1fd84a-6b4d-4182-a157-677c0078c676 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:53.752290 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1fd84a-6b4d-4182-a157-677c0078c676 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:53.752600 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1fd84a-6b4d-4182-a157-677c0078c676 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:53.752890 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1fd84a-6b4d-4182-a157-677c0078c676 None admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:53.753615 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1fd84a-6b4d-4182-a157-677c0078c676 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:53.753916 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1fd84a-6b4d-4182-a157-677c0078c676 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:53.755296 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1fd84a-6b4d-4182-a157-677c0078c676 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:53.773848 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 143/287] 10.222.0.102 () {56 vars in 1106 bytes} [Mon Aug 1 15:24:53 2022] GET /identity/v3/roles?name=reader => generated 343 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:24:53.779613 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1fd84a-6b4d-4182-a157-677c0078c676 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:53.810867 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:53.815873 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52eb4258-03e5-436d-802c-3ba6b84f3f11 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:53.870489 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fc9c12-599d-43ca-8073-b248128de635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:53.871149 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fc9c12-599d-43ca-8073-b248128de635 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:53.871431 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fc9c12-599d-43ca-8073-b248128de635 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:53.871711 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fc9c12-599d-43ca-8073-b248128de635 None admin] PATH_INFO: `/v3/users/ebf3562f36284490ab836787837bd909` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:53.877667 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fc9c12-599d-43ca-8073-b248128de635 None admin] RBAC: Authorizing `identity:get_user(user_id=ebf3562f36284490ab836787837bd909)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:53.879173 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fc9c12-599d-43ca-8073-b248128de635 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:53.881093 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 145/288] 10.222.0.102 () {56 vars in 1182 bytes} [Mon Aug 1 15:24:53 2022] GET /identity/v3/users/ebf3562f36284490ab836787837bd909 => generated 298 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:53.889809 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fc9c12-599d-43ca-8073-b248128de635 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:53.922217 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1fd84a-6b4d-4182-a157-677c0078c676 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:53.945012 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:53.958893 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb891e6-583d-40f1-a65f-38b25d9a70f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:53.963176 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb891e6-583d-40f1-a65f-38b25d9a70f2 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:53.963176 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb891e6-583d-40f1-a65f-38b25d9a70f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:53.963176 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb891e6-583d-40f1-a65f-38b25d9a70f2 None admin] PATH_INFO: `/v3/users/0b62f2357a2c4ef3967ffebb01bc405d` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:53.963176 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb891e6-583d-40f1-a65f-38b25d9a70f2 None admin] RBAC: Authorizing `identity:get_user(user_id=0b62f2357a2c4ef3967ffebb01bc405d)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:53.963478 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb891e6-583d-40f1-a65f-38b25d9a70f2 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:53.965619 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 144/289] 10.222.0.102 () {56 vars in 1182 bytes} [Mon Aug 1 15:24:53 2022] GET /identity/v3/users/0b62f2357a2c4ef3967ffebb01bc405d => generated 298 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:24:53.971135 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb891e6-583d-40f1-a65f-38b25d9a70f2 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:54.142343 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fc9c12-599d-43ca-8073-b248128de635 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:54.149508 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb891e6-583d-40f1-a65f-38b25d9a70f2 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:54.187630 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f250b187-a7dc-46bf-bb73-cdb849852121 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:54.188575 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f250b187-a7dc-46bf-bb73-cdb849852121 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:54.188994 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f250b187-a7dc-46bf-bb73-cdb849852121 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:54.189361 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f250b187-a7dc-46bf-bb73-cdb849852121 None admin] PATH_INFO: `/v3/projects/5db9d563233a43d8b5d7983c087936d2` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:54.190718 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f250b187-a7dc-46bf-bb73-cdb849852121 None admin] RBAC: Authorizing `identity:get_project(project_id=5db9d563233a43d8b5d7983c087936d2)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:54.192483 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f250b187-a7dc-46bf-bb73-cdb849852121 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:54.194619 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 145/290] 10.222.0.102 () {56 vars in 1191 bytes} [Mon Aug 1 15:24:53 2022] GET /identity/v3/projects/5db9d563233a43d8b5d7983c087936d2 => generated 303 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:54.200269 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb55def-fd66-418c-a362-6dbea33adfa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:54.200835 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb55def-fd66-418c-a362-6dbea33adfa6 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:54.201148 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb55def-fd66-418c-a362-6dbea33adfa6 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:54.201693 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb55def-fd66-418c-a362-6dbea33adfa6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:54.203006 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f250b187-a7dc-46bf-bb73-cdb849852121 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:54.263377 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:54.272289 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:54.326824 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb55def-fd66-418c-a362-6dbea33adfa6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:54.328313 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb55def-fd66-418c-a362-6dbea33adfa6 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:54.395836 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f250b187-a7dc-46bf-bb73-cdb849852121 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:54.433340 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49df5ec-3ab0-4e2c-86ba-0d6880ef8286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:54.434115 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49df5ec-3ab0-4e2c-86ba-0d6880ef8286 None admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:54.434417 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49df5ec-3ab0-4e2c-86ba-0d6880ef8286 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:54.434695 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49df5ec-3ab0-4e2c-86ba-0d6880ef8286 None admin] PATH_INFO: `/v3/projects/5db9d563233a43d8b5d7983c087936d2/users/0b62f2357a2c4ef3967ffebb01bc405d/roles/d517cfa9ee3e4f2b946b50d2236338f3` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:54.436714 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49df5ec-3ab0-4e2c-86ba-0d6880ef8286 None admin] RBAC: Authorizing `identity:create_grant(project_id=5db9d563233a43d8b5d7983c087936d2, user_id=0b62f2357a2c4ef3967ffebb01bc405d, role_id=d517cfa9ee3e4f2b946b50d2236338f3)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:54.438691 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49df5ec-3ab0-4e2c-86ba-0d6880ef8286 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:54.503186 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 146/291] 10.222.0.102 () {58 vars in 1444 bytes} [Mon Aug 1 15:24:54 2022] PUT /identity/v3/projects/5db9d563233a43d8b5d7983c087936d2/users/0b62f2357a2c4ef3967ffebb01bc405d/roles/d517cfa9ee3e4f2b946b50d2236338f3 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:24:54.505443 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 146/292] 10.222.0.102 () {58 vars in 1287 bytes} [Mon Aug 1 15:24:53 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 616 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 15:24:54.515677 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49df5ec-3ab0-4e2c-86ba-0d6880ef8286 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:54.669359 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49df5ec-3ab0-4e2c-86ba-0d6880ef8286 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:54.670983 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:54.707083 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904a9e71-4a1d-4c1a-9617-fabb35531d03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:54.707740 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904a9e71-4a1d-4c1a-9617-fabb35531d03 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:54.708016 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904a9e71-4a1d-4c1a-9617-fabb35531d03 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:54.708293 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904a9e71-4a1d-4c1a-9617-fabb35531d03 None admin] PATH_INFO: `/v3/projects/5db9d563233a43d8b5d7983c087936d2` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:54.709551 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904a9e71-4a1d-4c1a-9617-fabb35531d03 None admin] RBAC: Authorizing `identity:get_project(project_id=5db9d563233a43d8b5d7983c087936d2)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:54.711059 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904a9e71-4a1d-4c1a-9617-fabb35531d03 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:54.713169 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 147/293] 10.222.0.102 () {56 vars in 1191 bytes} [Mon Aug 1 15:24:54 2022] GET /identity/v3/projects/5db9d563233a43d8b5d7983c087936d2 => generated 303 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:54.718954 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb55def-fd66-418c-a362-6dbea33adfa6 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:54.784577 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:54.836483 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb55def-fd66-418c-a362-6dbea33adfa6 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:54.885678 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bb5130-fd55-4c8c-b828-35cb322a3c58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:54.886310 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bb5130-fd55-4c8c-b828-35cb322a3c58 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:54.886593 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bb5130-fd55-4c8c-b828-35cb322a3c58 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:54.886865 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bb5130-fd55-4c8c-b828-35cb322a3c58 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:54.887667 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bb5130-fd55-4c8c-b828-35cb322a3c58 None admin] RBAC: Adding query filter params (role.id=27f5093ac0674d799cdbd17c68482e32, scope.project.id=5db9d563233a43d8b5d7983c087936d2, user.id=ebf3562f36284490ab836787837bd909) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:54.887977 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bb5130-fd55-4c8c-b828-35cb322a3c58 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:54.893638 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bb5130-fd55-4c8c-b828-35cb322a3c58 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:54.900139 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 147/294] 10.222.0.102 () {56 vars in 1379 bytes} [Mon Aug 1 15:24:54 2022] GET /identity/v3/role_assignments?user.id=ebf3562f36284490ab836787837bd909&scope.project.id=5db9d563233a43d8b5d7983c087936d2&role.id=27f5093ac0674d799cdbd17c68482e32 => generated 610 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:55.458383 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e03805-923c-4285-a8ac-fbcc55146638 None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:55.459367 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e03805-923c-4285-a8ac-fbcc55146638 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:55.459883 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e03805-923c-4285-a8ac-fbcc55146638 None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:55.461621 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 148/295] 10.222.0.102 () {54 vars in 931 bytes} [Mon Aug 1 15:24:55 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 15:24:55.467142 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393cee04-94c8-49d4-bd87-f6a9bd87f6ac None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:55.467541 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393cee04-94c8-49d4-bd87-f6a9bd87f6ac None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:55.467730 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393cee04-94c8-49d4-bd87-f6a9bd87f6ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:55.491842 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-393cee04-94c8-49d4-bd87-f6a9bd87f6ac None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:24:55.493725 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-393cee04-94c8-49d4-bd87-f6a9bd87f6ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:24:55.566871 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 148/296] 10.222.0.102 () {58 vars in 1028 bytes} [Mon Aug 1 15:24:55 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 15:24:55.588803 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e03805-923c-4285-a8ac-fbcc55146638 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:55.706474 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e03805-923c-4285-a8ac-fbcc55146638 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:55.755508 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ad48a3-5812-4fc4-b4ae-d85fb051b278 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:55.755683 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ad48a3-5812-4fc4-b4ae-d85fb051b278 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:55.755967 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ad48a3-5812-4fc4-b4ae-d85fb051b278 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:55.757450 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 149/297] 10.222.0.102 () {54 vars in 931 bytes} [Mon Aug 1 15:24:55 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 15:24:55.760922 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7096b498-0c5d-4e6d-b9ab-afbdd9397839 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:55.761216 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7096b498-0c5d-4e6d-b9ab-afbdd9397839 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:55.761495 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7096b498-0c5d-4e6d-b9ab-afbdd9397839 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:55.763194 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 150/298] 10.222.0.102 () {54 vars in 931 bytes} [Mon Aug 1 15:24:55 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 01 15:24:55.764246 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58afbbdd-52d9-4b6c-b96b-6ef49dedb7b7 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:55.764528 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58afbbdd-52d9-4b6c-b96b-6ef49dedb7b7 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:55.766470 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58afbbdd-52d9-4b6c-b96b-6ef49dedb7b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:55.784898 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-58afbbdd-52d9-4b6c-b96b-6ef49dedb7b7 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:24:55.786081 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-58afbbdd-52d9-4b6c-b96b-6ef49dedb7b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:24:55.793837 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5521c02f-68f4-4f6c-9a9c-043466cee90f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:55.794483 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5521c02f-68f4-4f6c-9a9c-043466cee90f None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:55.794759 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5521c02f-68f4-4f6c-9a9c-043466cee90f None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:55.795032 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5521c02f-68f4-4f6c-9a9c-043466cee90f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:55.806415 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5521c02f-68f4-4f6c-9a9c-043466cee90f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:24:55.811360 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-5521c02f-68f4-4f6c-9a9c-043466cee90f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 01 15:24:55.811360 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:24:55.811360 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:24:55.811360 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:24:55.811360 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:24:55.811360 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:24:55.811360 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:24:55.811360 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:24:55.811360 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:24:55.811360 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:24:55.811360 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:24:55.811360 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:24:55.811360 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:24:55.811360 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:24:55.811360 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:24:55.811360 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:24:55.812234 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:24:55.812234 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:24:55.812234 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:24:55.812234 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:24:55.812234 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:24:55.812234 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:24:55.812234 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:24:55.812234 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:24:55.812234 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:24:55.812234 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:24:55.812234 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:24:55.812234 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 01 15:24:55.812234 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:24:55.812234 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:24:55.812234 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:24:55.812234 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:24:55.813090 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:24:55.813090 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:24:55.813090 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:24:55.813090 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:24:55.813090 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:24:55.813090 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:24:55.813090 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:24:55.813090 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:24:55.813090 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:24:55.813090 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:24:55.813090 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 01 15:24:55.813090 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 01 15:24:55.813090 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 149/299] 10.222.0.102 () {56 vars in 1104 bytes} [Mon Aug 1 15:24:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:24:55.813747 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740a8eaf-023d-4934-a1f4-12d488e38b34 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:55.814294 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740a8eaf-023d-4934-a1f4-12d488e38b34 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:55.814294 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740a8eaf-023d-4934-a1f4-12d488e38b34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:55.832142 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-740a8eaf-023d-4934-a1f4-12d488e38b34 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:24:55.833362 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-740a8eaf-023d-4934-a1f4-12d488e38b34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:24:55.844590 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:55.858901 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:55.868882 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 151/300] 10.222.0.102 () {58 vars in 1028 bytes} [Mon Aug 1 15:24:55 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 15:24:55.868882 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58afbbdd-52d9-4b6c-b96b-6ef49dedb7b7 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:55.919928 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 150/301] 10.222.0.102 () {58 vars in 1028 bytes} [Mon Aug 1 15:24:55 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 15:24:55.920932 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740a8eaf-023d-4934-a1f4-12d488e38b34 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:56.002778 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58afbbdd-52d9-4b6c-b96b-6ef49dedb7b7 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:56.036026 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740a8eaf-023d-4934-a1f4-12d488e38b34 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:56.036717 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a800845-3e4b-44d2-b315-26dbe685e5d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:56.037377 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a800845-3e4b-44d2-b315-26dbe685e5d0 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:56.037665 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a800845-3e4b-44d2-b315-26dbe685e5d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:56.037936 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a800845-3e4b-44d2-b315-26dbe685e5d0 None admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:56.038652 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a800845-3e4b-44d2-b315-26dbe685e5d0 None admin] RBAC: Adding query filter params (name=member) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:56.038955 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a800845-3e4b-44d2-b315-26dbe685e5d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:56.040927 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a800845-3e4b-44d2-b315-26dbe685e5d0 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:56.049146 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 152/302] 10.222.0.102 () {56 vars in 1106 bytes} [Mon Aug 1 15:24:55 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:56.049938 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a800845-3e4b-44d2-b315-26dbe685e5d0 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:56.080597 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433e7d09-8c38-4fc8-b6d8-487d7ccf5c44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:56.081287 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433e7d09-8c38-4fc8-b6d8-487d7ccf5c44 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:56.081578 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433e7d09-8c38-4fc8-b6d8-487d7ccf5c44 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:56.081838 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433e7d09-8c38-4fc8-b6d8-487d7ccf5c44 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:56.083169 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433e7d09-8c38-4fc8-b6d8-487d7ccf5c44 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:56.084532 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433e7d09-8c38-4fc8-b6d8-487d7ccf5c44 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:56.087391 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 151/303] 10.222.0.102 () {56 vars in 1113 bytes} [Mon Aug 1 15:24:55 2022] GET /identity/v3/domains/default => generated 200 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:56.087826 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433e7d09-8c38-4fc8-b6d8-487d7ccf5c44 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:56.102227 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:56.118767 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:56.157423 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a800845-3e4b-44d2-b315-26dbe685e5d0 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:56.197950 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd4eb00-fd25-45c3-8a4c-e87f3d051571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:56.198601 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd4eb00-fd25-45c3-8a4c-e87f3d051571 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:56.198882 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd4eb00-fd25-45c3-8a4c-e87f3d051571 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:56.199156 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd4eb00-fd25-45c3-8a4c-e87f3d051571 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:56.199636 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433e7d09-8c38-4fc8-b6d8-487d7ccf5c44 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:56.216657 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd4eb00-fd25-45c3-8a4c-e87f3d051571 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:24:56.226322 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-5fd4eb00-fd25-45c3-8a4c-e87f3d051571 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 01 15:24:56.226322 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:24:56.226322 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:24:56.226322 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:24:56.226322 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:24:56.226322 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:24:56.226322 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:24:56.226322 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:24:56.226322 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:24:56.226322 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:24:56.226322 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:24:56.226322 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:24:56.226322 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:24:56.226322 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:24:56.226322 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:24:56.226322 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:24:56.227261 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:24:56.227261 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:24:56.227261 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:24:56.227261 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:24:56.227261 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:24:56.227261 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:24:56.227261 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:24:56.227261 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:24:56.227261 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:24:56.227261 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:24:56.227261 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:24:56.227261 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 01 15:24:56.227261 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:24:56.227261 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:24:56.227261 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:24:56.227261 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:24:56.228468 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:24:56.228468 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:24:56.228468 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:24:56.228468 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:24:56.228468 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:24:56.228468 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:24:56.228468 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:24:56.228468 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:24:56.228468 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:24:56.228468 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:24:56.228468 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 01 15:24:56.228468 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 01 15:24:56.228468 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 153/304] 10.222.0.102 () {56 vars in 1104 bytes} [Mon Aug 1 15:24:56 2022] GET /identity/v3/roles/reader => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:24:56.233235 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd4eb00-fd25-45c3-8a4c-e87f3d051571 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:56.236522 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddee33b8-75f6-45c4-bab7-96bacb0d1571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:56.237279 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddee33b8-75f6-45c4-bab7-96bacb0d1571 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:56.237561 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddee33b8-75f6-45c4-bab7-96bacb0d1571 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:56.237836 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddee33b8-75f6-45c4-bab7-96bacb0d1571 None admin] PATH_INFO: `/v3/users/ee80663e06104a5aa82e9772fdd0efa4` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:56.239019 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddee33b8-75f6-45c4-bab7-96bacb0d1571 None admin] RBAC: Authorizing `identity:get_user(user_id=ee80663e06104a5aa82e9772fdd0efa4)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:56.240496 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddee33b8-75f6-45c4-bab7-96bacb0d1571 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:56.242448 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 152/305] 10.222.0.102 () {56 vars in 1182 bytes} [Mon Aug 1 15:24:56 2022] GET /identity/v3/users/ee80663e06104a5aa82e9772fdd0efa4 => generated 294 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:56.243319 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddee33b8-75f6-45c4-bab7-96bacb0d1571 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:56.345857 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:56.351995 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddee33b8-75f6-45c4-bab7-96bacb0d1571 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:56.364046 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd4eb00-fd25-45c3-8a4c-e87f3d051571 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:56.367266 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:56.397544 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d729581e-ae20-4e18-9cc6-66598d796f4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:56.398461 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d729581e-ae20-4e18-9cc6-66598d796f4f None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:56.398980 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d729581e-ae20-4e18-9cc6-66598d796f4f None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:56.399439 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d729581e-ae20-4e18-9cc6-66598d796f4f None admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:56.400161 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d729581e-ae20-4e18-9cc6-66598d796f4f None admin] RBAC: Adding query filter params (name=reader) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:56.400468 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d729581e-ae20-4e18-9cc6-66598d796f4f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:56.401877 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d729581e-ae20-4e18-9cc6-66598d796f4f None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:56.402241 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8340265-a767-43e0-9fc4-f74345c7a597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:56.403177 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8340265-a767-43e0-9fc4-f74345c7a597 None admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:56.403665 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8340265-a767-43e0-9fc4-f74345c7a597 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:56.404237 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8340265-a767-43e0-9fc4-f74345c7a597 None admin] PATH_INFO: `/v3/groups` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:56.405170 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8340265-a767-43e0-9fc4-f74345c7a597 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:56.406804 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8340265-a767-43e0-9fc4-f74345c7a597 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:56.415441 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 153/306] 10.222.0.102 () {56 vars in 1106 bytes} [Mon Aug 1 15:24:56 2022] GET /identity/v3/roles?name=reader => generated 343 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:56.415441 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d729581e-ae20-4e18-9cc6-66598d796f4f None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:56.521025 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 154/307] 10.222.0.102 () {60 vars in 1139 bytes} [Mon Aug 1 15:24:56 2022] POST /identity/v3/groups => generated 230 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:24:56.521025 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8340265-a767-43e0-9fc4-f74345c7a597 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:56.526161 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d729581e-ae20-4e18-9cc6-66598d796f4f None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:56.581545 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9fdf62-c327-4188-9343-c399cef37769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:56.582231 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9fdf62-c327-4188-9343-c399cef37769 None admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:56.582511 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9fdf62-c327-4188-9343-c399cef37769 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:56.582786 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9fdf62-c327-4188-9343-c399cef37769 None admin] PATH_INFO: `/v3/system/users/ee80663e06104a5aa82e9772fdd0efa4/roles/27f5093ac0674d799cdbd17c68482e32` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:56.584339 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9fdf62-c327-4188-9343-c399cef37769 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=ee80663e06104a5aa82e9772fdd0efa4, role_id=27f5093ac0674d799cdbd17c68482e32)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:56.585863 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9fdf62-c327-4188-9343-c399cef37769 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:56.660954 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8340265-a767-43e0-9fc4-f74345c7a597 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:56.681523 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 154/308] 10.222.0.102 () {58 vars in 1339 bytes} [Mon Aug 1 15:24:56 2022] PUT /identity/v3/system/users/ee80663e06104a5aa82e9772fdd0efa4/roles/27f5093ac0674d799cdbd17c68482e32 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:24:56.683457 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1929aa9-3f35-4ac0-927f-4b660d0b0323 None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:56.683815 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1929aa9-3f35-4ac0-927f-4b660d0b0323 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:56.684173 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1929aa9-3f35-4ac0-927f-4b660d0b0323 None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:56.686693 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 155/309] 10.222.0.102 () {54 vars in 931 bytes} [Mon Aug 1 15:24:56 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 15:24:56.704353 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981f239f-d172-4f91-b235-fe331f6964d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:56.705380 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981f239f-d172-4f91-b235-fe331f6964d0 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:56.705802 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981f239f-d172-4f91-b235-fe331f6964d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:56.706257 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981f239f-d172-4f91-b235-fe331f6964d0 None admin] PATH_INFO: `/v3/users/d1f0c9a5ba454a51b2e195e96ac5602a` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:56.708017 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b0f94d-f9ca-40e6-adb3-a2a9c52d7880 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:56.708310 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b0f94d-f9ca-40e6-adb3-a2a9c52d7880 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:56.708582 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b0f94d-f9ca-40e6-adb3-a2a9c52d7880 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:56.816525 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-95b0f94d-f9ca-40e6-adb3-a2a9c52d7880 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:24:56.817304 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981f239f-d172-4f91-b235-fe331f6964d0 None admin] RBAC: Authorizing `identity:get_user(user_id=d1f0c9a5ba454a51b2e195e96ac5602a)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:56.818385 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-95b0f94d-f9ca-40e6-adb3-a2a9c52d7880 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:24:56.818869 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981f239f-d172-4f91-b235-fe331f6964d0 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:56.821276 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 155/310] 10.222.0.102 () {56 vars in 1182 bytes} [Mon Aug 1 15:24:56 2022] GET /identity/v3/users/d1f0c9a5ba454a51b2e195e96ac5602a => generated 294 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:56.828432 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981f239f-d172-4f91-b235-fe331f6964d0 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:56.843833 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:56.855930 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:56.907374 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 156/311] 10.222.0.102 () {58 vars in 1028 bytes} [Mon Aug 1 15:24:56 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 01 15:24:56.929778 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b0f94d-f9ca-40e6-adb3-a2a9c52d7880 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:56.953129 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981f239f-d172-4f91-b235-fe331f6964d0 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:56.995216 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab16cce-6af3-4fbc-b157-9355e330b1f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:56.995843 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab16cce-6af3-4fbc-b157-9355e330b1f9 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:56.996133 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab16cce-6af3-4fbc-b157-9355e330b1f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:56.996394 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab16cce-6af3-4fbc-b157-9355e330b1f9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:56.997220 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab16cce-6af3-4fbc-b157-9355e330b1f9 None admin] RBAC: Adding query filter params (role.id=d517cfa9ee3e4f2b946b50d2236338f3, user.id=d1f0c9a5ba454a51b2e195e96ac5602a, scope.system=all) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:56.997634 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab16cce-6af3-4fbc-b157-9355e330b1f9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:56.999080 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab16cce-6af3-4fbc-b157-9355e330b1f9 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:57.006476 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 156/312] 10.222.0.102 () {56 vars in 1313 bytes} [Mon Aug 1 15:24:56 2022] GET /identity/v3/role_assignments?user.id=d1f0c9a5ba454a51b2e195e96ac5602a&scope.system=all&role.id=d517cfa9ee3e4f2b946b50d2236338f3 => generated 227 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:24:57.066388 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b0f94d-f9ca-40e6-adb3-a2a9c52d7880 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:57.106331 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c390d1ef-5343-4bd3-bf4b-a0c8b0361875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:57.107368 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c390d1ef-5343-4bd3-bf4b-a0c8b0361875 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:57.107819 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c390d1ef-5343-4bd3-bf4b-a0c8b0361875 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:57.108231 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c390d1ef-5343-4bd3-bf4b-a0c8b0361875 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:57.120570 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c390d1ef-5343-4bd3-bf4b-a0c8b0361875 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:24:57.125931 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-c390d1ef-5343-4bd3-bf4b-a0c8b0361875 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 01 15:24:57.125931 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:24:57.125931 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:24:57.125931 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:24:57.125931 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:24:57.125931 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:24:57.125931 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:24:57.125931 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:24:57.125931 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:24:57.125931 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:24:57.125931 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:24:57.125931 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:24:57.125931 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:24:57.125931 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:24:57.125931 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:24:57.125931 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:24:57.127083 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:24:57.127083 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:24:57.127083 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:24:57.127083 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:24:57.127083 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:24:57.127083 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:24:57.127083 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:24:57.127083 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:24:57.127083 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:24:57.127083 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:24:57.127083 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:24:57.127083 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 01 15:24:57.127083 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:24:57.127083 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:24:57.127083 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:24:57.127083 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:24:57.128072 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:24:57.128072 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:24:57.128072 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:24:57.128072 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:24:57.128072 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:24:57.128072 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:24:57.128072 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:24:57.128072 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:24:57.128072 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:24:57.128072 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:24:57.128072 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 01 15:24:57.128072 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 01 15:24:57.130193 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 157/313] 10.222.0.102 () {56 vars in 1104 bytes} [Mon Aug 1 15:24:56 2022] GET /identity/v3/roles/reader => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 15:24:57.137712 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab16cce-6af3-4fbc-b157-9355e330b1f9 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:57.231028 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:57.246961 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab16cce-6af3-4fbc-b157-9355e330b1f9 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:57.284755 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b6ce4b-cb58-4721-aa93-ba919ffaa292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:57.285778 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b6ce4b-cb58-4721-aa93-ba919ffaa292 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:57.286274 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b6ce4b-cb58-4721-aa93-ba919ffaa292 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:57.286743 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b6ce4b-cb58-4721-aa93-ba919ffaa292 None admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:57.287657 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b6ce4b-cb58-4721-aa93-ba919ffaa292 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:57.288179 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b6ce4b-cb58-4721-aa93-ba919ffaa292 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:57.289831 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b6ce4b-cb58-4721-aa93-ba919ffaa292 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:57.300469 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 157/314] 10.222.0.102 () {56 vars in 1106 bytes} [Mon Aug 1 15:24:57 2022] GET /identity/v3/roles?name=reader => generated 343 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:57.306375 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c390d1ef-5343-4bd3-bf4b-a0c8b0361875 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:57.325056 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:57.415376 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c390d1ef-5343-4bd3-bf4b-a0c8b0361875 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:57.450501 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030261ef-ed02-48a2-9259-ed3664e516a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:57.451148 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030261ef-ed02-48a2-9259-ed3664e516a0 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:57.451686 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030261ef-ed02-48a2-9259-ed3664e516a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:57.451965 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030261ef-ed02-48a2-9259-ed3664e516a0 None admin] PATH_INFO: `/v3/users/0b62f2357a2c4ef3967ffebb01bc405d` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:57.453257 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030261ef-ed02-48a2-9259-ed3664e516a0 None admin] RBAC: Authorizing `identity:get_user(user_id=0b62f2357a2c4ef3967ffebb01bc405d)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:57.454723 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030261ef-ed02-48a2-9259-ed3664e516a0 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:57.456766 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 158/315] 10.222.0.102 () {56 vars in 1182 bytes} [Mon Aug 1 15:24:57 2022] GET /identity/v3/users/0b62f2357a2c4ef3967ffebb01bc405d => generated 298 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:57.462661 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b6ce4b-cb58-4721-aa93-ba919ffaa292 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:57.572050 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b6ce4b-cb58-4721-aa93-ba919ffaa292 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:57.607896 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6f423b-4fb8-4fe0-a5ca-a470d0988062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:57.608516 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6f423b-4fb8-4fe0-a5ca-a470d0988062 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:57.608797 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6f423b-4fb8-4fe0-a5ca-a470d0988062 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:57.609097 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6f423b-4fb8-4fe0-a5ca-a470d0988062 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:57.627005 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:57.678074 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6f423b-4fb8-4fe0-a5ca-a470d0988062 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:57.679562 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6f423b-4fb8-4fe0-a5ca-a470d0988062 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:57.783884 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 158/316] 10.222.0.102 () {58 vars in 1287 bytes} [Mon Aug 1 15:24:57 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 01 15:24:57.793919 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030261ef-ed02-48a2-9259-ed3664e516a0 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:57.901246 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:57.910902 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030261ef-ed02-48a2-9259-ed3664e516a0 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:57.946903 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9770da12-cc61-4fbb-bc94-d382d0767c8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:57.947546 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9770da12-cc61-4fbb-bc94-d382d0767c8a None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:57.947825 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9770da12-cc61-4fbb-bc94-d382d0767c8a None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:57.948105 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9770da12-cc61-4fbb-bc94-d382d0767c8a None admin] PATH_INFO: `/v3/projects/5db9d563233a43d8b5d7983c087936d2` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:57.949314 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9770da12-cc61-4fbb-bc94-d382d0767c8a None admin] RBAC: Authorizing `identity:get_project(project_id=5db9d563233a43d8b5d7983c087936d2)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:57.950772 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9770da12-cc61-4fbb-bc94-d382d0767c8a None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:57.952892 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 159/317] 10.222.0.102 () {56 vars in 1191 bytes} [Mon Aug 1 15:24:57 2022] GET /identity/v3/projects/5db9d563233a43d8b5d7983c087936d2 => generated 303 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:57.958716 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6f423b-4fb8-4fe0-a5ca-a470d0988062 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:58.012380 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:58.066555 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6f423b-4fb8-4fe0-a5ca-a470d0988062 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:58.101440 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5ff4a6-4e7e-4b29-a5d3-9d9dc2b1eecc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:58.102087 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5ff4a6-4e7e-4b29-a5d3-9d9dc2b1eecc None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:58.102368 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5ff4a6-4e7e-4b29-a5d3-9d9dc2b1eecc None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:58.102639 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5ff4a6-4e7e-4b29-a5d3-9d9dc2b1eecc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:58.103428 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5ff4a6-4e7e-4b29-a5d3-9d9dc2b1eecc None admin] RBAC: Adding query filter params (role.id=d517cfa9ee3e4f2b946b50d2236338f3, scope.project.id=5db9d563233a43d8b5d7983c087936d2, user.id=0b62f2357a2c4ef3967ffebb01bc405d) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:58.103734 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5ff4a6-4e7e-4b29-a5d3-9d9dc2b1eecc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:58.105195 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5ff4a6-4e7e-4b29-a5d3-9d9dc2b1eecc None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:58.111546 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 159/318] 10.222.0.102 () {56 vars in 1379 bytes} [Mon Aug 1 15:24:57 2022] GET /identity/v3/role_assignments?user.id=0b62f2357a2c4ef3967ffebb01bc405d&scope.project.id=5db9d563233a43d8b5d7983c087936d2&role.id=d517cfa9ee3e4f2b946b50d2236338f3 => generated 610 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:58.621340 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd6ef37-e237-4fde-a0aa-71a1919bd242 None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:58.621733 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd6ef37-e237-4fde-a0aa-71a1919bd242 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:58.621928 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd6ef37-e237-4fde-a0aa-71a1919bd242 None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:58.623284 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 160/319] 10.222.0.102 () {54 vars in 931 bytes} [Mon Aug 1 15:24:58 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 15:24:58.628340 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2284ac57-a1e4-4a67-a088-99aec608bce8 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:58.628796 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2284ac57-a1e4-4a67-a088-99aec608bce8 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:58.628986 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2284ac57-a1e4-4a67-a088-99aec608bce8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:58.647460 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-2284ac57-a1e4-4a67-a088-99aec608bce8 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:24:58.649244 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-2284ac57-a1e4-4a67-a088-99aec608bce8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:24:58.718003 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 160/320] 10.222.0.102 () {58 vars in 1028 bytes} [Mon Aug 1 15:24:58 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 15:24:58.739926 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd6ef37-e237-4fde-a0aa-71a1919bd242 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:58.791771 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcd4af4-461e-4552-979e-732a3e2c2905 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:58.792096 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcd4af4-461e-4552-979e-732a3e2c2905 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:58.792329 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcd4af4-461e-4552-979e-732a3e2c2905 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:58.793880 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 161/321] 10.222.0.102 () {54 vars in 931 bytes} [Mon Aug 1 15:24:58 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 15:24:58.798451 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71d3ee8-44ee-4bd1-b104-ea2f1f9c9d6d None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:58.798737 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71d3ee8-44ee-4bd1-b104-ea2f1f9c9d6d None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:58.799016 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71d3ee8-44ee-4bd1-b104-ea2f1f9c9d6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:58.817249 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-d71d3ee8-44ee-4bd1-b104-ea2f1f9c9d6d None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:24:58.818441 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-d71d3ee8-44ee-4bd1-b104-ea2f1f9c9d6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:24:58.851248 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd6ef37-e237-4fde-a0aa-71a1919bd242 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:58.855783 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:58.895067 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 162/322] 10.222.0.102 () {58 vars in 1028 bytes} [Mon Aug 1 15:24:58 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 01 15:24:58.895355 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f7b0a5-8c7d-4e2d-8176-bb8cc7e403ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:58.895995 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f7b0a5-8c7d-4e2d-8176-bb8cc7e403ca None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:58.896369 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f7b0a5-8c7d-4e2d-8176-bb8cc7e403ca None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:58.896583 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f7b0a5-8c7d-4e2d-8176-bb8cc7e403ca None admin] PATH_INFO: `/v3/domains/default` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:58.901703 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f7b0a5-8c7d-4e2d-8176-bb8cc7e403ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:58.903150 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f7b0a5-8c7d-4e2d-8176-bb8cc7e403ca None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:58.904897 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 161/323] 10.222.0.102 () {56 vars in 1113 bytes} [Mon Aug 1 15:24:58 2022] GET /identity/v3/domains/default => generated 200 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:58.910176 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71d3ee8-44ee-4bd1-b104-ea2f1f9c9d6d None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:58.919108 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f7b0a5-8c7d-4e2d-8176-bb8cc7e403ca None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:58.942925 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:59.011379 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71d3ee8-44ee-4bd1-b104-ea2f1f9c9d6d None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:59.045743 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f7b0a5-8c7d-4e2d-8176-bb8cc7e403ca None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:59.047104 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5614a34-ec05-41ba-8bfe-21cc5c81b6b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:59.047736 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5614a34-ec05-41ba-8bfe-21cc5c81b6b7 None admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:59.048022 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5614a34-ec05-41ba-8bfe-21cc5c81b6b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:59.048301 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5614a34-ec05-41ba-8bfe-21cc5c81b6b7 None admin] PATH_INFO: `/v3/groups` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:59.049023 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5614a34-ec05-41ba-8bfe-21cc5c81b6b7 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:59.050468 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5614a34-ec05-41ba-8bfe-21cc5c81b6b7 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:59.081540 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d786a427-bb1b-4524-95ca-4bb66f6bcad2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:59.082184 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d786a427-bb1b-4524-95ca-4bb66f6bcad2 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:59.082461 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d786a427-bb1b-4524-95ca-4bb66f6bcad2 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:59.082731 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d786a427-bb1b-4524-95ca-4bb66f6bcad2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:59.092654 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d786a427-bb1b-4524-95ca-4bb66f6bcad2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:24:59.097579 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-d786a427-bb1b-4524-95ca-4bb66f6bcad2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 01 15:24:59.097579 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:24:59.097579 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:24:59.097579 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:24:59.097579 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:24:59.097579 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:24:59.097579 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:24:59.097579 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:24:59.097579 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:24:59.097579 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:24:59.097579 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:24:59.097579 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:24:59.097579 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:24:59.097579 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:24:59.097579 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:24:59.097579 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:24:59.098663 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:24:59.098663 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:24:59.098663 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:24:59.098663 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:24:59.098663 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:24:59.098663 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:24:59.098663 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:24:59.098663 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:24:59.098663 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:24:59.098663 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:24:59.098663 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:24:59.098663 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 01 15:24:59.098663 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:24:59.098663 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:24:59.098663 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:24:59.098663 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:24:59.099707 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:24:59.099707 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:24:59.099707 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:24:59.099707 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:24:59.099707 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:24:59.099707 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:24:59.099707 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:24:59.099707 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:24:59.099707 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:24:59.099707 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:24:59.099707 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 01 15:24:59.099707 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 01 15:24:59.099707 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 162/324] 10.222.0.102 () {56 vars in 1104 bytes} [Mon Aug 1 15:24:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 15:24:59.100551 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f8805b-c153-4c93-9e31-27d6e85fc160 None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:59.100551 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f8805b-c153-4c93-9e31-27d6e85fc160 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:59.100551 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f8805b-c153-4c93-9e31-27d6e85fc160 None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:59.101724 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 163/325] 10.222.0.102 () {54 vars in 931 bytes} [Mon Aug 1 15:24:59 2022] GET /identity => generated 271 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 15:24:59.106772 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f94a9b-dd52-4512-9301-aa27ee951729 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:59.107057 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f94a9b-dd52-4512-9301-aa27ee951729 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:59.107328 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f94a9b-dd52-4512-9301-aa27ee951729 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:59.125558 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-94f94a9b-dd52-4512-9301-aa27ee951729 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:24:59.126745 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-94f94a9b-dd52-4512-9301-aa27ee951729 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:24:59.131376 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 163/326] 10.222.0.102 () {60 vars in 1139 bytes} [Mon Aug 1 15:24:58 2022] POST /identity/v3/groups => generated 227 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 15:24:59.132186 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5614a34-ec05-41ba-8bfe-21cc5c81b6b7 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:59.177955 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:59.212873 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 164/327] 10.222.0.102 () {58 vars in 1028 bytes} [Mon Aug 1 15:24:59 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 01 15:24:59.227349 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f94a9b-dd52-4512-9301-aa27ee951729 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:59.237118 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:59.270052 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5614a34-ec05-41ba-8bfe-21cc5c81b6b7 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:59.312490 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d775656a-d998-4b3e-9b55-8f00bf12721a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:59.312933 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d775656a-d998-4b3e-9b55-8f00bf12721a None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:59.313215 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d775656a-d998-4b3e-9b55-8f00bf12721a None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:59.313487 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d775656a-d998-4b3e-9b55-8f00bf12721a None admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:59.314522 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d775656a-d998-4b3e-9b55-8f00bf12721a None admin] RBAC: Adding query filter params (name=member) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:59.314522 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d775656a-d998-4b3e-9b55-8f00bf12721a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:59.315874 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d775656a-d998-4b3e-9b55-8f00bf12721a None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:59.327425 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 164/328] 10.222.0.102 () {56 vars in 1106 bytes} [Mon Aug 1 15:24:59 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:59.332527 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d775656a-d998-4b3e-9b55-8f00bf12721a None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:59.355994 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f94a9b-dd52-4512-9301-aa27ee951729 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:59.403292 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2db20a-5c61-407c-b0d5-23ea918e0c91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:59.404288 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2db20a-5c61-407c-b0d5-23ea918e0c91 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:59.404288 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2db20a-5c61-407c-b0d5-23ea918e0c91 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:59.404467 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2db20a-5c61-407c-b0d5-23ea918e0c91 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:59.415539 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2db20a-5c61-407c-b0d5-23ea918e0c91 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:24:59.420569 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-5c2db20a-5c61-407c-b0d5-23ea918e0c91 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 01 15:24:59.420569 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:24:59.420569 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:24:59.420569 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:24:59.420569 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:24:59.420569 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:24:59.420569 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:24:59.420569 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:24:59.420569 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:24:59.420569 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:24:59.420569 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:24:59.420569 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:24:59.420569 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:24:59.420569 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:24:59.420569 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:24:59.420569 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:24:59.421754 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:24:59.421754 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:24:59.421754 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:24:59.421754 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:24:59.421754 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:24:59.421754 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:24:59.421754 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:24:59.421754 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:24:59.421754 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:24:59.421754 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:24:59.421754 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:24:59.421754 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 01 15:24:59.421754 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:24:59.421754 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:24:59.421754 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:24:59.421754 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:24:59.422550 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:24:59.422550 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:24:59.422550 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:24:59.422550 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:24:59.422550 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:24:59.422550 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:24:59.422550 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:24:59.422550 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:24:59.422550 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:24:59.422550 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:24:59.422550 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 01 15:24:59.422550 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 01 15:24:59.422550 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 165/329] 10.222.0.102 () {56 vars in 1104 bytes} [Mon Aug 1 15:24:59 2022] GET /identity/v3/roles/reader => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 15:24:59.428119 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2db20a-5c61-407c-b0d5-23ea918e0c91 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:59.456687 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:59.464929 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d775656a-d998-4b3e-9b55-8f00bf12721a None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:59.511701 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a734eb-964b-4e7c-b956-abb54cc2b51f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:59.513391 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a734eb-964b-4e7c-b956-abb54cc2b51f None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:59.513737 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a734eb-964b-4e7c-b956-abb54cc2b51f None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:59.514082 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a734eb-964b-4e7c-b956-abb54cc2b51f None admin] PATH_INFO: `/v3/users/ee80663e06104a5aa82e9772fdd0efa4` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:59.515370 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a734eb-964b-4e7c-b956-abb54cc2b51f None admin] RBAC: Authorizing `identity:get_user(user_id=ee80663e06104a5aa82e9772fdd0efa4)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:59.516791 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:59.517580 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a734eb-964b-4e7c-b956-abb54cc2b51f None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:59.519616 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 165/330] 10.222.0.102 () {56 vars in 1182 bytes} [Mon Aug 1 15:24:59 2022] GET /identity/v3/users/ee80663e06104a5aa82e9772fdd0efa4 => generated 294 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:24:59.529615 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a734eb-964b-4e7c-b956-abb54cc2b51f None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:59.561770 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2db20a-5c61-407c-b0d5-23ea918e0c91 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:59.608893 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7e1092-afcb-4da3-9b7d-541cc0683a1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:59.608893 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7e1092-afcb-4da3-9b7d-541cc0683a1e None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:59.608893 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7e1092-afcb-4da3-9b7d-541cc0683a1e None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:59.608893 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7e1092-afcb-4da3-9b7d-541cc0683a1e None admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:59.611600 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7e1092-afcb-4da3-9b7d-541cc0683a1e None admin] RBAC: Adding query filter params (name=reader) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:59.611600 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7e1092-afcb-4da3-9b7d-541cc0683a1e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:59.611600 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7e1092-afcb-4da3-9b7d-541cc0683a1e None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:59.621393 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 166/331] 10.222.0.102 () {56 vars in 1106 bytes} [Mon Aug 1 15:24:59 2022] GET /identity/v3/roles?name=reader => generated 343 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:24:59.627166 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7e1092-afcb-4da3-9b7d-541cc0683a1e None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:59.665384 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a734eb-964b-4e7c-b956-abb54cc2b51f None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:59.702482 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c33af38-4e7a-4ab0-bae7-4ca0801e73df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:59.703022 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c33af38-4e7a-4ab0-bae7-4ca0801e73df None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:59.703299 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c33af38-4e7a-4ab0-bae7-4ca0801e73df None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:59.703569 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c33af38-4e7a-4ab0-bae7-4ca0801e73df None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:59.704359 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c33af38-4e7a-4ab0-bae7-4ca0801e73df None admin] RBAC: Adding query filter params (role.id=27f5093ac0674d799cdbd17c68482e32, user.id=ee80663e06104a5aa82e9772fdd0efa4, scope.system=all) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:24:59.704661 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c33af38-4e7a-4ab0-bae7-4ca0801e73df None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:59.706140 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c33af38-4e7a-4ab0-bae7-4ca0801e73df None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:59.719332 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 166/332] 10.222.0.102 () {56 vars in 1313 bytes} [Mon Aug 1 15:24:59 2022] GET /identity/v3/role_assignments?user.id=ee80663e06104a5aa82e9772fdd0efa4&scope.system=all&role.id=27f5093ac0674d799cdbd17c68482e32 => generated 512 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:59.740749 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7e1092-afcb-4da3-9b7d-541cc0683a1e None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:59.773006 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:59.781896 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07569d5e-b740-4333-a5be-72dbdd72c9c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:59.782615 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07569d5e-b740-4333-a5be-72dbdd72c9c1 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:59.782965 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07569d5e-b740-4333-a5be-72dbdd72c9c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:59.783241 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07569d5e-b740-4333-a5be-72dbdd72c9c1 None admin] PATH_INFO: `/v3/users/d1f0c9a5ba454a51b2e195e96ac5602a` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:59.784546 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07569d5e-b740-4333-a5be-72dbdd72c9c1 None admin] RBAC: Authorizing `identity:get_user(user_id=d1f0c9a5ba454a51b2e195e96ac5602a)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:59.786138 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07569d5e-b740-4333-a5be-72dbdd72c9c1 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:24:59.788335 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 167/333] 10.222.0.102 () {56 vars in 1182 bytes} [Mon Aug 1 15:24:59 2022] GET /identity/v3/users/d1f0c9a5ba454a51b2e195e96ac5602a => generated 294 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:24:59.794265 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c33af38-4e7a-4ab0-bae7-4ca0801e73df None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:24:59.824066 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:59.924444 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c33af38-4e7a-4ab0-bae7-4ca0801e73df None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:24:59.961714 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab99abf-b062-4502-8d3d-406a61512794 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:24:59.962322 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab99abf-b062-4502-8d3d-406a61512794 None admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:24:59.962588 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab99abf-b062-4502-8d3d-406a61512794 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:24:59.962861 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab99abf-b062-4502-8d3d-406a61512794 None admin] PATH_INFO: `/v3/system/users/d1f0c9a5ba454a51b2e195e96ac5602a/roles/d517cfa9ee3e4f2b946b50d2236338f3` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:24:59.964322 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab99abf-b062-4502-8d3d-406a61512794 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=d1f0c9a5ba454a51b2e195e96ac5602a, role_id=d517cfa9ee3e4f2b946b50d2236338f3)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:24:59.965734 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab99abf-b062-4502-8d3d-406a61512794 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:00.030007 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 167/334] 10.222.0.102 () {58 vars in 1339 bytes} [Mon Aug 1 15:24:59 2022] PUT /identity/v3/system/users/d1f0c9a5ba454a51b2e195e96ac5602a/roles/d517cfa9ee3e4f2b946b50d2236338f3 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:25:01.574390 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5e7846-6d5f-4e88-a968-4853ce055208 None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:01.574933 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5e7846-6d5f-4e88-a968-4853ce055208 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:01.574933 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5e7846-6d5f-4e88-a968-4853ce055208 None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:01.576553 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 168/335] 10.222.0.102 () {54 vars in 931 bytes} [Mon Aug 1 15:25:01 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 15:25:01.594533 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c91ad9b-f466-4551-a296-e9954e721060 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:01.595028 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c91ad9b-f466-4551-a296-e9954e721060 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:01.595130 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c91ad9b-f466-4551-a296-e9954e721060 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:01.621893 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-5c91ad9b-f466-4551-a296-e9954e721060 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:25:01.623124 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-5c91ad9b-f466-4551-a296-e9954e721060 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:25:01.707530 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 168/336] 10.222.0.102 () {58 vars in 1028 bytes} [Mon Aug 1 15:25:01 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 15:25:01.762160 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5e7846-6d5f-4e88-a968-4853ce055208 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:01.934269 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5e7846-6d5f-4e88-a968-4853ce055208 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:01.995326 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300b277b-475b-4e84-9159-b321f936e7fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:01.996342 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300b277b-475b-4e84-9159-b321f936e7fe None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:01.996812 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300b277b-475b-4e84-9159-b321f936e7fe None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:01.997335 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300b277b-475b-4e84-9159-b321f936e7fe None admin] PATH_INFO: `/v3/roles/member` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:02.012335 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300b277b-475b-4e84-9159-b321f936e7fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:25:02.017624 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-300b277b-475b-4e84-9159-b321f936e7fe None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 01 15:25:02.017624 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:25:02.017624 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:25:02.017624 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:25:02.017624 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:25:02.017624 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:25:02.017624 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:25:02.017624 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:25:02.017624 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:25:02.017624 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:25:02.017624 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:25:02.017624 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:25:02.017624 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:25:02.017624 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:25:02.017624 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:25:02.017624 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:25:02.018494 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:25:02.018494 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:25:02.018494 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:25:02.018494 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:25:02.018494 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:25:02.018494 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:25:02.018494 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:25:02.018494 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:25:02.018494 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:25:02.018494 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:25:02.018494 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:25:02.018494 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 01 15:25:02.018494 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:25:02.018494 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:25:02.018494 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:25:02.018494 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:25:02.019270 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:25:02.019270 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:25:02.019270 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:25:02.019270 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:25:02.019270 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:25:02.019270 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:25:02.019270 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:25:02.019270 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:25:02.019270 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:25:02.019270 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:25:02.019270 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 01 15:25:02.019270 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 01 15:25:02.021924 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 169/337] 10.222.0.102 () {56 vars in 1104 bytes} [Mon Aug 1 15:25:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:25:02.028006 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c91ad9b-f466-4551-a296-e9954e721060 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:02.047026 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:02.145690 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c91ad9b-f466-4551-a296-e9954e721060 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:02.191602 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145fa1cc-94f0-4bd4-9f63-59f5282a313a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:02.192235 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145fa1cc-94f0-4bd4-9f63-59f5282a313a None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:02.192511 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145fa1cc-94f0-4bd4-9f63-59f5282a313a None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:02.192778 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145fa1cc-94f0-4bd4-9f63-59f5282a313a None admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:02.193538 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145fa1cc-94f0-4bd4-9f63-59f5282a313a None admin] RBAC: Adding query filter params (name=member) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:25:02.193839 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145fa1cc-94f0-4bd4-9f63-59f5282a313a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:02.195211 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145fa1cc-94f0-4bd4-9f63-59f5282a313a None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:02.207503 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 169/338] 10.222.0.102 () {56 vars in 1106 bytes} [Mon Aug 1 15:25:02 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:02.212994 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300b277b-475b-4e84-9159-b321f936e7fe None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:02.301882 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:02.359430 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300b277b-475b-4e84-9159-b321f936e7fe None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:02.405764 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a7453f-0fa4-4b7d-97dc-a7870d209c97 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:02.406060 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a7453f-0fa4-4b7d-97dc-a7870d209c97 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:02.406341 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a7453f-0fa4-4b7d-97dc-a7870d209c97 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:02.407491 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c499e532-a3aa-4a9f-a96b-4b913066885e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:02.407947 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 170/339] 10.222.0.102 () {54 vars in 931 bytes} [Mon Aug 1 15:25:02 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 15:25:02.408118 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c499e532-a3aa-4a9f-a96b-4b913066885e None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:02.408390 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c499e532-a3aa-4a9f-a96b-4b913066885e None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:02.408663 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c499e532-a3aa-4a9f-a96b-4b913066885e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:02.414028 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6b937f-a51d-41a7-9668-6eee42a79895 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:02.414852 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6b937f-a51d-41a7-9668-6eee42a79895 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:02.415130 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6b937f-a51d-41a7-9668-6eee42a79895 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:02.445631 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-4e6b937f-a51d-41a7-9668-6eee42a79895 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:25:02.446826 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-4e6b937f-a51d-41a7-9668-6eee42a79895 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:25:02.580745 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c499e532-a3aa-4a9f-a96b-4b913066885e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:02.582353 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c499e532-a3aa-4a9f-a96b-4b913066885e None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:02.623200 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 171/340] 10.222.0.102 () {58 vars in 1028 bytes} [Mon Aug 1 15:25:02 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 15:25:02.630036 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a905fd-bd2b-43ff-aa19-63f19f70f615 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:02.630314 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a905fd-bd2b-43ff-aa19-63f19f70f615 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:02.630581 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a905fd-bd2b-43ff-aa19-63f19f70f615 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:02.631928 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 172/341] 10.222.0.102 () {54 vars in 931 bytes} [Mon Aug 1 15:25:02 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 01 15:25:02.638004 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd4ab84-c383-4656-b07c-5c5b9073b576 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:02.638292 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd4ab84-c383-4656-b07c-5c5b9073b576 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:02.638565 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd4ab84-c383-4656-b07c-5c5b9073b576 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:02.660425 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:02.674066 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-9dd4ab84-c383-4656-b07c-5c5b9073b576 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:25:02.675458 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-9dd4ab84-c383-4656-b07c-5c5b9073b576 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:25:02.693272 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:02.742696 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 170/342] 10.222.0.102 () {58 vars in 1287 bytes} [Mon Aug 1 15:25:02 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 529 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 15:25:02.743489 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c499e532-a3aa-4a9f-a96b-4b913066885e None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:02.794638 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 173/343] 10.222.0.102 () {58 vars in 1028 bytes} [Mon Aug 1 15:25:02 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 01 15:25:02.795389 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd4ab84-c383-4656-b07c-5c5b9073b576 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:02.875936 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c499e532-a3aa-4a9f-a96b-4b913066885e None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:02.924467 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e96cd0-4367-4fc4-8fd7-fed82a4c1670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:02.925060 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e96cd0-4367-4fc4-8fd7-fed82a4c1670 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:02.925346 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e96cd0-4367-4fc4-8fd7-fed82a4c1670 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:02.925618 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e96cd0-4367-4fc4-8fd7-fed82a4c1670 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:02.939380 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e96cd0-4367-4fc4-8fd7-fed82a4c1670 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:25:02.944444 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-01e96cd0-4367-4fc4-8fd7-fed82a4c1670 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 01 15:25:02.944444 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:25:02.944444 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:25:02.944444 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:25:02.944444 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:25:02.944444 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:25:02.944444 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:25:02.944444 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:25:02.944444 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:25:02.944444 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:25:02.944444 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:25:02.944444 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:25:02.944444 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:25:02.944444 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:25:02.944444 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:25:02.944444 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:25:02.945442 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:25:02.945442 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:25:02.945442 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:25:02.945442 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:25:02.945442 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:25:02.945442 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:25:02.945442 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:25:02.945442 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:25:02.945442 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:25:02.945442 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:25:02.945442 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:25:02.945442 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 01 15:25:02.945442 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:25:02.945442 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:25:02.945442 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:25:02.945442 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:25:02.946750 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:25:02.946750 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:25:02.946750 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:25:02.946750 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:25:02.946750 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:25:02.946750 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:25:02.946750 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:25:02.946750 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:25:02.946750 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:25:02.946750 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:25:02.946750 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 01 15:25:02.946750 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 01 15:25:02.946750 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 171/344] 10.222.0.102 () {56 vars in 1119 bytes} [Mon Aug 1 15:25:02 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:25:02.947409 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e96cd0-4367-4fc4-8fd7-fed82a4c1670 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:02.975113 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:02.999075 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd4ab84-c383-4656-b07c-5c5b9073b576 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:03.050882 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bb46bc-0a2f-40bf-95e8-c0154535e15e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:03.051977 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bb46bc-0a2f-40bf-95e8-c0154535e15e None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:03.052511 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bb46bc-0a2f-40bf-95e8-c0154535e15e None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:03.053032 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bb46bc-0a2f-40bf-95e8-c0154535e15e None admin] PATH_INFO: `/v3/projects/dfcf3ac155ec4ab1b51e9b6849baec64` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:03.054529 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bb46bc-0a2f-40bf-95e8-c0154535e15e None admin] RBAC: Authorizing `identity:get_project(project_id=dfcf3ac155ec4ab1b51e9b6849baec64)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:03.057055 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bb46bc-0a2f-40bf-95e8-c0154535e15e None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:03.059264 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 174/345] 10.222.0.102 () {56 vars in 1191 bytes} [Mon Aug 1 15:25:02 2022] GET /identity/v3/projects/dfcf3ac155ec4ab1b51e9b6849baec64 => generated 299 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:03.060258 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bb46bc-0a2f-40bf-95e8-c0154535e15e None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:03.064329 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e96cd0-4367-4fc4-8fd7-fed82a4c1670 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:03.064549 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:03.101397 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97c317d-b1b5-430f-9b1c-f42ff9c3905e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:03.102603 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97c317d-b1b5-430f-9b1c-f42ff9c3905e None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:03.102885 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97c317d-b1b5-430f-9b1c-f42ff9c3905e None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:03.103158 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97c317d-b1b5-430f-9b1c-f42ff9c3905e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:03.113751 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97c317d-b1b5-430f-9b1c-f42ff9c3905e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:25:03.120399 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-b97c317d-b1b5-430f-9b1c-f42ff9c3905e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 01 15:25:03.120399 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:25:03.120399 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:25:03.120399 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:25:03.120399 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:25:03.120399 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:25:03.120399 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:25:03.120399 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:25:03.120399 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:25:03.120399 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:25:03.120399 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:25:03.120399 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:25:03.120399 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:25:03.120399 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:25:03.120399 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:25:03.120399 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:25:03.121351 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:25:03.121351 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:25:03.121351 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:25:03.121351 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:25:03.121351 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:25:03.121351 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:25:03.121351 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:25:03.121351 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:25:03.121351 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:25:03.121351 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:25:03.121351 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:25:03.121351 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 01 15:25:03.121351 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:25:03.121351 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:25:03.121351 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:25:03.121351 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:25:03.122264 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:25:03.122264 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:25:03.122264 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:25:03.122264 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:25:03.122264 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:25:03.122264 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:25:03.122264 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:25:03.122264 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:25:03.122264 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:25:03.122264 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:25:03.122264 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 01 15:25:03.122264 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 01 15:25:03.122264 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 172/346] 10.222.0.102 () {56 vars in 1104 bytes} [Mon Aug 1 15:25:02 2022] GET /identity/v3/roles/reader => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:25:03.123427 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3556b48-12b9-4e68-a6cc-deb1f6ae6e35 None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:03.123427 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3556b48-12b9-4e68-a6cc-deb1f6ae6e35 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:03.123651 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3556b48-12b9-4e68-a6cc-deb1f6ae6e35 None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:03.124895 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 173/347] 10.222.0.102 () {54 vars in 931 bytes} [Mon Aug 1 15:25:03 2022] GET /identity => generated 271 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 15:25:03.125559 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3556b48-12b9-4e68-a6cc-deb1f6ae6e35 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:03.185863 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bb46bc-0a2f-40bf-95e8-c0154535e15e None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:03.223531 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:03.229558 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1e1a9d-f24e-4601-894d-c8ce9f9642e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:03.230378 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1e1a9d-f24e-4601-894d-c8ce9f9642e9 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:03.242017 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1e1a9d-f24e-4601-894d-c8ce9f9642e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:03.242017 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1e1a9d-f24e-4601-894d-c8ce9f9642e9 None admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:03.242017 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1e1a9d-f24e-4601-894d-c8ce9f9642e9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:25:03.242017 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1e1a9d-f24e-4601-894d-c8ce9f9642e9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:03.242017 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1e1a9d-f24e-4601-894d-c8ce9f9642e9 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:03.244687 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 175/348] 10.222.0.102 () {56 vars in 1116 bytes} [Mon Aug 1 15:25:03 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:03.246065 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b7c22a-d60d-4a72-b66d-36ce40af82dd None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:03.246353 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b7c22a-d60d-4a72-b66d-36ce40af82dd None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:03.246637 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b7c22a-d60d-4a72-b66d-36ce40af82dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:03.256825 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3556b48-12b9-4e68-a6cc-deb1f6ae6e35 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:03.270560 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-03b7c22a-d60d-4a72-b66d-36ce40af82dd None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:25:03.272812 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-03b7c22a-d60d-4a72-b66d-36ce40af82dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:25:03.316557 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecb479e-ec68-44b5-b3b1-f76f181618e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:03.317239 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecb479e-ec68-44b5-b3b1-f76f181618e9 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:03.317526 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecb479e-ec68-44b5-b3b1-f76f181618e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:03.317793 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecb479e-ec68-44b5-b3b1-f76f181618e9 None admin] PATH_INFO: `/v3/groups/d18530a57eae416c8bab748ea01a7cff` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:03.328551 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecb479e-ec68-44b5-b3b1-f76f181618e9 None admin] RBAC: Authorizing `identity:get_group(group_id=d18530a57eae416c8bab748ea01a7cff)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:03.332578 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecb479e-ec68-44b5-b3b1-f76f181618e9 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:03.332578 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 174/349] 10.222.0.102 () {56 vars in 1185 bytes} [Mon Aug 1 15:25:03 2022] GET /identity/v3/groups/d18530a57eae416c8bab748ea01a7cff => generated 227 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:03.333484 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecb479e-ec68-44b5-b3b1-f76f181618e9 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:03.368803 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:03.377623 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 176/350] 10.222.0.102 () {58 vars in 1028 bytes} [Mon Aug 1 15:25:03 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 15:25:03.385752 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b7c22a-d60d-4a72-b66d-36ce40af82dd None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:03.463770 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecb479e-ec68-44b5-b3b1-f76f181618e9 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:03.500521 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e101a6-6ff1-4c0d-9fc8-de9798e66d28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:03.503947 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e101a6-6ff1-4c0d-9fc8-de9798e66d28 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:03.503947 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e101a6-6ff1-4c0d-9fc8-de9798e66d28 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:03.503947 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e101a6-6ff1-4c0d-9fc8-de9798e66d28 None admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:03.503947 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e101a6-6ff1-4c0d-9fc8-de9798e66d28 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:25:03.503947 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e101a6-6ff1-4c0d-9fc8-de9798e66d28 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:03.504303 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e101a6-6ff1-4c0d-9fc8-de9798e66d28 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:03.515122 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 175/351] 10.222.0.102 () {56 vars in 1106 bytes} [Mon Aug 1 15:25:03 2022] GET /identity/v3/roles?name=reader => generated 343 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:03.516049 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e101a6-6ff1-4c0d-9fc8-de9798e66d28 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:03.518946 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:03.526887 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b7c22a-d60d-4a72-b66d-36ce40af82dd None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:03.566875 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67197f5c-f95c-4a30-acc6-0c221a6132c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:03.567504 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67197f5c-f95c-4a30-acc6-0c221a6132c8 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:03.567783 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67197f5c-f95c-4a30-acc6-0c221a6132c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:03.568054 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67197f5c-f95c-4a30-acc6-0c221a6132c8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:03.644438 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e101a6-6ff1-4c0d-9fc8-de9798e66d28 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:03.662810 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:03.673639 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67197f5c-f95c-4a30-acc6-0c221a6132c8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:03.675401 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67197f5c-f95c-4a30-acc6-0c221a6132c8 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:03.692126 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fafb00-2313-44a1-af9d-4d281b04db65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:03.693025 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fafb00-2313-44a1-af9d-4d281b04db65 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:03.693451 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fafb00-2313-44a1-af9d-4d281b04db65 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:03.693868 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fafb00-2313-44a1-af9d-4d281b04db65 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:03.694861 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fafb00-2313-44a1-af9d-4d281b04db65 None admin] RBAC: Adding query filter params (group.id=d18530a57eae416c8bab748ea01a7cff, role.id=27f5093ac0674d799cdbd17c68482e32, scope.project.id=dfcf3ac155ec4ab1b51e9b6849baec64) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:25:03.695869 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fafb00-2313-44a1-af9d-4d281b04db65 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:03.697520 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fafb00-2313-44a1-af9d-4d281b04db65 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:03.704768 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 176/352] 10.222.0.102 () {56 vars in 1381 bytes} [Mon Aug 1 15:25:03 2022] GET /identity/v3/role_assignments?group.id=d18530a57eae416c8bab748ea01a7cff&scope.project.id=dfcf3ac155ec4ab1b51e9b6849baec64&role.id=27f5093ac0674d799cdbd17c68482e32 => generated 261 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:03.706214 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d366d14d-9390-42f3-a661-203f948acf65 None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:03.706669 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d366d14d-9390-42f3-a661-203f948acf65 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:03.707103 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d366d14d-9390-42f3-a661-203f948acf65 None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:03.708746 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 177/353] 10.222.0.102 () {54 vars in 931 bytes} [Mon Aug 1 15:25:03 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 15:25:03.709738 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d366d14d-9390-42f3-a661-203f948acf65 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:03.790654 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 177/354] 10.222.0.102 () {58 vars in 1287 bytes} [Mon Aug 1 15:25:03 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 15:25:03.791462 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:03.791572 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67197f5c-f95c-4a30-acc6-0c221a6132c8 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:03.836906 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d366d14d-9390-42f3-a661-203f948acf65 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:03.890212 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23e7f31-2aef-4b5d-87bc-d54eed16e961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:03.891344 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23e7f31-2aef-4b5d-87bc-d54eed16e961 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:03.891857 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23e7f31-2aef-4b5d-87bc-d54eed16e961 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:03.892406 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23e7f31-2aef-4b5d-87bc-d54eed16e961 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:03.895520 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:03.904234 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67197f5c-f95c-4a30-acc6-0c221a6132c8 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:03.908974 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23e7f31-2aef-4b5d-87bc-d54eed16e961 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:25:03.914959 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-b23e7f31-2aef-4b5d-87bc-d54eed16e961 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 01 15:25:03.914959 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:25:03.914959 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:25:03.914959 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:25:03.914959 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:25:03.914959 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:25:03.914959 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:25:03.914959 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:25:03.914959 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:25:03.914959 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:25:03.914959 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:25:03.914959 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:25:03.914959 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:25:03.914959 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:25:03.914959 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:25:03.914959 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:25:03.915936 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:25:03.915936 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:25:03.915936 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:25:03.915936 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:25:03.915936 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:25:03.915936 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:25:03.915936 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:25:03.915936 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:25:03.915936 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:25:03.915936 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:25:03.915936 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:25:03.915936 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 01 15:25:03.915936 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:25:03.915936 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:25:03.915936 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:25:03.915936 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:25:03.916753 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:25:03.916753 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:25:03.916753 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:25:03.916753 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:25:03.916753 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:25:03.916753 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:25:03.916753 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:25:03.916753 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:25:03.916753 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:25:03.916753 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:25:03.916753 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 01 15:25:03.916753 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 01 15:25:03.919385 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 178/355] 10.222.0.102 () {56 vars in 1104 bytes} [Mon Aug 1 15:25:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:25:03.924911 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f9cc03-cfa2-498c-9c35-b7a6ac806de0 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:03.925557 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f9cc03-cfa2-498c-9c35-b7a6ac806de0 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:03.926046 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f9cc03-cfa2-498c-9c35-b7a6ac806de0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:03.947678 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-d3f9cc03-cfa2-498c-9c35-b7a6ac806de0 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:25:03.949729 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-d3f9cc03-cfa2-498c-9c35-b7a6ac806de0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:25:03.952440 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acf95ea-c587-4772-a93a-b7619a9c962e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:03.953134 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acf95ea-c587-4772-a93a-b7619a9c962e None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:03.953409 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acf95ea-c587-4772-a93a-b7619a9c962e None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:03.953675 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acf95ea-c587-4772-a93a-b7619a9c962e None admin] PATH_INFO: `/v3/users/d1f0c9a5ba454a51b2e195e96ac5602a` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:03.956105 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acf95ea-c587-4772-a93a-b7619a9c962e None admin] RBAC: Authorizing `identity:get_user(user_id=d1f0c9a5ba454a51b2e195e96ac5602a)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:03.957646 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acf95ea-c587-4772-a93a-b7619a9c962e None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:03.964136 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 178/356] 10.222.0.102 () {56 vars in 1182 bytes} [Mon Aug 1 15:25:03 2022] GET /identity/v3/users/d1f0c9a5ba454a51b2e195e96ac5602a => generated 294 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:03.965152 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acf95ea-c587-4772-a93a-b7619a9c962e None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:04.026189 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 179/357] 10.222.0.102 () {58 vars in 1028 bytes} [Mon Aug 1 15:25:03 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 15:25:04.027315 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f9cc03-cfa2-498c-9c35-b7a6ac806de0 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:04.099797 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:04.110622 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acf95ea-c587-4772-a93a-b7619a9c962e None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:04.152683 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f9cc03-cfa2-498c-9c35-b7a6ac806de0 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:04.159036 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553f38b8-7824-4293-9afa-348b3b7d3c2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:04.159693 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553f38b8-7824-4293-9afa-348b3b7d3c2a None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:04.160031 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553f38b8-7824-4293-9afa-348b3b7d3c2a None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:04.160307 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553f38b8-7824-4293-9afa-348b3b7d3c2a None admin] PATH_INFO: `/v3/projects/dfcf3ac155ec4ab1b51e9b6849baec64` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:04.161975 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553f38b8-7824-4293-9afa-348b3b7d3c2a None admin] RBAC: Authorizing `identity:get_project(project_id=dfcf3ac155ec4ab1b51e9b6849baec64)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:04.163806 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553f38b8-7824-4293-9afa-348b3b7d3c2a None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:04.166654 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 179/358] 10.222.0.102 () {56 vars in 1191 bytes} [Mon Aug 1 15:25:03 2022] GET /identity/v3/projects/dfcf3ac155ec4ab1b51e9b6849baec64 => generated 299 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:04.167582 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553f38b8-7824-4293-9afa-348b3b7d3c2a None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:04.197971 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806ac86a-1d45-4089-b8bd-396b756f82e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:04.199059 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806ac86a-1d45-4089-b8bd-396b756f82e6 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:04.199606 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806ac86a-1d45-4089-b8bd-396b756f82e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:04.199879 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806ac86a-1d45-4089-b8bd-396b756f82e6 None admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:04.200903 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806ac86a-1d45-4089-b8bd-396b756f82e6 None admin] RBAC: Adding query filter params (name=member) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:25:04.201482 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806ac86a-1d45-4089-b8bd-396b756f82e6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:04.203739 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806ac86a-1d45-4089-b8bd-396b756f82e6 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:04.206156 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:04.216075 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 180/359] 10.222.0.102 () {56 vars in 1106 bytes} [Mon Aug 1 15:25:04 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:04.223363 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe447232-3a60-48f3-b7de-a4f155d911b5 None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:04.223363 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe447232-3a60-48f3-b7de-a4f155d911b5 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:04.223363 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe447232-3a60-48f3-b7de-a4f155d911b5 None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:04.223363 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 181/360] 10.222.0.102 () {54 vars in 931 bytes} [Mon Aug 1 15:25:04 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 15:25:04.223363 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe447232-3a60-48f3-b7de-a4f155d911b5 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:04.319414 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553f38b8-7824-4293-9afa-348b3b7d3c2a None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:04.365975 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0588922-a4ab-4179-a1a9-99e2906dfe35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:04.366576 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0588922-a4ab-4179-a1a9-99e2906dfe35 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:04.366851 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0588922-a4ab-4179-a1a9-99e2906dfe35 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:04.367120 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0588922-a4ab-4179-a1a9-99e2906dfe35 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:04.367960 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0588922-a4ab-4179-a1a9-99e2906dfe35 None admin] RBAC: Adding query filter params (role.id=d517cfa9ee3e4f2b946b50d2236338f3, user.id=d1f0c9a5ba454a51b2e195e96ac5602a, scope.system=all) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:25:04.368268 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0588922-a4ab-4179-a1a9-99e2906dfe35 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:04.369828 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0588922-a4ab-4179-a1a9-99e2906dfe35 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:04.389121 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 180/361] 10.222.0.102 () {56 vars in 1313 bytes} [Mon Aug 1 15:25:04 2022] GET /identity/v3/role_assignments?user.id=d1f0c9a5ba454a51b2e195e96ac5602a&scope.system=all&role.id=d517cfa9ee3e4f2b946b50d2236338f3 => generated 512 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:04.389121 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0588922-a4ab-4179-a1a9-99e2906dfe35 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:04.393879 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe447232-3a60-48f3-b7de-a4f155d911b5 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:04.440112 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:04.480703 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be47ea80-4449-444f-9036-5b6357bc4615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:04.481719 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be47ea80-4449-444f-9036-5b6357bc4615 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:04.482002 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be47ea80-4449-444f-9036-5b6357bc4615 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:04.482275 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be47ea80-4449-444f-9036-5b6357bc4615 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:04.499223 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be47ea80-4449-444f-9036-5b6357bc4615 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:25:04.505423 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-be47ea80-4449-444f-9036-5b6357bc4615 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 01 15:25:04.505423 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:25:04.505423 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:25:04.505423 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:25:04.505423 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:25:04.505423 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:25:04.505423 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:25:04.505423 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:25:04.505423 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:25:04.505423 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:25:04.505423 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:25:04.505423 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:25:04.505423 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:25:04.505423 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:25:04.505423 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:25:04.505423 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:25:04.506382 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:25:04.506382 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:25:04.506382 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:25:04.506382 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:25:04.506382 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:25:04.506382 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:25:04.506382 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:25:04.506382 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:25:04.506382 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:25:04.506382 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:25:04.506382 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:25:04.506382 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 01 15:25:04.506382 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:25:04.506382 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:25:04.506382 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:25:04.506382 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:25:04.507217 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:25:04.507217 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:25:04.507217 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:25:04.507217 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:25:04.507217 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:25:04.507217 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:25:04.507217 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:25:04.507217 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:25:04.507217 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:25:04.507217 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:25:04.507217 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 01 15:25:04.507217 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 01 15:25:04.507217 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 182/362] 10.222.0.102 () {56 vars in 1119 bytes} [Mon Aug 1 15:25:04 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:25:04.508441 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be47ea80-4449-444f-9036-5b6357bc4615 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:04.566106 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:04.587506 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0588922-a4ab-4179-a1a9-99e2906dfe35 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:04.652110 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c31b462-872c-425b-a726-f17d889f760a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:04.653695 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c31b462-872c-425b-a726-f17d889f760a None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:04.653695 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c31b462-872c-425b-a726-f17d889f760a None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:04.655109 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c31b462-872c-425b-a726-f17d889f760a None admin] PATH_INFO: `/v3/groups/d18530a57eae416c8bab748ea01a7cff` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:04.657308 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c31b462-872c-425b-a726-f17d889f760a None admin] RBAC: Authorizing `identity:get_group(group_id=d18530a57eae416c8bab748ea01a7cff)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:04.659254 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c31b462-872c-425b-a726-f17d889f760a None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:04.662125 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 181/363] 10.222.0.102 () {56 vars in 1185 bytes} [Mon Aug 1 15:25:04 2022] GET /identity/v3/groups/d18530a57eae416c8bab748ea01a7cff => generated 227 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:04.663549 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d694d5ef-e00c-4d0d-bca4-7e589cf0fc64 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:04.664124 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d694d5ef-e00c-4d0d-bca4-7e589cf0fc64 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:04.664124 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d694d5ef-e00c-4d0d-bca4-7e589cf0fc64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:04.681854 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be47ea80-4449-444f-9036-5b6357bc4615 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:04.693883 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-d694d5ef-e00c-4d0d-bca4-7e589cf0fc64 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:25:04.698707 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-d694d5ef-e00c-4d0d-bca4-7e589cf0fc64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:25:04.731645 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2557ecaf-dfa6-46a6-a755-4edd09298baa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:04.732373 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2557ecaf-dfa6-46a6-a755-4edd09298baa None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:04.732656 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2557ecaf-dfa6-46a6-a755-4edd09298baa None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:04.732977 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2557ecaf-dfa6-46a6-a755-4edd09298baa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:04.787688 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:04.791090 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 182/364] 10.222.0.102 () {58 vars in 1028 bytes} [Mon Aug 1 15:25:04 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 15:25:04.792229 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d694d5ef-e00c-4d0d-bca4-7e589cf0fc64 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:04.812359 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2557ecaf-dfa6-46a6-a755-4edd09298baa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:04.814748 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2557ecaf-dfa6-46a6-a755-4edd09298baa None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:04.923685 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:04.939090 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d694d5ef-e00c-4d0d-bca4-7e589cf0fc64 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:04.952893 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 183/365] 10.222.0.102 () {58 vars in 1287 bytes} [Mon Aug 1 15:25:04 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 15:25:04.953855 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2557ecaf-dfa6-46a6-a755-4edd09298baa None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:04.981141 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654ae42e-2f16-4690-a2bf-24978a59ac95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:04.981766 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654ae42e-2f16-4690-a2bf-24978a59ac95 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:04.982045 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654ae42e-2f16-4690-a2bf-24978a59ac95 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:04.982315 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654ae42e-2f16-4690-a2bf-24978a59ac95 None admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:04.983216 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654ae42e-2f16-4690-a2bf-24978a59ac95 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:25:04.983520 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654ae42e-2f16-4690-a2bf-24978a59ac95 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:04.985914 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654ae42e-2f16-4690-a2bf-24978a59ac95 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:04.996366 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 183/366] 10.222.0.102 () {56 vars in 1116 bytes} [Mon Aug 1 15:25:04 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:04.998050 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654ae42e-2f16-4690-a2bf-24978a59ac95 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:05.056579 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:05.091391 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2557ecaf-dfa6-46a6-a755-4edd09298baa None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:05.141887 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525a0751-9c98-47b7-85a5-c671e64b0e3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:05.142088 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525a0751-9c98-47b7-85a5-c671e64b0e3c None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:05.142354 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525a0751-9c98-47b7-85a5-c671e64b0e3c None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:05.142789 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525a0751-9c98-47b7-85a5-c671e64b0e3c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:05.143581 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525a0751-9c98-47b7-85a5-c671e64b0e3c None admin] RBAC: Adding query filter params (group.id=d18530a57eae416c8bab748ea01a7cff, role.id=5acf9fe30ec74532a49ebed755ea61e4, scope.project.id=dfcf3ac155ec4ab1b51e9b6849baec64) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:25:05.145162 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525a0751-9c98-47b7-85a5-c671e64b0e3c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:05.146623 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525a0751-9c98-47b7-85a5-c671e64b0e3c None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:05.153398 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 184/367] 10.222.0.102 () {56 vars in 1381 bytes} [Mon Aug 1 15:25:04 2022] GET /identity/v3/role_assignments?group.id=d18530a57eae416c8bab748ea01a7cff&scope.project.id=dfcf3ac155ec4ab1b51e9b6849baec64&role.id=5acf9fe30ec74532a49ebed755ea61e4 => generated 261 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:05.154235 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525a0751-9c98-47b7-85a5-c671e64b0e3c None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:05.155665 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654ae42e-2f16-4690-a2bf-24978a59ac95 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:05.220800 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1621442b-55fd-4cf2-92af-e4cc59a392fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:05.221468 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1621442b-55fd-4cf2-92af-e4cc59a392fc None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:05.221752 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1621442b-55fd-4cf2-92af-e4cc59a392fc None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:05.222026 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1621442b-55fd-4cf2-92af-e4cc59a392fc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:05.237139 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1621442b-55fd-4cf2-92af-e4cc59a392fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:25:05.247458 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-1621442b-55fd-4cf2-92af-e4cc59a392fc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 15:25:05.247458 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:25:05.247458 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:25:05.247458 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:25:05.247458 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:25:05.247458 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:25:05.247458 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:25:05.247458 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:25:05.247458 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:25:05.247458 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:25:05.247458 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:25:05.247458 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:25:05.247458 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:25:05.247458 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:25:05.247458 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:25:05.247458 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:25:05.248411 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:25:05.248411 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:25:05.248411 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:25:05.248411 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:25:05.248411 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:25:05.248411 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:25:05.248411 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:25:05.248411 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:25:05.248411 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:25:05.248411 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:25:05.248411 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:25:05.248411 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 01 15:25:05.248411 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:25:05.248411 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:25:05.248411 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:25:05.248411 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:25:05.249280 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:25:05.249280 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:25:05.249280 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:25:05.249280 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:25:05.249280 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:25:05.249280 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:25:05.249280 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:25:05.249280 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:25:05.249280 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:25:05.249280 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:25:05.249280 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 15:25:05.249280 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 01 15:25:05.249280 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 184/368] 10.222.0.102 () {56 vars in 1101 bytes} [Mon Aug 1 15:25:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:25:05.250441 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1621442b-55fd-4cf2-92af-e4cc59a392fc None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:05.266220 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:05.304827 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525a0751-9c98-47b7-85a5-c671e64b0e3c None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:05.366899 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fcd3f0-3f34-4ac2-9d87-b30e41c50cf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:05.368598 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fcd3f0-3f34-4ac2-9d87-b30e41c50cf6 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:05.369091 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fcd3f0-3f34-4ac2-9d87-b30e41c50cf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:05.369491 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fcd3f0-3f34-4ac2-9d87-b30e41c50cf6 None admin] PATH_INFO: `/v3/projects/5db9d563233a43d8b5d7983c087936d2` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:05.372286 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fcd3f0-3f34-4ac2-9d87-b30e41c50cf6 None admin] RBAC: Authorizing `identity:get_project(project_id=5db9d563233a43d8b5d7983c087936d2)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:05.374934 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fcd3f0-3f34-4ac2-9d87-b30e41c50cf6 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:05.378267 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 185/369] 10.222.0.102 () {56 vars in 1191 bytes} [Mon Aug 1 15:25:05 2022] GET /identity/v3/projects/5db9d563233a43d8b5d7983c087936d2 => generated 303 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:05.379648 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fcd3f0-3f34-4ac2-9d87-b30e41c50cf6 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:05.383370 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1621442b-55fd-4cf2-92af-e4cc59a392fc None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:05.399867 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:05.431481 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f843224-487d-41c3-bedf-36a427ef89b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:05.432568 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f843224-487d-41c3-bedf-36a427ef89b3 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:05.432919 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f843224-487d-41c3-bedf-36a427ef89b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:05.433199 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f843224-487d-41c3-bedf-36a427ef89b3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:05.515710 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fcd3f0-3f34-4ac2-9d87-b30e41c50cf6 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:05.526011 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f843224-487d-41c3-bedf-36a427ef89b3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:05.527546 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f843224-487d-41c3-bedf-36a427ef89b3 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:05.541565 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:05.564273 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d050ff8f-f08e-4491-8b29-3050f61951a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:05.565461 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d050ff8f-f08e-4491-8b29-3050f61951a8 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:05.565876 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d050ff8f-f08e-4491-8b29-3050f61951a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:05.566152 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d050ff8f-f08e-4491-8b29-3050f61951a8 None admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:05.567022 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d050ff8f-f08e-4491-8b29-3050f61951a8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:25:05.567331 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d050ff8f-f08e-4491-8b29-3050f61951a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:05.569307 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d050ff8f-f08e-4491-8b29-3050f61951a8 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:05.588990 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 186/370] 10.222.0.102 () {56 vars in 1104 bytes} [Mon Aug 1 15:25:05 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:05.589910 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d050ff8f-f08e-4491-8b29-3050f61951a8 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:05.651701 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 185/371] 10.222.0.102 () {58 vars in 1287 bytes} [Mon Aug 1 15:25:05 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 15:25:05.653011 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f843224-487d-41c3-bedf-36a427ef89b3 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:05.682518 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:05.713422 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d050ff8f-f08e-4491-8b29-3050f61951a8 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:05.749306 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580e1f50-3669-45b0-a8f4-85c97535273a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:05.749952 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580e1f50-3669-45b0-a8f4-85c97535273a None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:05.750230 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580e1f50-3669-45b0-a8f4-85c97535273a None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:05.751248 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580e1f50-3669-45b0-a8f4-85c97535273a None admin] PATH_INFO: `/v3/groups/d18530a57eae416c8bab748ea01a7cff` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:05.753881 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580e1f50-3669-45b0-a8f4-85c97535273a None admin] RBAC: Authorizing `identity:get_group(group_id=d18530a57eae416c8bab748ea01a7cff)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:05.754875 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580e1f50-3669-45b0-a8f4-85c97535273a None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:05.756713 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 187/372] 10.222.0.102 () {56 vars in 1185 bytes} [Mon Aug 1 15:25:05 2022] GET /identity/v3/groups/d18530a57eae416c8bab748ea01a7cff => generated 227 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:05.757534 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580e1f50-3669-45b0-a8f4-85c97535273a None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:05.763690 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f843224-487d-41c3-bedf-36a427ef89b3 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:05.787314 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:05.801322 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20da8f81-5c63-4765-82f6-1f4c1c6aa7cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:05.802261 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20da8f81-5c63-4765-82f6-1f4c1c6aa7cf None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:05.802768 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20da8f81-5c63-4765-82f6-1f4c1c6aa7cf None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:05.803200 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20da8f81-5c63-4765-82f6-1f4c1c6aa7cf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:05.894834 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580e1f50-3669-45b0-a8f4-85c97535273a None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:05.908121 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20da8f81-5c63-4765-82f6-1f4c1c6aa7cf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:05.910071 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20da8f81-5c63-4765-82f6-1f4c1c6aa7cf None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:05.947327 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113ece25-d176-4f2a-9391-2bceaf8d74c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:05.948642 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113ece25-d176-4f2a-9391-2bceaf8d74c8 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:05.949361 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113ece25-d176-4f2a-9391-2bceaf8d74c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:05.949795 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113ece25-d176-4f2a-9391-2bceaf8d74c8 None admin] PATH_INFO: `/v3/projects/5db9d563233a43d8b5d7983c087936d2` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:05.951797 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113ece25-d176-4f2a-9391-2bceaf8d74c8 None admin] RBAC: Authorizing `identity:get_project(project_id=5db9d563233a43d8b5d7983c087936d2)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:05.953790 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113ece25-d176-4f2a-9391-2bceaf8d74c8 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:05.957392 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 188/373] 10.222.0.102 () {56 vars in 1191 bytes} [Mon Aug 1 15:25:05 2022] GET /identity/v3/projects/5db9d563233a43d8b5d7983c087936d2 => generated 303 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:05.958406 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113ece25-d176-4f2a-9391-2bceaf8d74c8 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:05.973430 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:06.055553 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 186/374] 10.222.0.102 () {58 vars in 1287 bytes} [Mon Aug 1 15:25:05 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 15:25:06.055553 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20da8f81-5c63-4765-82f6-1f4c1c6aa7cf None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:06.070099 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:06.106890 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113ece25-d176-4f2a-9391-2bceaf8d74c8 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:06.151848 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c938e6e3-e8a7-4165-863b-195d72f86840 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:06.152476 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c938e6e3-e8a7-4165-863b-195d72f86840 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:06.152756 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c938e6e3-e8a7-4165-863b-195d72f86840 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:06.153060 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c938e6e3-e8a7-4165-863b-195d72f86840 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:06.153836 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c938e6e3-e8a7-4165-863b-195d72f86840 None admin] RBAC: Adding query filter params (group.id=d18530a57eae416c8bab748ea01a7cff, role.id=27f5093ac0674d799cdbd17c68482e32, scope.project.id=5db9d563233a43d8b5d7983c087936d2) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:25:06.154144 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c938e6e3-e8a7-4165-863b-195d72f86840 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:06.155584 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c938e6e3-e8a7-4165-863b-195d72f86840 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:06.161814 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 189/375] 10.222.0.102 () {56 vars in 1381 bytes} [Mon Aug 1 15:25:05 2022] GET /identity/v3/role_assignments?group.id=d18530a57eae416c8bab748ea01a7cff&scope.project.id=5db9d563233a43d8b5d7983c087936d2&role.id=27f5093ac0674d799cdbd17c68482e32 => generated 261 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:06.162634 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c938e6e3-e8a7-4165-863b-195d72f86840 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:06.195239 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20da8f81-5c63-4765-82f6-1f4c1c6aa7cf None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:06.234956 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bd5726-3b58-453e-a7e7-74d57f501922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:06.236024 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bd5726-3b58-453e-a7e7-74d57f501922 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:06.236511 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bd5726-3b58-453e-a7e7-74d57f501922 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:06.237026 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bd5726-3b58-453e-a7e7-74d57f501922 None admin] PATH_INFO: `/v3/groups/d18530a57eae416c8bab748ea01a7cff` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:06.238538 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bd5726-3b58-453e-a7e7-74d57f501922 None admin] RBAC: Authorizing `identity:get_group(group_id=d18530a57eae416c8bab748ea01a7cff)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:06.240346 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bd5726-3b58-453e-a7e7-74d57f501922 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:06.244299 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 187/376] 10.222.0.102 () {56 vars in 1185 bytes} [Mon Aug 1 15:25:06 2022] GET /identity/v3/groups/d18530a57eae416c8bab748ea01a7cff => generated 227 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:06.246094 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8f53cf-23ea-4bb7-bfd7-4e935ab97b06 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:06.246593 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8f53cf-23ea-4bb7-bfd7-4e935ab97b06 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:06.247085 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8f53cf-23ea-4bb7-bfd7-4e935ab97b06 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:06.248654 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 188/377] 10.222.0.102 () {54 vars in 931 bytes} [Mon Aug 1 15:25:06 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 15:25:06.252305 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:06.265356 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cfe0b4-4461-43a2-ad95-0ca5e53fbc62 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:06.265953 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cfe0b4-4461-43a2-ad95-0ca5e53fbc62 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:06.266384 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cfe0b4-4461-43a2-ad95-0ca5e53fbc62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:06.288760 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-78cfe0b4-4461-43a2-ad95-0ca5e53fbc62 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:25:06.290550 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c938e6e3-e8a7-4165-863b-195d72f86840 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:06.291405 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-78cfe0b4-4461-43a2-ad95-0ca5e53fbc62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:25:06.329603 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbaab09-570a-46e4-8727-85bed43fad53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:06.330278 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbaab09-570a-46e4-8727-85bed43fad53 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:06.330627 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbaab09-570a-46e4-8727-85bed43fad53 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:06.330968 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbaab09-570a-46e4-8727-85bed43fad53 None admin] PATH_INFO: `/v3/projects/fba62fb532fd40bd9b79f542e01e21d7` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:06.332232 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbaab09-570a-46e4-8727-85bed43fad53 None admin] RBAC: Authorizing `identity:get_project(project_id=fba62fb532fd40bd9b79f542e01e21d7)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:06.333850 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbaab09-570a-46e4-8727-85bed43fad53 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:06.339924 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 190/378] 10.222.0.102 () {56 vars in 1191 bytes} [Mon Aug 1 15:25:06 2022] GET /identity/v3/projects/fba62fb532fd40bd9b79f542e01e21d7 => generated 345 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:06.339924 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbaab09-570a-46e4-8727-85bed43fad53 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:06.376000 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 189/379] 10.222.0.102 () {58 vars in 1028 bytes} [Mon Aug 1 15:25:06 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 15:25:06.377352 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cfe0b4-4461-43a2-ad95-0ca5e53fbc62 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:06.407382 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:06.475090 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbaab09-570a-46e4-8727-85bed43fad53 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:06.518089 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c707c3d4-da96-4835-bff6-bc8e2cda7dfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:06.518711 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c707c3d4-da96-4835-bff6-bc8e2cda7dfb None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:06.518990 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c707c3d4-da96-4835-bff6-bc8e2cda7dfb None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:06.519262 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c707c3d4-da96-4835-bff6-bc8e2cda7dfb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:06.520056 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c707c3d4-da96-4835-bff6-bc8e2cda7dfb None admin] RBAC: Adding query filter params (group.id=d18530a57eae416c8bab748ea01a7cff, role.id=5acf9fe30ec74532a49ebed755ea61e4, scope.project.id=5db9d563233a43d8b5d7983c087936d2) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:25:06.520362 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c707c3d4-da96-4835-bff6-bc8e2cda7dfb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:06.521845 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c707c3d4-da96-4835-bff6-bc8e2cda7dfb None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:06.523006 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cfe0b4-4461-43a2-ad95-0ca5e53fbc62 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:06.528362 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 191/380] 10.222.0.102 () {56 vars in 1381 bytes} [Mon Aug 1 15:25:06 2022] GET /identity/v3/role_assignments?group.id=d18530a57eae416c8bab748ea01a7cff&scope.project.id=5db9d563233a43d8b5d7983c087936d2&role.id=5acf9fe30ec74532a49ebed755ea61e4 => generated 261 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:06.530469 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c707c3d4-da96-4835-bff6-bc8e2cda7dfb None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:06.534385 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:06.564643 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79aeadd2-9678-43bc-a247-577cea21ae45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:06.565757 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79aeadd2-9678-43bc-a247-577cea21ae45 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:06.566238 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79aeadd2-9678-43bc-a247-577cea21ae45 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:06.566807 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79aeadd2-9678-43bc-a247-577cea21ae45 None admin] PATH_INFO: `/v3/groups/68018f8f361f47768eefda30799e7f90` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:06.575776 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79aeadd2-9678-43bc-a247-577cea21ae45 None admin] RBAC: Authorizing `identity:get_group(group_id=68018f8f361f47768eefda30799e7f90)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:06.577945 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79aeadd2-9678-43bc-a247-577cea21ae45 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:06.580103 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 190/381] 10.222.0.102 () {56 vars in 1185 bytes} [Mon Aug 1 15:25:06 2022] GET /identity/v3/groups/68018f8f361f47768eefda30799e7f90 => generated 230 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:06.590181 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79aeadd2-9678-43bc-a247-577cea21ae45 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:06.682636 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c707c3d4-da96-4835-bff6-bc8e2cda7dfb None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:06.743826 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1425a3-0b01-46d1-a235-e397e7f93c14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:06.744491 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1425a3-0b01-46d1-a235-e397e7f93c14 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:06.744769 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1425a3-0b01-46d1-a235-e397e7f93c14 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:06.745062 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1425a3-0b01-46d1-a235-e397e7f93c14 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:06.753917 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:06.771588 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1425a3-0b01-46d1-a235-e397e7f93c14 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:25:06.777166 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-1b1425a3-0b01-46d1-a235-e397e7f93c14 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 01 15:25:06.777166 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:25:06.777166 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:25:06.777166 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:25:06.777166 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:25:06.777166 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:25:06.777166 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:25:06.777166 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:25:06.777166 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:25:06.777166 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:25:06.777166 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:25:06.777166 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:25:06.777166 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:25:06.777166 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:25:06.777166 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:25:06.777166 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:25:06.778041 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:25:06.778041 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:25:06.778041 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:25:06.778041 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:25:06.778041 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:25:06.778041 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:25:06.778041 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:25:06.778041 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:25:06.778041 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:25:06.778041 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:25:06.778041 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:25:06.778041 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 01 15:25:06.778041 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:25:06.778041 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:25:06.778041 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:25:06.778041 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:25:06.778847 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:25:06.778847 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:25:06.778847 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:25:06.778847 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:25:06.778847 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:25:06.778847 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:25:06.778847 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:25:06.778847 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:25:06.778847 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:25:06.778847 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:25:06.778847 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 01 15:25:06.778847 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 01 15:25:06.779513 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 192/382] 10.222.0.102 () {56 vars in 1104 bytes} [Mon Aug 1 15:25:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:25:06.785812 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1425a3-0b01-46d1-a235-e397e7f93c14 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:06.807833 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79aeadd2-9678-43bc-a247-577cea21ae45 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:06.849331 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a9400a-c0f8-4493-addc-b29c2bb856bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:06.850302 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a9400a-c0f8-4493-addc-b29c2bb856bf None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:06.850785 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a9400a-c0f8-4493-addc-b29c2bb856bf None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:06.851316 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a9400a-c0f8-4493-addc-b29c2bb856bf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:06.852888 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a9400a-c0f8-4493-addc-b29c2bb856bf None admin] RBAC: Adding query filter params (group.id=68018f8f361f47768eefda30799e7f90, role.id=de1374f966c04c27b579515b54334fd2, scope.project.id=fba62fb532fd40bd9b79f542e01e21d7) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:25:06.853442 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a9400a-c0f8-4493-addc-b29c2bb856bf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:06.855091 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a9400a-c0f8-4493-addc-b29c2bb856bf None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:06.870325 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 191/383] 10.222.0.102 () {56 vars in 1381 bytes} [Mon Aug 1 15:25:06 2022] GET /identity/v3/role_assignments?group.id=68018f8f361f47768eefda30799e7f90&scope.project.id=fba62fb532fd40bd9b79f542e01e21d7&role.id=de1374f966c04c27b579515b54334fd2 => generated 261 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:06.874691 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:06.924782 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1425a3-0b01-46d1-a235-e397e7f93c14 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:06.976811 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c01a81b-1db7-436f-a3e3-b240833c446e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:06.977509 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c01a81b-1db7-436f-a3e3-b240833c446e None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:06.977791 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c01a81b-1db7-436f-a3e3-b240833c446e None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:06.978064 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c01a81b-1db7-436f-a3e3-b240833c446e None admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:06.978807 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c01a81b-1db7-436f-a3e3-b240833c446e None admin] RBAC: Adding query filter params (name=member) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:25:06.979110 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c01a81b-1db7-436f-a3e3-b240833c446e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:06.980518 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c01a81b-1db7-436f-a3e3-b240833c446e None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:06.993502 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 193/384] 10.222.0.102 () {56 vars in 1106 bytes} [Mon Aug 1 15:25:06 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:06.999879 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a9400a-c0f8-4493-addc-b29c2bb856bf None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:07.138160 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a9400a-c0f8-4493-addc-b29c2bb856bf None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:07.173388 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b86b51-8e54-4e00-bd70-a3f23ed6d4fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:07.174279 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b86b51-8e54-4e00-bd70-a3f23ed6d4fd None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:07.174702 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b86b51-8e54-4e00-bd70-a3f23ed6d4fd None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:07.175115 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b86b51-8e54-4e00-bd70-a3f23ed6d4fd None admin] PATH_INFO: `/v3/groups/d18530a57eae416c8bab748ea01a7cff` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:07.176457 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b86b51-8e54-4e00-bd70-a3f23ed6d4fd None admin] RBAC: Authorizing `identity:get_group(group_id=d18530a57eae416c8bab748ea01a7cff)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:07.178092 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b86b51-8e54-4e00-bd70-a3f23ed6d4fd None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:07.184907 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 192/385] 10.222.0.102 () {56 vars in 1185 bytes} [Mon Aug 1 15:25:06 2022] GET /identity/v3/groups/d18530a57eae416c8bab748ea01a7cff => generated 227 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:07.186119 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c01a81b-1db7-436f-a3e3-b240833c446e None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:07.294666 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c01a81b-1db7-436f-a3e3-b240833c446e None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:07.322865 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:07.332212 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943aa29f-e979-4d69-9fec-26b76ea836ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:07.333129 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943aa29f-e979-4d69-9fec-26b76ea836ff None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:07.333633 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943aa29f-e979-4d69-9fec-26b76ea836ff None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:07.334080 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943aa29f-e979-4d69-9fec-26b76ea836ff None admin] PATH_INFO: `/v3/projects/dfcf3ac155ec4ab1b51e9b6849baec64` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:07.335478 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943aa29f-e979-4d69-9fec-26b76ea836ff None admin] RBAC: Authorizing `identity:get_project(project_id=dfcf3ac155ec4ab1b51e9b6849baec64)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:07.337165 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943aa29f-e979-4d69-9fec-26b76ea836ff None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:07.339430 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 194/386] 10.222.0.102 () {56 vars in 1191 bytes} [Mon Aug 1 15:25:07 2022] GET /identity/v3/projects/dfcf3ac155ec4ab1b51e9b6849baec64 => generated 299 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:07.345288 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b86b51-8e54-4e00-bd70-a3f23ed6d4fd None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:07.349413 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:07.456965 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b86b51-8e54-4e00-bd70-a3f23ed6d4fd None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:07.495456 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b26736-3822-4997-ae30-b5ead940e469 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:07.496138 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b26736-3822-4997-ae30-b5ead940e469 None admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:07.496417 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b26736-3822-4997-ae30-b5ead940e469 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:07.496693 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b26736-3822-4997-ae30-b5ead940e469 None admin] PATH_INFO: `/v3/projects/dfcf3ac155ec4ab1b51e9b6849baec64/groups/d18530a57eae416c8bab748ea01a7cff/roles/27f5093ac0674d799cdbd17c68482e32` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:07.498736 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b26736-3822-4997-ae30-b5ead940e469 None admin] RBAC: Authorizing `identity:create_grant(project_id=dfcf3ac155ec4ab1b51e9b6849baec64, group_id=d18530a57eae416c8bab748ea01a7cff, role_id=27f5093ac0674d799cdbd17c68482e32)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:07.500199 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b26736-3822-4997-ae30-b5ead940e469 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:07.612611 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 193/387] 10.222.0.102 () {58 vars in 1447 bytes} [Mon Aug 1 15:25:07 2022] PUT /identity/v3/projects/dfcf3ac155ec4ab1b51e9b6849baec64/groups/d18530a57eae416c8bab748ea01a7cff/roles/27f5093ac0674d799cdbd17c68482e32 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:25:07.625975 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b170a38-be32-43ce-b508-74f2b912fd1e None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:07.626317 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b170a38-be32-43ce-b508-74f2b912fd1e None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:07.626531 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b170a38-be32-43ce-b508-74f2b912fd1e None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:07.628324 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 195/388] 10.222.0.102 () {54 vars in 931 bytes} [Mon Aug 1 15:25:07 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 15:25:07.634568 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dfae18-18c0-4f42-bd0b-34f48faa36c0 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:07.634856 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dfae18-18c0-4f42-bd0b-34f48faa36c0 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:07.635133 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dfae18-18c0-4f42-bd0b-34f48faa36c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:07.655521 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-72dfae18-18c0-4f42-bd0b-34f48faa36c0 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:25:07.656743 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-72dfae18-18c0-4f42-bd0b-34f48faa36c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:25:07.720573 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:07.732781 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 194/389] 10.222.0.102 () {58 vars in 1028 bytes} [Mon Aug 1 15:25:07 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 15:25:07.751886 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b170a38-be32-43ce-b508-74f2b912fd1e None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:07.896956 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b170a38-be32-43ce-b508-74f2b912fd1e None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:07.932987 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2c93ca-67c2-4639-aab1-486ff5737bfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:07.933737 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2c93ca-67c2-4639-aab1-486ff5737bfe None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:07.934033 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2c93ca-67c2-4639-aab1-486ff5737bfe None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:07.934299 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2c93ca-67c2-4639-aab1-486ff5737bfe None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:07.946771 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2c93ca-67c2-4639-aab1-486ff5737bfe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:25:07.952676 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-fd2c93ca-67c2-4639-aab1-486ff5737bfe None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 01 15:25:07.952676 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:25:07.952676 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:25:07.952676 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:25:07.952676 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:25:07.952676 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:25:07.952676 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:25:07.952676 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:25:07.952676 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:25:07.952676 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:25:07.952676 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:25:07.952676 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:25:07.952676 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:25:07.952676 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:25:07.952676 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:25:07.952676 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:25:07.953681 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:25:07.953681 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:25:07.953681 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:25:07.953681 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:25:07.953681 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:25:07.953681 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:25:07.953681 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:25:07.953681 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:25:07.953681 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:25:07.953681 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:25:07.953681 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:25:07.953681 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 01 15:25:07.953681 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:25:07.953681 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:25:07.953681 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:25:07.953681 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:25:07.954934 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:25:07.954934 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:25:07.954934 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:25:07.954934 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:25:07.954934 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:25:07.954934 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:25:07.954934 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:25:07.954934 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:25:07.954934 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:25:07.954934 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:25:07.954934 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 01 15:25:07.954934 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 01 15:25:07.954934 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 196/390] 10.222.0.102 () {56 vars in 1119 bytes} [Mon Aug 1 15:25:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:25:07.961993 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72dfae18-18c0-4f42-bd0b-34f48faa36c0 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:08.095486 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72dfae18-18c0-4f42-bd0b-34f48faa36c0 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:08.140320 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179e64ad-81f0-487f-906b-6764afedf9f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:08.140983 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179e64ad-81f0-487f-906b-6764afedf9f5 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:08.141265 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179e64ad-81f0-487f-906b-6764afedf9f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:08.141538 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179e64ad-81f0-487f-906b-6764afedf9f5 None admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:08.142269 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179e64ad-81f0-487f-906b-6764afedf9f5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:25:08.142573 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179e64ad-81f0-487f-906b-6764afedf9f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:08.143964 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179e64ad-81f0-487f-906b-6764afedf9f5 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:08.153329 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 195/391] 10.222.0.102 () {56 vars in 1116 bytes} [Mon Aug 1 15:25:07 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:08.158925 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2c93ca-67c2-4639-aab1-486ff5737bfe None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:08.237583 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:08.297821 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2c93ca-67c2-4639-aab1-486ff5737bfe None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:08.334067 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86164cbe-74ec-4f21-8594-844f5c3274a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:08.334705 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86164cbe-74ec-4f21-8594-844f5c3274a7 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:08.334985 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86164cbe-74ec-4f21-8594-844f5c3274a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:08.335258 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86164cbe-74ec-4f21-8594-844f5c3274a7 None admin] PATH_INFO: `/v3/groups/d18530a57eae416c8bab748ea01a7cff` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:08.336982 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86164cbe-74ec-4f21-8594-844f5c3274a7 None admin] RBAC: Authorizing `identity:get_group(group_id=d18530a57eae416c8bab748ea01a7cff)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:08.338491 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86164cbe-74ec-4f21-8594-844f5c3274a7 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:08.344647 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 197/392] 10.222.0.102 () {56 vars in 1185 bytes} [Mon Aug 1 15:25:08 2022] GET /identity/v3/groups/d18530a57eae416c8bab748ea01a7cff => generated 227 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:08.346074 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179e64ad-81f0-487f-906b-6764afedf9f5 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:08.403161 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:08.468522 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179e64ad-81f0-487f-906b-6764afedf9f5 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:08.512492 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61cce94-916f-4d1f-8ad7-3ccca5d4fb7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:08.513450 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61cce94-916f-4d1f-8ad7-3ccca5d4fb7c None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:08.513976 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61cce94-916f-4d1f-8ad7-3ccca5d4fb7c None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:08.514473 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61cce94-916f-4d1f-8ad7-3ccca5d4fb7c None admin] PATH_INFO: `/v3/projects/dfcf3ac155ec4ab1b51e9b6849baec64` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:08.521531 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61cce94-916f-4d1f-8ad7-3ccca5d4fb7c None admin] RBAC: Authorizing `identity:get_project(project_id=dfcf3ac155ec4ab1b51e9b6849baec64)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:08.523214 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61cce94-916f-4d1f-8ad7-3ccca5d4fb7c None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:08.525723 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 196/393] 10.222.0.102 () {56 vars in 1191 bytes} [Mon Aug 1 15:25:08 2022] GET /identity/v3/projects/dfcf3ac155ec4ab1b51e9b6849baec64 => generated 299 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:08.531831 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86164cbe-74ec-4f21-8594-844f5c3274a7 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:08.664163 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86164cbe-74ec-4f21-8594-844f5c3274a7 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:08.689926 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:08.702939 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1b355f-8925-4e54-8fe6-82cb56aa1090 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:08.703618 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1b355f-8925-4e54-8fe6-82cb56aa1090 None admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:08.703897 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1b355f-8925-4e54-8fe6-82cb56aa1090 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:08.704171 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1b355f-8925-4e54-8fe6-82cb56aa1090 None admin] PATH_INFO: `/v3/projects/dfcf3ac155ec4ab1b51e9b6849baec64/groups/d18530a57eae416c8bab748ea01a7cff/roles/5acf9fe30ec74532a49ebed755ea61e4` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:08.706446 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1b355f-8925-4e54-8fe6-82cb56aa1090 None admin] RBAC: Authorizing `identity:create_grant(project_id=dfcf3ac155ec4ab1b51e9b6849baec64, group_id=d18530a57eae416c8bab748ea01a7cff, role_id=5acf9fe30ec74532a49ebed755ea61e4)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:08.707904 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1b355f-8925-4e54-8fe6-82cb56aa1090 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:08.801373 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 198/394] 10.222.0.102 () {58 vars in 1447 bytes} [Mon Aug 1 15:25:08 2022] PUT /identity/v3/projects/dfcf3ac155ec4ab1b51e9b6849baec64/groups/d18530a57eae416c8bab748ea01a7cff/roles/5acf9fe30ec74532a49ebed755ea61e4 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:25:08.932511 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6715949c-f55d-4aad-96c9-5b302c0ae4bc None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:08.933151 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6715949c-f55d-4aad-96c9-5b302c0ae4bc None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:08.933622 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6715949c-f55d-4aad-96c9-5b302c0ae4bc None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:08.935593 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 197/395] 10.222.0.102 () {54 vars in 931 bytes} [Mon Aug 1 15:25:08 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 15:25:08.940938 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dfbb77-713e-4bde-ae8d-621d95eae671 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:08.941190 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dfbb77-713e-4bde-ae8d-621d95eae671 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:08.941461 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dfbb77-713e-4bde-ae8d-621d95eae671 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:08.970604 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-f6dfbb77-713e-4bde-ae8d-621d95eae671 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:25:08.971929 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-f6dfbb77-713e-4bde-ae8d-621d95eae671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:25:09.058499 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 199/396] 10.222.0.102 () {58 vars in 1028 bytes} [Mon Aug 1 15:25:08 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 15:25:09.081258 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6715949c-f55d-4aad-96c9-5b302c0ae4bc None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:09.161376 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9769a5-097e-4ae3-ae9b-426714f3049c None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:09.161671 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9769a5-097e-4ae3-ae9b-426714f3049c None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:09.161927 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9769a5-097e-4ae3-ae9b-426714f3049c None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:09.163579 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 200/397] 10.222.0.102 () {54 vars in 931 bytes} [Mon Aug 1 15:25:09 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 01 15:25:09.171425 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0a6853-a535-494b-9464-fcad7366a479 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:09.171425 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0a6853-a535-494b-9464-fcad7366a479 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:09.171425 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0a6853-a535-494b-9464-fcad7366a479 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:09.189109 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-7d0a6853-a535-494b-9464-fcad7366a479 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:25:09.190302 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-7d0a6853-a535-494b-9464-fcad7366a479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:25:09.216710 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6715949c-f55d-4aad-96c9-5b302c0ae4bc None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:09.246880 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:09.260481 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b80a28-4990-47d2-b628-7e0e2fb9f434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:09.261513 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b80a28-4990-47d2-b628-7e0e2fb9f434 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:09.262014 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b80a28-4990-47d2-b628-7e0e2fb9f434 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:09.262531 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b80a28-4990-47d2-b628-7e0e2fb9f434 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:09.264054 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 201/398] 10.222.0.102 () {58 vars in 1028 bytes} [Mon Aug 1 15:25:09 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 01 15:25:09.275782 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b80a28-4990-47d2-b628-7e0e2fb9f434 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:25:09.282281 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-37b80a28-4990-47d2-b628-7e0e2fb9f434 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 01 15:25:09.282281 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:25:09.282281 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:25:09.282281 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:25:09.282281 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:25:09.282281 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:25:09.282281 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:25:09.282281 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:25:09.282281 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:25:09.282281 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:25:09.282281 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:25:09.282281 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:25:09.282281 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:25:09.282281 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:25:09.282281 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:25:09.282281 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:25:09.284281 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:25:09.284281 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:25:09.284281 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:25:09.284281 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:25:09.284281 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:25:09.284281 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:25:09.284281 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:25:09.284281 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:25:09.284281 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:25:09.284281 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:25:09.284281 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:25:09.284281 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 01 15:25:09.284281 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:25:09.284281 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:25:09.284281 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:25:09.284281 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:25:09.285291 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:25:09.285291 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:25:09.285291 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:25:09.285291 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:25:09.285291 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:25:09.285291 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:25:09.285291 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:25:09.285291 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:25:09.285291 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:25:09.285291 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:25:09.285291 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 01 15:25:09.285291 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 01 15:25:09.286937 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 198/399] 10.222.0.102 () {56 vars in 1119 bytes} [Mon Aug 1 15:25:09 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:25:09.292775 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0a6853-a535-494b-9464-fcad7366a479 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:09.294170 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b80a28-4990-47d2-b628-7e0e2fb9f434 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:09.343670 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:09.400295 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0a6853-a535-494b-9464-fcad7366a479 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:09.436605 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00ea7ea-57dc-4f0e-a938-c1ecc18df487 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:09.437430 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00ea7ea-57dc-4f0e-a938-c1ecc18df487 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:09.437833 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00ea7ea-57dc-4f0e-a938-c1ecc18df487 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:09.438189 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00ea7ea-57dc-4f0e-a938-c1ecc18df487 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:09.450256 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00ea7ea-57dc-4f0e-a938-c1ecc18df487 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:25:09.455802 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-a00ea7ea-57dc-4f0e-a938-c1ecc18df487 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 01 15:25:09.455802 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:25:09.455802 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:25:09.455802 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:25:09.455802 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:25:09.455802 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:25:09.455802 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:25:09.455802 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:25:09.455802 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:25:09.455802 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:25:09.455802 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:25:09.455802 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:25:09.455802 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:25:09.455802 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:25:09.455802 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:25:09.455802 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:25:09.456929 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:25:09.456929 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:25:09.456929 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:25:09.456929 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:25:09.456929 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:25:09.456929 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:25:09.456929 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:25:09.456929 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:25:09.456929 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:25:09.456929 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:25:09.456929 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:25:09.456929 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 01 15:25:09.456929 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:25:09.456929 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:25:09.456929 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:25:09.456929 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:25:09.457946 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:25:09.457946 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:25:09.457946 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:25:09.457946 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:25:09.457946 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:25:09.457946 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:25:09.457946 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:25:09.457946 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:25:09.457946 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:25:09.457946 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:25:09.457946 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 01 15:25:09.457946 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 01 15:25:09.468904 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 202/400] 10.222.0.102 () {56 vars in 1104 bytes} [Mon Aug 1 15:25:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:25:09.468904 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00ea7ea-57dc-4f0e-a938-c1ecc18df487 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:09.478969 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b80a28-4990-47d2-b628-7e0e2fb9f434 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:09.549144 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5eb7166-c8e5-4875-b903-a1d65f067276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:09.550173 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5eb7166-c8e5-4875-b903-a1d65f067276 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:09.550681 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5eb7166-c8e5-4875-b903-a1d65f067276 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:09.551194 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5eb7166-c8e5-4875-b903-a1d65f067276 None admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:09.552094 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5eb7166-c8e5-4875-b903-a1d65f067276 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:25:09.552574 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5eb7166-c8e5-4875-b903-a1d65f067276 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:09.554322 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5eb7166-c8e5-4875-b903-a1d65f067276 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:09.572449 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 199/401] 10.222.0.102 () {56 vars in 1116 bytes} [Mon Aug 1 15:25:09 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:09.573631 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00ea7ea-57dc-4f0e-a938-c1ecc18df487 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:09.575357 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:09.578518 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5eb7166-c8e5-4875-b903-a1d65f067276 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:09.612121 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42de7540-0f6d-4466-8008-6ae51af8d6a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:09.612833 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42de7540-0f6d-4466-8008-6ae51af8d6a0 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:09.613224 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42de7540-0f6d-4466-8008-6ae51af8d6a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:09.613697 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42de7540-0f6d-4466-8008-6ae51af8d6a0 None admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:09.614485 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42de7540-0f6d-4466-8008-6ae51af8d6a0 None admin] RBAC: Adding query filter params (name=member) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:25:09.614889 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42de7540-0f6d-4466-8008-6ae51af8d6a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:09.616386 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42de7540-0f6d-4466-8008-6ae51af8d6a0 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:09.626863 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 203/402] 10.222.0.102 () {56 vars in 1106 bytes} [Mon Aug 1 15:25:09 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:25:09.632638 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42de7540-0f6d-4466-8008-6ae51af8d6a0 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:09.665155 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:09.744235 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42de7540-0f6d-4466-8008-6ae51af8d6a0 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:09.774279 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5eb7166-c8e5-4875-b903-a1d65f067276 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:09.795632 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08b349d-7749-402c-a814-b8af10fc40e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:09.796574 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08b349d-7749-402c-a814-b8af10fc40e6 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:09.797100 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08b349d-7749-402c-a814-b8af10fc40e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:09.797619 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08b349d-7749-402c-a814-b8af10fc40e6 None admin] PATH_INFO: `/v3/groups/d18530a57eae416c8bab748ea01a7cff` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:09.798986 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08b349d-7749-402c-a814-b8af10fc40e6 None admin] RBAC: Authorizing `identity:get_group(group_id=d18530a57eae416c8bab748ea01a7cff)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:09.800637 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08b349d-7749-402c-a814-b8af10fc40e6 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:09.807259 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 204/403] 10.222.0.102 () {56 vars in 1185 bytes} [Mon Aug 1 15:25:09 2022] GET /identity/v3/groups/d18530a57eae416c8bab748ea01a7cff => generated 227 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:25:09.809178 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08b349d-7749-402c-a814-b8af10fc40e6 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:09.832246 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bed75e-6b8c-44e3-a79b-3e13d816a50f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:09.832928 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bed75e-6b8c-44e3-a79b-3e13d816a50f None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:09.833212 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bed75e-6b8c-44e3-a79b-3e13d816a50f None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:09.833480 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bed75e-6b8c-44e3-a79b-3e13d816a50f None admin] PATH_INFO: `/v3/groups/d18530a57eae416c8bab748ea01a7cff` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:09.834623 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bed75e-6b8c-44e3-a79b-3e13d816a50f None admin] RBAC: Authorizing `identity:get_group(group_id=d18530a57eae416c8bab748ea01a7cff)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:09.836155 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bed75e-6b8c-44e3-a79b-3e13d816a50f None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:09.842615 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 200/404] 10.222.0.102 () {56 vars in 1185 bytes} [Mon Aug 1 15:25:09 2022] GET /identity/v3/groups/d18530a57eae416c8bab748ea01a7cff => generated 227 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:09.843860 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec24814-777b-475a-a20f-300d4006f32d None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:09.844169 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec24814-777b-475a-a20f-300d4006f32d None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:09.844444 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec24814-777b-475a-a20f-300d4006f32d None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:09.845786 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 201/405] 10.222.0.102 () {54 vars in 931 bytes} [Mon Aug 1 15:25:09 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 15:25:09.846286 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:09.846393 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec24814-777b-475a-a20f-300d4006f32d None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:09.935733 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08b349d-7749-402c-a814-b8af10fc40e6 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:09.968096 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec24814-777b-475a-a20f-300d4006f32d None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:09.972729 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4205a8c-d408-4d60-8caf-a9ffc40e2415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:09.973593 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4205a8c-d408-4d60-8caf-a9ffc40e2415 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:09.974040 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4205a8c-d408-4d60-8caf-a9ffc40e2415 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:09.974462 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4205a8c-d408-4d60-8caf-a9ffc40e2415 None admin] PATH_INFO: `/v3/projects/5db9d563233a43d8b5d7983c087936d2` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:09.975790 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4205a8c-d408-4d60-8caf-a9ffc40e2415 None admin] RBAC: Authorizing `identity:get_project(project_id=5db9d563233a43d8b5d7983c087936d2)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:09.978081 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4205a8c-d408-4d60-8caf-a9ffc40e2415 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:09.985176 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:09.985446 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 205/406] 10.222.0.102 () {56 vars in 1191 bytes} [Mon Aug 1 15:25:09 2022] GET /identity/v3/projects/5db9d563233a43d8b5d7983c087936d2 => generated 303 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:09.987609 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8de64c-ad77-4db8-9a86-ebcf171de9b9 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:09.988048 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8de64c-ad77-4db8-9a86-ebcf171de9b9 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:09.988473 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8de64c-ad77-4db8-9a86-ebcf171de9b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:10.011823 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89992dab-505b-498c-b0e1-707bb59a8599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:10.012820 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89992dab-505b-498c-b0e1-707bb59a8599 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:10.013279 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89992dab-505b-498c-b0e1-707bb59a8599 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:10.013746 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89992dab-505b-498c-b0e1-707bb59a8599 None admin] PATH_INFO: `/v3/projects/5db9d563233a43d8b5d7983c087936d2` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:10.013880 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-0c8de64c-ad77-4db8-9a86-ebcf171de9b9 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:25:10.015294 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-0c8de64c-ad77-4db8-9a86-ebcf171de9b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:25:10.015499 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89992dab-505b-498c-b0e1-707bb59a8599 None admin] RBAC: Authorizing `identity:get_project(project_id=5db9d563233a43d8b5d7983c087936d2)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:10.017225 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89992dab-505b-498c-b0e1-707bb59a8599 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:10.020149 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 202/407] 10.222.0.102 () {56 vars in 1191 bytes} [Mon Aug 1 15:25:09 2022] GET /identity/v3/projects/5db9d563233a43d8b5d7983c087936d2 => generated 303 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:10.021540 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89992dab-505b-498c-b0e1-707bb59a8599 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:10.109630 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 206/408] 10.222.0.102 () {58 vars in 1028 bytes} [Mon Aug 1 15:25:09 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 15:25:10.110779 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8de64c-ad77-4db8-9a86-ebcf171de9b9 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:10.141366 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:10.152624 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89992dab-505b-498c-b0e1-707bb59a8599 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:10.190330 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03bf14b-633a-46fc-9a5b-84891b6e059a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:10.191339 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03bf14b-633a-46fc-9a5b-84891b6e059a None admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:10.191675 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03bf14b-633a-46fc-9a5b-84891b6e059a None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:10.192021 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03bf14b-633a-46fc-9a5b-84891b6e059a None admin] PATH_INFO: `/v3/projects/5db9d563233a43d8b5d7983c087936d2/groups/d18530a57eae416c8bab748ea01a7cff/roles/27f5093ac0674d799cdbd17c68482e32` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:10.194174 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03bf14b-633a-46fc-9a5b-84891b6e059a None admin] RBAC: Authorizing `identity:create_grant(project_id=5db9d563233a43d8b5d7983c087936d2, group_id=d18530a57eae416c8bab748ea01a7cff, role_id=27f5093ac0674d799cdbd17c68482e32)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:10.195799 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03bf14b-633a-46fc-9a5b-84891b6e059a None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:10.217463 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8de64c-ad77-4db8-9a86-ebcf171de9b9 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:10.253829 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cbf3ba-0d6a-4061-8691-d5866a146969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:10.254491 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cbf3ba-0d6a-4061-8691-d5866a146969 None admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:10.254769 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cbf3ba-0d6a-4061-8691-d5866a146969 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:10.255041 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cbf3ba-0d6a-4061-8691-d5866a146969 None admin] PATH_INFO: `/v3/projects/5db9d563233a43d8b5d7983c087936d2/groups/d18530a57eae416c8bab748ea01a7cff/roles/5acf9fe30ec74532a49ebed755ea61e4` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:10.257279 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cbf3ba-0d6a-4061-8691-d5866a146969 None admin] RBAC: Authorizing `identity:create_grant(project_id=5db9d563233a43d8b5d7983c087936d2, group_id=d18530a57eae416c8bab748ea01a7cff, role_id=5acf9fe30ec74532a49ebed755ea61e4)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:10.258755 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cbf3ba-0d6a-4061-8691-d5866a146969 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:10.263795 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 203/409] 10.222.0.102 () {58 vars in 1447 bytes} [Mon Aug 1 15:25:10 2022] PUT /identity/v3/projects/5db9d563233a43d8b5d7983c087936d2/groups/d18530a57eae416c8bab748ea01a7cff/roles/27f5093ac0674d799cdbd17c68482e32 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:25:10.264569 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03bf14b-633a-46fc-9a5b-84891b6e059a None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:10.318300 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:10.327143 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 207/410] 10.222.0.102 () {58 vars in 1447 bytes} [Mon Aug 1 15:25:10 2022] PUT /identity/v3/projects/5db9d563233a43d8b5d7983c087936d2/groups/d18530a57eae416c8bab748ea01a7cff/roles/5acf9fe30ec74532a49ebed755ea61e4 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:25:10.331675 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df14c80a-3320-4c48-bb96-122c91830bcb None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:10.331675 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df14c80a-3320-4c48-bb96-122c91830bcb None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:10.331675 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df14c80a-3320-4c48-bb96-122c91830bcb None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:10.333068 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 208/411] 10.222.0.102 () {54 vars in 931 bytes} [Mon Aug 1 15:25:10 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 15:25:10.339371 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2b4584-ac9a-4f0d-9247-63a463adf846 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:10.339662 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2b4584-ac9a-4f0d-9247-63a463adf846 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:10.339927 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2b4584-ac9a-4f0d-9247-63a463adf846 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:10.376867 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-4b2b4584-ac9a-4f0d-9247-63a463adf846 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:25:10.378170 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-4b2b4584-ac9a-4f0d-9247-63a463adf846 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:25:10.456171 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03bf14b-633a-46fc-9a5b-84891b6e059a None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:10.485603 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 209/412] 10.222.0.102 () {58 vars in 1028 bytes} [Mon Aug 1 15:25:10 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 15:25:10.502368 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2d0df8-a806-4c2c-9f71-05c0bb6892fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:10.503127 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2d0df8-a806-4c2c-9f71-05c0bb6892fc None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:10.503411 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2d0df8-a806-4c2c-9f71-05c0bb6892fc None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:10.503745 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2d0df8-a806-4c2c-9f71-05c0bb6892fc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:10.513284 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2b4584-ac9a-4f0d-9247-63a463adf846 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:10.517817 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2d0df8-a806-4c2c-9f71-05c0bb6892fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:25:10.522928 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-8e2d0df8-a806-4c2c-9f71-05c0bb6892fc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 15:25:10.522928 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:25:10.522928 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:25:10.522928 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:25:10.522928 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:25:10.522928 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:25:10.522928 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:25:10.522928 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:25:10.522928 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:25:10.522928 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:25:10.522928 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:25:10.522928 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:25:10.522928 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:25:10.522928 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:25:10.522928 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:25:10.522928 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:25:10.524495 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:25:10.524495 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:25:10.524495 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:25:10.524495 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:25:10.524495 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:25:10.524495 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:25:10.524495 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:25:10.524495 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:25:10.524495 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:25:10.524495 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:25:10.524495 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:25:10.524495 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 01 15:25:10.524495 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:25:10.524495 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:25:10.524495 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:25:10.524495 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:25:10.525399 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:25:10.525399 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:25:10.525399 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:25:10.525399 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:25:10.525399 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:25:10.525399 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:25:10.525399 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:25:10.525399 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:25:10.525399 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:25:10.525399 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:25:10.525399 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 15:25:10.525399 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 01 15:25:10.525399 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 204/413] 10.222.0.102 () {56 vars in 1101 bytes} [Mon Aug 1 15:25:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:25:10.530584 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2d0df8-a806-4c2c-9f71-05c0bb6892fc None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:10.542519 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:10.659731 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2d0df8-a806-4c2c-9f71-05c0bb6892fc None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:10.662004 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:10.672710 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2b4584-ac9a-4f0d-9247-63a463adf846 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:10.710370 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f505fc4-4ac1-45bb-bc9c-d41d9b3e210a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:10.711088 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f505fc4-4ac1-45bb-bc9c-d41d9b3e210a None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:10.711376 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f505fc4-4ac1-45bb-bc9c-d41d9b3e210a None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:10.711651 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f505fc4-4ac1-45bb-bc9c-d41d9b3e210a None admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:10.712380 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f505fc4-4ac1-45bb-bc9c-d41d9b3e210a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:25:10.712689 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f505fc4-4ac1-45bb-bc9c-d41d9b3e210a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:10.716869 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f505fc4-4ac1-45bb-bc9c-d41d9b3e210a None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:10.731126 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 205/414] 10.222.0.102 () {56 vars in 1104 bytes} [Mon Aug 1 15:25:10 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:25:10.732321 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f505fc4-4ac1-45bb-bc9c-d41d9b3e210a None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:10.760261 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9145cc-afad-4856-ac85-9e40da115b96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:10.761384 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9145cc-afad-4856-ac85-9e40da115b96 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:10.761848 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9145cc-afad-4856-ac85-9e40da115b96 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:10.762313 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9145cc-afad-4856-ac85-9e40da115b96 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:10.787371 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9145cc-afad-4856-ac85-9e40da115b96 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:25:10.797454 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-de9145cc-afad-4856-ac85-9e40da115b96 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 01 15:25:10.797454 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:25:10.797454 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:25:10.797454 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:25:10.797454 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:25:10.797454 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:25:10.797454 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:25:10.797454 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:25:10.797454 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:25:10.797454 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:25:10.797454 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:25:10.797454 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:25:10.797454 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:25:10.797454 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:25:10.797454 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:25:10.797454 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:25:10.798380 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:25:10.798380 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:25:10.798380 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:25:10.798380 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:25:10.798380 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:25:10.798380 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:25:10.798380 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:25:10.798380 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:25:10.798380 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:25:10.798380 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:25:10.798380 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:25:10.798380 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 01 15:25:10.798380 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:25:10.798380 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:25:10.798380 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:25:10.798380 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:25:10.799150 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:25:10.799150 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:25:10.799150 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:25:10.799150 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:25:10.799150 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:25:10.799150 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:25:10.799150 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:25:10.799150 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:25:10.799150 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:25:10.799150 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:25:10.799150 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 01 15:25:10.799150 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 01 15:25:10.802577 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 210/415] 10.222.0.102 () {56 vars in 1104 bytes} [Mon Aug 1 15:25:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 15:25:10.806521 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9145cc-afad-4856-ac85-9e40da115b96 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:10.907400 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:10.911333 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f505fc4-4ac1-45bb-bc9c-d41d9b3e210a None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:10.928162 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9145cc-afad-4856-ac85-9e40da115b96 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:10.966827 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac94f04-dc96-4a2c-af51-c6fd43377767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:10.967490 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac94f04-dc96-4a2c-af51-c6fd43377767 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:10.967774 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac94f04-dc96-4a2c-af51-c6fd43377767 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:10.968047 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac94f04-dc96-4a2c-af51-c6fd43377767 None admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:10.968766 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac94f04-dc96-4a2c-af51-c6fd43377767 None admin] RBAC: Adding query filter params (name=member) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:25:10.969098 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac94f04-dc96-4a2c-af51-c6fd43377767 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:10.970503 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac94f04-dc96-4a2c-af51-c6fd43377767 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:10.977876 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f99323-4c79-41a8-be0f-fc099e37850e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:10.978532 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f99323-4c79-41a8-be0f-fc099e37850e None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:10.978820 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f99323-4c79-41a8-be0f-fc099e37850e None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:10.979288 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f99323-4c79-41a8-be0f-fc099e37850e None admin] PATH_INFO: `/v3/groups/68018f8f361f47768eefda30799e7f90` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:10.980416 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 211/416] 10.222.0.102 () {56 vars in 1106 bytes} [Mon Aug 1 15:25:10 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:10.980535 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f99323-4c79-41a8-be0f-fc099e37850e None admin] RBAC: Authorizing `identity:get_group(group_id=68018f8f361f47768eefda30799e7f90)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:10.982017 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f99323-4c79-41a8-be0f-fc099e37850e None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:10.983897 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 206/417] 10.222.0.102 () {56 vars in 1185 bytes} [Mon Aug 1 15:25:10 2022] GET /identity/v3/groups/68018f8f361f47768eefda30799e7f90 => generated 230 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:10.985749 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac94f04-dc96-4a2c-af51-c6fd43377767 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:10.989066 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f99323-4c79-41a8-be0f-fc099e37850e None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:11.022537 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:11.095251 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f99323-4c79-41a8-be0f-fc099e37850e None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:11.095422 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac94f04-dc96-4a2c-af51-c6fd43377767 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:11.131796 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b764fb53-f8f4-4b99-89b2-d9f125030f06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:11.131998 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d17cde4-4419-41f1-afc2-94ca7346c5bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:11.132410 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b764fb53-f8f4-4b99-89b2-d9f125030f06 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:11.132529 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d17cde4-4419-41f1-afc2-94ca7346c5bb None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:11.132682 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b764fb53-f8f4-4b99-89b2-d9f125030f06 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:11.132948 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d17cde4-4419-41f1-afc2-94ca7346c5bb None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:11.133106 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b764fb53-f8f4-4b99-89b2-d9f125030f06 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:11.133250 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d17cde4-4419-41f1-afc2-94ca7346c5bb None admin] PATH_INFO: `/v3/projects/fba62fb532fd40bd9b79f542e01e21d7` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:11.134293 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d17cde4-4419-41f1-afc2-94ca7346c5bb None admin] RBAC: Authorizing `identity:get_project(project_id=fba62fb532fd40bd9b79f542e01e21d7)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:11.135759 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d17cde4-4419-41f1-afc2-94ca7346c5bb None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:11.137774 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 207/418] 10.222.0.102 () {56 vars in 1191 bytes} [Mon Aug 1 15:25:10 2022] GET /identity/v3/projects/fba62fb532fd40bd9b79f542e01e21d7 => generated 345 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:11.143269 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d17cde4-4419-41f1-afc2-94ca7346c5bb None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:11.146466 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:11.207442 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b764fb53-f8f4-4b99-89b2-d9f125030f06 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:11.208922 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b764fb53-f8f4-4b99-89b2-d9f125030f06 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:11.248978 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:11.252510 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d17cde4-4419-41f1-afc2-94ca7346c5bb None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:11.290249 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d2c838-cfcd-414c-8057-f0021a6692c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:11.290927 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d2c838-cfcd-414c-8057-f0021a6692c5 None admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:11.291212 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d2c838-cfcd-414c-8057-f0021a6692c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:11.291486 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d2c838-cfcd-414c-8057-f0021a6692c5 None admin] PATH_INFO: `/v3/projects/fba62fb532fd40bd9b79f542e01e21d7/groups/68018f8f361f47768eefda30799e7f90/roles/de1374f966c04c27b579515b54334fd2` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:11.293511 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d2c838-cfcd-414c-8057-f0021a6692c5 None admin] RBAC: Authorizing `identity:create_grant(project_id=fba62fb532fd40bd9b79f542e01e21d7, group_id=68018f8f361f47768eefda30799e7f90, role_id=de1374f966c04c27b579515b54334fd2)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:11.294966 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d2c838-cfcd-414c-8057-f0021a6692c5 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:11.344151 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 212/419] 10.222.0.102 () {58 vars in 1287 bytes} [Mon Aug 1 15:25:10 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 15:25:11.353897 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b764fb53-f8f4-4b99-89b2-d9f125030f06 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:11.378304 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 208/420] 10.222.0.102 () {58 vars in 1447 bytes} [Mon Aug 1 15:25:11 2022] PUT /identity/v3/projects/fba62fb532fd40bd9b79f542e01e21d7/groups/68018f8f361f47768eefda30799e7f90/roles/de1374f966c04c27b579515b54334fd2 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 15:25:11.399888 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:11.462773 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b764fb53-f8f4-4b99-89b2-d9f125030f06 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:11.499671 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e15609-aaee-4c0e-b439-972e4d527d36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:11.500339 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e15609-aaee-4c0e-b439-972e4d527d36 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:11.500615 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e15609-aaee-4c0e-b439-972e4d527d36 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:11.500911 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e15609-aaee-4c0e-b439-972e4d527d36 None admin] PATH_INFO: `/v3/projects/dfcf3ac155ec4ab1b51e9b6849baec64` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:11.502166 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e15609-aaee-4c0e-b439-972e4d527d36 None admin] RBAC: Authorizing `identity:get_project(project_id=dfcf3ac155ec4ab1b51e9b6849baec64)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:11.503639 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e15609-aaee-4c0e-b439-972e4d527d36 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:11.505840 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 213/421] 10.222.0.102 () {56 vars in 1191 bytes} [Mon Aug 1 15:25:11 2022] GET /identity/v3/projects/dfcf3ac155ec4ab1b51e9b6849baec64 => generated 299 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:11.511598 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d2c838-cfcd-414c-8057-f0021a6692c5 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:11.632303 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698e1321-f3de-4bc0-a443-03b54a1aef2c None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:11.632592 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698e1321-f3de-4bc0-a443-03b54a1aef2c None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:11.632802 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698e1321-f3de-4bc0-a443-03b54a1aef2c None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:11.634946 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 214/422] 10.222.0.102 () {54 vars in 931 bytes} [Mon Aug 1 15:25:11 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 15:25:11.640059 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1549f59d-a51b-4458-a7cf-cd9fa2b1e795 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:11.640351 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1549f59d-a51b-4458-a7cf-cd9fa2b1e795 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:11.640630 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1549f59d-a51b-4458-a7cf-cd9fa2b1e795 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:11.645294 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d2c838-cfcd-414c-8057-f0021a6692c5 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:11.661136 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-1549f59d-a51b-4458-a7cf-cd9fa2b1e795 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:25:11.662354 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-1549f59d-a51b-4458-a7cf-cd9fa2b1e795 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:25:11.697535 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b442917-7728-441b-a427-170ffa2d11e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:11.698192 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b442917-7728-441b-a427-170ffa2d11e6 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:11.698476 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b442917-7728-441b-a427-170ffa2d11e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:11.698750 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b442917-7728-441b-a427-170ffa2d11e6 None admin] PATH_INFO: `/v3/groups/d18530a57eae416c8bab748ea01a7cff` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:11.701142 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b442917-7728-441b-a427-170ffa2d11e6 None admin] RBAC: Authorizing `identity:get_group(group_id=d18530a57eae416c8bab748ea01a7cff)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:11.703137 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b442917-7728-441b-a427-170ffa2d11e6 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:11.705191 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 209/423] 10.222.0.102 () {56 vars in 1185 bytes} [Mon Aug 1 15:25:11 2022] GET /identity/v3/groups/d18530a57eae416c8bab748ea01a7cff => generated 227 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:11.710991 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b442917-7728-441b-a427-170ffa2d11e6 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:11.750270 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 215/424] 10.222.0.102 () {58 vars in 1028 bytes} [Mon Aug 1 15:25:11 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 01 15:25:11.763612 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:11.805674 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1549f59d-a51b-4458-a7cf-cd9fa2b1e795 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:11.841730 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b442917-7728-441b-a427-170ffa2d11e6 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:11.878183 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c29d2e5-beb1-4fc7-9603-f4fef541800a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:11.878819 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c29d2e5-beb1-4fc7-9603-f4fef541800a None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:11.879108 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c29d2e5-beb1-4fc7-9603-f4fef541800a None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:11.879394 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c29d2e5-beb1-4fc7-9603-f4fef541800a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:11.880198 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c29d2e5-beb1-4fc7-9603-f4fef541800a None admin] RBAC: Adding query filter params (group.id=d18530a57eae416c8bab748ea01a7cff, role.id=27f5093ac0674d799cdbd17c68482e32, scope.project.id=dfcf3ac155ec4ab1b51e9b6849baec64) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:25:11.880518 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c29d2e5-beb1-4fc7-9603-f4fef541800a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:11.882024 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c29d2e5-beb1-4fc7-9603-f4fef541800a None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:11.898726 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 210/425] 10.222.0.102 () {56 vars in 1381 bytes} [Mon Aug 1 15:25:11 2022] GET /identity/v3/role_assignments?group.id=d18530a57eae416c8bab748ea01a7cff&scope.project.id=dfcf3ac155ec4ab1b51e9b6849baec64&role.id=27f5093ac0674d799cdbd17c68482e32 => generated 613 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:11.929344 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:12.024176 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1549f59d-a51b-4458-a7cf-cd9fa2b1e795 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:12.071207 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278828b7-7af3-4a3d-8765-1e83a45c9d74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:12.071851 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278828b7-7af3-4a3d-8765-1e83a45c9d74 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:12.072131 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278828b7-7af3-4a3d-8765-1e83a45c9d74 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:12.072403 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278828b7-7af3-4a3d-8765-1e83a45c9d74 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:12.088664 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278828b7-7af3-4a3d-8765-1e83a45c9d74 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:25:12.093700 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-278828b7-7af3-4a3d-8765-1e83a45c9d74 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 01 15:25:12.093700 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:25:12.093700 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:25:12.093700 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:25:12.093700 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:25:12.093700 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:25:12.093700 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:25:12.093700 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:25:12.093700 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:25:12.093700 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:25:12.093700 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:25:12.093700 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:25:12.093700 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:25:12.093700 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:25:12.093700 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:25:12.093700 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:25:12.094599 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:25:12.094599 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:25:12.094599 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:25:12.094599 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:25:12.094599 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:25:12.094599 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:25:12.094599 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:25:12.094599 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:25:12.094599 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:25:12.094599 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:25:12.094599 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:25:12.094599 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 01 15:25:12.094599 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:25:12.094599 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:25:12.094599 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:25:12.094599 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:25:12.095775 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:25:12.095775 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:25:12.095775 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:25:12.095775 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:25:12.095775 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:25:12.095775 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:25:12.095775 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:25:12.095775 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:25:12.095775 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:25:12.095775 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:25:12.095775 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 01 15:25:12.095775 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 01 15:25:12.095775 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 216/426] 10.222.0.102 () {56 vars in 1119 bytes} [Mon Aug 1 15:25:11 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 15:25:12.100964 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c29d2e5-beb1-4fc7-9603-f4fef541800a None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:12.197706 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:12.206721 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c29d2e5-beb1-4fc7-9603-f4fef541800a None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:12.241836 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e577196c-c8ab-42e1-9aca-63f9927b2b62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:12.242542 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e577196c-c8ab-42e1-9aca-63f9927b2b62 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:12.242827 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e577196c-c8ab-42e1-9aca-63f9927b2b62 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:12.243150 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e577196c-c8ab-42e1-9aca-63f9927b2b62 None admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:12.243882 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e577196c-c8ab-42e1-9aca-63f9927b2b62 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:25:12.244187 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e577196c-c8ab-42e1-9aca-63f9927b2b62 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:12.245595 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e577196c-c8ab-42e1-9aca-63f9927b2b62 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:12.254414 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 211/427] 10.222.0.102 () {56 vars in 1116 bytes} [Mon Aug 1 15:25:12 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:12.260557 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278828b7-7af3-4a3d-8765-1e83a45c9d74 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:12.393290 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:12.397078 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278828b7-7af3-4a3d-8765-1e83a45c9d74 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:12.436522 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26a54ca-a8e3-420c-877d-7817cd1e2ddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:12.437199 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26a54ca-a8e3-420c-877d-7817cd1e2ddc None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:12.437479 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26a54ca-a8e3-420c-877d-7817cd1e2ddc None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:12.437755 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26a54ca-a8e3-420c-877d-7817cd1e2ddc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:12.513693 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26a54ca-a8e3-420c-877d-7817cd1e2ddc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:12.515080 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26a54ca-a8e3-420c-877d-7817cd1e2ddc None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:12.614422 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:12.621203 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 217/428] 10.222.0.102 () {58 vars in 1287 bytes} [Mon Aug 1 15:25:12 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 15:25:12.624136 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e577196c-c8ab-42e1-9aca-63f9927b2b62 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:12.732544 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e577196c-c8ab-42e1-9aca-63f9927b2b62 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:12.773843 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f588f8dc-9488-4874-bda9-e6baf8fb820e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:12.774411 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f588f8dc-9488-4874-bda9-e6baf8fb820e None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:12.774695 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f588f8dc-9488-4874-bda9-e6baf8fb820e None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:12.774973 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f588f8dc-9488-4874-bda9-e6baf8fb820e None admin] PATH_INFO: `/v3/projects/dfcf3ac155ec4ab1b51e9b6849baec64` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:12.776229 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f588f8dc-9488-4874-bda9-e6baf8fb820e None admin] RBAC: Authorizing `identity:get_project(project_id=dfcf3ac155ec4ab1b51e9b6849baec64)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:12.777733 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f588f8dc-9488-4874-bda9-e6baf8fb820e None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:12.779711 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 212/429] 10.222.0.102 () {56 vars in 1191 bytes} [Mon Aug 1 15:25:12 2022] GET /identity/v3/projects/dfcf3ac155ec4ab1b51e9b6849baec64 => generated 299 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:12.785322 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26a54ca-a8e3-420c-877d-7817cd1e2ddc None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:12.824582 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8475dc45-c7fa-4c47-b205-592657fffcf9 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:12.824950 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8475dc45-c7fa-4c47-b205-592657fffcf9 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:12.825157 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8475dc45-c7fa-4c47-b205-592657fffcf9 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:12.827032 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 213/430] 10.222.0.102 () {54 vars in 931 bytes} [Mon Aug 1 15:25:12 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 15:25:12.834245 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb667b64-e8ef-4596-bb09-0ad27d6b7b4c None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:12.834534 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb667b64-e8ef-4596-bb09-0ad27d6b7b4c None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:12.834814 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb667b64-e8ef-4596-bb09-0ad27d6b7b4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:12.855362 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-eb667b64-e8ef-4596-bb09-0ad27d6b7b4c None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:25:12.856567 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-eb667b64-e8ef-4596-bb09-0ad27d6b7b4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:25:12.890953 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:12.930937 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26a54ca-a8e3-420c-877d-7817cd1e2ddc None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:12.953903 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 214/431] 10.222.0.102 () {58 vars in 1028 bytes} [Mon Aug 1 15:25:12 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 01 15:25:12.955248 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0a8d1c-b68c-4de2-8797-c25c9e738dbd None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:12.955531 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0a8d1c-b68c-4de2-8797-c25c9e738dbd None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:12.955801 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0a8d1c-b68c-4de2-8797-c25c9e738dbd None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:12.957268 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 215/432] 10.222.0.102 () {54 vars in 931 bytes} [Mon Aug 1 15:25:12 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 15:25:12.962465 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1419d949-104f-4e16-81b7-35702d3d841a None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:12.962945 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1419d949-104f-4e16-81b7-35702d3d841a None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:12.963215 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1419d949-104f-4e16-81b7-35702d3d841a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:12.979349 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e16c878-d157-4b0b-988b-617a3b1322df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:12.980336 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e16c878-d157-4b0b-988b-617a3b1322df None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:12.980817 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e16c878-d157-4b0b-988b-617a3b1322df None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:12.981230 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e16c878-d157-4b0b-988b-617a3b1322df None admin] PATH_INFO: `/v3/groups/d18530a57eae416c8bab748ea01a7cff` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:12.982494 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e16c878-d157-4b0b-988b-617a3b1322df None admin] RBAC: Authorizing `identity:get_group(group_id=d18530a57eae416c8bab748ea01a7cff)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:12.982669 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-1419d949-104f-4e16-81b7-35702d3d841a None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:25:12.983698 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-1419d949-104f-4e16-81b7-35702d3d841a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:25:12.984033 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e16c878-d157-4b0b-988b-617a3b1322df None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:12.990656 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 218/433] 10.222.0.102 () {56 vars in 1185 bytes} [Mon Aug 1 15:25:12 2022] GET /identity/v3/groups/d18530a57eae416c8bab748ea01a7cff => generated 227 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:12.990656 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e16c878-d157-4b0b-988b-617a3b1322df None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:13.058490 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 216/434] 10.222.0.102 () {58 vars in 1028 bytes} [Mon Aug 1 15:25:12 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 01 15:25:13.059361 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1419d949-104f-4e16-81b7-35702d3d841a None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:13.061812 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:13.102737 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e16c878-d157-4b0b-988b-617a3b1322df None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:13.136953 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b4d572-a59a-417a-8fb1-064d4e457d32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:13.137569 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b4d572-a59a-417a-8fb1-064d4e457d32 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:13.137843 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b4d572-a59a-417a-8fb1-064d4e457d32 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:13.138107 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b4d572-a59a-417a-8fb1-064d4e457d32 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:13.148045 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b4d572-a59a-417a-8fb1-064d4e457d32 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:25:13.153910 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-24b4d572-a59a-417a-8fb1-064d4e457d32 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 01 15:25:13.153910 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:25:13.153910 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:25:13.153910 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:25:13.153910 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:25:13.153910 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:25:13.153910 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:25:13.153910 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:25:13.153910 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:25:13.153910 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:25:13.153910 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:25:13.153910 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:25:13.153910 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:25:13.153910 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:25:13.153910 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:25:13.153910 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:25:13.154799 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:25:13.154799 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:25:13.154799 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:25:13.154799 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:25:13.154799 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:25:13.154799 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:25:13.154799 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:25:13.154799 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:25:13.154799 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:25:13.154799 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:25:13.154799 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:25:13.154799 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 01 15:25:13.154799 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:25:13.154799 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:25:13.154799 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:25:13.154799 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:25:13.156752 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:25:13.156752 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:25:13.156752 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:25:13.156752 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:25:13.156752 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:25:13.156752 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:25:13.156752 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:25:13.156752 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:25:13.156752 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:25:13.156752 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:25:13.156752 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 01 15:25:13.156752 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 01 15:25:13.156752 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 219/435] 10.222.0.102 () {56 vars in 1119 bytes} [Mon Aug 1 15:25:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:25:13.156752 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b4d572-a59a-417a-8fb1-064d4e457d32 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:13.166534 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:13.186732 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1419d949-104f-4e16-81b7-35702d3d841a None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:13.226355 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a67836-feb8-4254-9899-c27930757489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:13.228157 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a67836-feb8-4254-9899-c27930757489 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:13.228157 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a67836-feb8-4254-9899-c27930757489 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:13.228429 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a67836-feb8-4254-9899-c27930757489 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:13.229312 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a67836-feb8-4254-9899-c27930757489 None admin] RBAC: Adding query filter params (group.id=d18530a57eae416c8bab748ea01a7cff, role.id=5acf9fe30ec74532a49ebed755ea61e4, scope.project.id=dfcf3ac155ec4ab1b51e9b6849baec64) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:25:13.229614 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a67836-feb8-4254-9899-c27930757489 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:13.231089 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a67836-feb8-4254-9899-c27930757489 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:13.249211 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 217/436] 10.222.0.102 () {56 vars in 1381 bytes} [Mon Aug 1 15:25:13 2022] GET /identity/v3/role_assignments?group.id=d18530a57eae416c8bab748ea01a7cff&scope.project.id=dfcf3ac155ec4ab1b51e9b6849baec64&role.id=5acf9fe30ec74532a49ebed755ea61e4 => generated 613 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:13.250033 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a67836-feb8-4254-9899-c27930757489 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:13.260957 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b4d572-a59a-417a-8fb1-064d4e457d32 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:13.292999 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:13.303405 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5d3d22-1eb3-4a44-bac3-973e532e3da1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:13.304058 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5d3d22-1eb3-4a44-bac3-973e532e3da1 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:13.304436 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5d3d22-1eb3-4a44-bac3-973e532e3da1 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:13.304682 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5d3d22-1eb3-4a44-bac3-973e532e3da1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:13.317553 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5d3d22-1eb3-4a44-bac3-973e532e3da1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:25:13.322742 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-0c5d3d22-1eb3-4a44-bac3-973e532e3da1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 01 15:25:13.322742 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:25:13.322742 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:25:13.322742 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:25:13.322742 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:25:13.322742 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:25:13.322742 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:25:13.322742 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:25:13.322742 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:25:13.322742 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:25:13.322742 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:25:13.322742 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:25:13.322742 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:25:13.322742 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:25:13.322742 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:25:13.322742 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:25:13.324761 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:25:13.324761 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:25:13.324761 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:25:13.324761 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:25:13.324761 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:25:13.324761 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:25:13.324761 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:25:13.324761 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:25:13.324761 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:25:13.324761 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:25:13.324761 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:25:13.324761 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 01 15:25:13.324761 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:25:13.324761 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:25:13.324761 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:25:13.324761 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:25:13.325627 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:25:13.325627 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:25:13.325627 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:25:13.325627 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:25:13.325627 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:25:13.325627 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:25:13.325627 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:25:13.325627 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:25:13.325627 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:25:13.325627 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:25:13.325627 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 01 15:25:13.325627 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 01 15:25:13.329597 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 220/437] 10.222.0.102 () {56 vars in 1104 bytes} [Mon Aug 1 15:25:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:25:13.330628 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5d3d22-1eb3-4a44-bac3-973e532e3da1 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:13.406390 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a67836-feb8-4254-9899-c27930757489 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:13.448760 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba77289-0726-4e44-88dc-b36939055d3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:13.449453 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba77289-0726-4e44-88dc-b36939055d3a None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:13.449736 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba77289-0726-4e44-88dc-b36939055d3a None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:13.450073 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba77289-0726-4e44-88dc-b36939055d3a None admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:13.450803 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba77289-0726-4e44-88dc-b36939055d3a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:25:13.451105 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba77289-0726-4e44-88dc-b36939055d3a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:13.452744 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba77289-0726-4e44-88dc-b36939055d3a None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:13.461961 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5d3d22-1eb3-4a44-bac3-973e532e3da1 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:13.463307 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 218/438] 10.222.0.102 () {56 vars in 1116 bytes} [Mon Aug 1 15:25:13 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:13.471332 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba77289-0726-4e44-88dc-b36939055d3a None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:13.483191 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:13.506140 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0b8658-1bd4-4c90-a973-0294b2235e0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:13.507066 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0b8658-1bd4-4c90-a973-0294b2235e0c None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:13.507504 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0b8658-1bd4-4c90-a973-0294b2235e0c None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:13.508455 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0b8658-1bd4-4c90-a973-0294b2235e0c None admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:13.509406 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0b8658-1bd4-4c90-a973-0294b2235e0c None admin] RBAC: Adding query filter params (name=member) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:25:13.509859 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0b8658-1bd4-4c90-a973-0294b2235e0c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:13.512513 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0b8658-1bd4-4c90-a973-0294b2235e0c None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:13.522670 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 221/439] 10.222.0.102 () {56 vars in 1106 bytes} [Mon Aug 1 15:25:13 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:25:13.532958 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0b8658-1bd4-4c90-a973-0294b2235e0c None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:13.599527 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:13.604226 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba77289-0726-4e44-88dc-b36939055d3a None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:13.644660 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040eb34a-9246-4018-b101-a270030dfa55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:13.645423 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040eb34a-9246-4018-b101-a270030dfa55 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:13.645793 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040eb34a-9246-4018-b101-a270030dfa55 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:13.646135 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040eb34a-9246-4018-b101-a270030dfa55 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:13.664585 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0b8658-1bd4-4c90-a973-0294b2235e0c None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:13.713131 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f4d319-211d-4edd-bc3d-62da2ba982f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:13.713946 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f4d319-211d-4edd-bc3d-62da2ba982f9 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:13.714320 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f4d319-211d-4edd-bc3d-62da2ba982f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:13.714896 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f4d319-211d-4edd-bc3d-62da2ba982f9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:13.735470 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040eb34a-9246-4018-b101-a270030dfa55 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:13.736985 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040eb34a-9246-4018-b101-a270030dfa55 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:13.746799 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:13.799052 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f4d319-211d-4edd-bc3d-62da2ba982f9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:13.800798 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f4d319-211d-4edd-bc3d-62da2ba982f9 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:13.837976 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 219/440] 10.222.0.102 () {58 vars in 1287 bytes} [Mon Aug 1 15:25:13 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 01 15:25:13.839617 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133079ff-39a0-4009-91e3-746eb02e7895 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:13.839898 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133079ff-39a0-4009-91e3-746eb02e7895 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:13.840174 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133079ff-39a0-4009-91e3-746eb02e7895 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:13.841456 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 220/441] 10.222.0.102 () {54 vars in 931 bytes} [Mon Aug 1 15:25:13 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 15:25:13.843309 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133079ff-39a0-4009-91e3-746eb02e7895 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:13.852683 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:13.907279 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 222/442] 10.222.0.102 () {58 vars in 1287 bytes} [Mon Aug 1 15:25:13 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 01 15:25:13.908595 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108d5605-e0b6-475e-8e07-1b20dde4228f None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:13.908907 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108d5605-e0b6-475e-8e07-1b20dde4228f None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:13.909182 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108d5605-e0b6-475e-8e07-1b20dde4228f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:13.927451 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-108d5605-e0b6-475e-8e07-1b20dde4228f None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:25:13.928650 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-108d5605-e0b6-475e-8e07-1b20dde4228f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:25:13.948974 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133079ff-39a0-4009-91e3-746eb02e7895 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:13.958200 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:13.981794 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5263dc04-dcb2-4386-904c-142747fae68b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:13.982509 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5263dc04-dcb2-4386-904c-142747fae68b None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:13.982811 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5263dc04-dcb2-4386-904c-142747fae68b None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:13.983061 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5263dc04-dcb2-4386-904c-142747fae68b None admin] PATH_INFO: `/v3/projects/5db9d563233a43d8b5d7983c087936d2` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:13.984309 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5263dc04-dcb2-4386-904c-142747fae68b None admin] RBAC: Authorizing `identity:get_project(project_id=5db9d563233a43d8b5d7983c087936d2)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:13.985775 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5263dc04-dcb2-4386-904c-142747fae68b None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:13.987892 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 221/443] 10.222.0.102 () {56 vars in 1191 bytes} [Mon Aug 1 15:25:13 2022] GET /identity/v3/projects/5db9d563233a43d8b5d7983c087936d2 => generated 303 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:25:13.988687 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5263dc04-dcb2-4386-904c-142747fae68b None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:13.997605 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 223/444] 10.222.0.102 () {58 vars in 1028 bytes} [Mon Aug 1 15:25:13 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 15:25:13.998433 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108d5605-e0b6-475e-8e07-1b20dde4228f None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:14.079231 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:14.098690 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5263dc04-dcb2-4386-904c-142747fae68b None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:14.104903 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108d5605-e0b6-475e-8e07-1b20dde4228f None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:14.133874 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f419c1e4-1914-4c3e-b88c-d8afde9eba1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:14.134521 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f419c1e4-1914-4c3e-b88c-d8afde9eba1b None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:14.134800 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f419c1e4-1914-4c3e-b88c-d8afde9eba1b None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:14.135071 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f419c1e4-1914-4c3e-b88c-d8afde9eba1b None admin] PATH_INFO: `/v3/projects/5db9d563233a43d8b5d7983c087936d2` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:14.136235 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f419c1e4-1914-4c3e-b88c-d8afde9eba1b None admin] RBAC: Authorizing `identity:get_project(project_id=5db9d563233a43d8b5d7983c087936d2)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:14.137699 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f419c1e4-1914-4c3e-b88c-d8afde9eba1b None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:14.139434 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 222/445] 10.222.0.102 () {56 vars in 1191 bytes} [Mon Aug 1 15:25:13 2022] GET /identity/v3/projects/5db9d563233a43d8b5d7983c087936d2 => generated 303 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:14.140128 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f419c1e4-1914-4c3e-b88c-d8afde9eba1b None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:14.144516 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a25d50c-8dbf-4db3-a085-522e675b769f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:14.145253 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a25d50c-8dbf-4db3-a085-522e675b769f None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:14.145595 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a25d50c-8dbf-4db3-a085-522e675b769f None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:14.145932 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a25d50c-8dbf-4db3-a085-522e675b769f None admin] PATH_INFO: `/v3/groups/d18530a57eae416c8bab748ea01a7cff` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:14.147078 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a25d50c-8dbf-4db3-a085-522e675b769f None admin] RBAC: Authorizing `identity:get_group(group_id=d18530a57eae416c8bab748ea01a7cff)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:14.148546 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a25d50c-8dbf-4db3-a085-522e675b769f None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:14.150164 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 224/446] 10.222.0.102 () {56 vars in 1185 bytes} [Mon Aug 1 15:25:13 2022] GET /identity/v3/groups/d18530a57eae416c8bab748ea01a7cff => generated 227 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:14.150913 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a25d50c-8dbf-4db3-a085-522e675b769f None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:14.192183 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:14.245686 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f419c1e4-1914-4c3e-b88c-d8afde9eba1b None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:14.249661 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a25d50c-8dbf-4db3-a085-522e675b769f None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:14.278833 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5c4a0a-4f38-4031-a231-6386a74dc564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:14.279470 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5c4a0a-4f38-4031-a231-6386a74dc564 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:14.279747 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5c4a0a-4f38-4031-a231-6386a74dc564 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:14.280015 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5c4a0a-4f38-4031-a231-6386a74dc564 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:14.282368 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce7ec4c-4ccb-467e-9351-3d9b911648ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:14.283267 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce7ec4c-4ccb-467e-9351-3d9b911648ba None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:14.283545 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce7ec4c-4ccb-467e-9351-3d9b911648ba None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:14.283818 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce7ec4c-4ccb-467e-9351-3d9b911648ba None admin] PATH_INFO: `/v3/groups/d18530a57eae416c8bab748ea01a7cff` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:14.285003 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce7ec4c-4ccb-467e-9351-3d9b911648ba None admin] RBAC: Authorizing `identity:get_group(group_id=d18530a57eae416c8bab748ea01a7cff)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:14.286444 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce7ec4c-4ccb-467e-9351-3d9b911648ba None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:14.288036 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 225/447] 10.222.0.102 () {56 vars in 1185 bytes} [Mon Aug 1 15:25:14 2022] GET /identity/v3/groups/d18530a57eae416c8bab748ea01a7cff => generated 227 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:14.288789 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce7ec4c-4ccb-467e-9351-3d9b911648ba None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:14.294264 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5c4a0a-4f38-4031-a231-6386a74dc564 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:25:14.299328 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-7e5c4a0a-4f38-4031-a231-6386a74dc564 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 15:25:14.299328 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:25:14.299328 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:25:14.299328 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:25:14.299328 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:25:14.299328 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:25:14.299328 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:25:14.299328 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:25:14.299328 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:25:14.299328 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:25:14.299328 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:25:14.299328 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:25:14.299328 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:25:14.299328 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:25:14.299328 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:25:14.299328 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:25:14.300249 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:25:14.300249 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:25:14.300249 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:25:14.300249 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:25:14.300249 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:25:14.300249 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:25:14.300249 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:25:14.300249 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:25:14.300249 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:25:14.300249 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:25:14.300249 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:25:14.300249 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 01 15:25:14.300249 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:25:14.300249 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:25:14.300249 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:25:14.300249 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:25:14.301064 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:25:14.301064 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:25:14.301064 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:25:14.301064 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:25:14.301064 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:25:14.301064 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:25:14.301064 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:25:14.301064 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:25:14.301064 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:25:14.301064 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:25:14.301064 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 15:25:14.301064 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 01 15:25:14.301064 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 223/448] 10.222.0.102 () {56 vars in 1101 bytes} [Mon Aug 1 15:25:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:25:14.301958 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5c4a0a-4f38-4031-a231-6386a74dc564 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:14.311774 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:14.395514 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce7ec4c-4ccb-467e-9351-3d9b911648ba None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:14.406264 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5c4a0a-4f38-4031-a231-6386a74dc564 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:14.409346 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:14.430238 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55cde4b-6183-44d4-b478-2afc42bc423d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:14.430882 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55cde4b-6183-44d4-b478-2afc42bc423d None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:14.431159 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55cde4b-6183-44d4-b478-2afc42bc423d None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:14.431433 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55cde4b-6183-44d4-b478-2afc42bc423d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:14.432224 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55cde4b-6183-44d4-b478-2afc42bc423d None admin] RBAC: Adding query filter params (group.id=d18530a57eae416c8bab748ea01a7cff, role.id=5acf9fe30ec74532a49ebed755ea61e4, scope.project.id=5db9d563233a43d8b5d7983c087936d2) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:25:14.432536 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55cde4b-6183-44d4-b478-2afc42bc423d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:14.434141 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55cde4b-6183-44d4-b478-2afc42bc423d None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:14.440049 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 226/449] 10.222.0.102 () {56 vars in 1381 bytes} [Mon Aug 1 15:25:14 2022] GET /identity/v3/role_assignments?group.id=d18530a57eae416c8bab748ea01a7cff&scope.project.id=5db9d563233a43d8b5d7983c087936d2&role.id=5acf9fe30ec74532a49ebed755ea61e4 => generated 613 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:14.440824 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55cde4b-6183-44d4-b478-2afc42bc423d None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:14.442721 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee82c63-3e6c-4cca-a61b-ac4f19c974fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:14.443353 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee82c63-3e6c-4cca-a61b-ac4f19c974fb None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:14.443634 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee82c63-3e6c-4cca-a61b-ac4f19c974fb None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:14.443906 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee82c63-3e6c-4cca-a61b-ac4f19c974fb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:14.444712 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee82c63-3e6c-4cca-a61b-ac4f19c974fb None admin] RBAC: Adding query filter params (group.id=d18530a57eae416c8bab748ea01a7cff, role.id=27f5093ac0674d799cdbd17c68482e32, scope.project.id=5db9d563233a43d8b5d7983c087936d2) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:25:14.445056 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee82c63-3e6c-4cca-a61b-ac4f19c974fb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:14.447071 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee82c63-3e6c-4cca-a61b-ac4f19c974fb None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:14.455230 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 224/450] 10.222.0.102 () {56 vars in 1381 bytes} [Mon Aug 1 15:25:14 2022] GET /identity/v3/role_assignments?group.id=d18530a57eae416c8bab748ea01a7cff&scope.project.id=5db9d563233a43d8b5d7983c087936d2&role.id=27f5093ac0674d799cdbd17c68482e32 => generated 613 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:14.547418 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:14.568711 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55cde4b-6183-44d4-b478-2afc42bc423d None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:14.610859 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f165bb5e-9a56-4fb6-a9fa-25ff1a184a84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:14.611551 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f165bb5e-9a56-4fb6-a9fa-25ff1a184a84 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:14.611828 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f165bb5e-9a56-4fb6-a9fa-25ff1a184a84 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:14.612139 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f165bb5e-9a56-4fb6-a9fa-25ff1a184a84 None admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:14.612891 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f165bb5e-9a56-4fb6-a9fa-25ff1a184a84 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:25:14.613200 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f165bb5e-9a56-4fb6-a9fa-25ff1a184a84 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:14.614597 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f165bb5e-9a56-4fb6-a9fa-25ff1a184a84 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:14.624749 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 227/451] 10.222.0.102 () {56 vars in 1104 bytes} [Mon Aug 1 15:25:14 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:14.630304 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee82c63-3e6c-4cca-a61b-ac4f19c974fb None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:14.738878 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee82c63-3e6c-4cca-a61b-ac4f19c974fb None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:14.773315 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d017b6c4-69a5-45cd-866f-13d6142a2013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:14.774818 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d017b6c4-69a5-45cd-866f-13d6142a2013 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:14.775099 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d017b6c4-69a5-45cd-866f-13d6142a2013 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:14.775417 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d017b6c4-69a5-45cd-866f-13d6142a2013 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:14.814325 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:14.848973 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d017b6c4-69a5-45cd-866f-13d6142a2013 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:14.850439 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d017b6c4-69a5-45cd-866f-13d6142a2013 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:14.952170 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 225/452] 10.222.0.102 () {58 vars in 1287 bytes} [Mon Aug 1 15:25:14 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 15:25:14.958027 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f165bb5e-9a56-4fb6-a9fa-25ff1a184a84 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:15.055928 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f165bb5e-9a56-4fb6-a9fa-25ff1a184a84 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:15.089258 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcccc92-280b-424a-9c5b-33e6dc683909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:15.089876 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcccc92-280b-424a-9c5b-33e6dc683909 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:15.090148 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcccc92-280b-424a-9c5b-33e6dc683909 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:15.090417 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcccc92-280b-424a-9c5b-33e6dc683909 None admin] PATH_INFO: `/v3/projects/fba62fb532fd40bd9b79f542e01e21d7` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:15.091549 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcccc92-280b-424a-9c5b-33e6dc683909 None admin] RBAC: Authorizing `identity:get_project(project_id=fba62fb532fd40bd9b79f542e01e21d7)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:15.093161 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcccc92-280b-424a-9c5b-33e6dc683909 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:15.094794 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 228/453] 10.222.0.102 () {56 vars in 1191 bytes} [Mon Aug 1 15:25:14 2022] GET /identity/v3/projects/fba62fb532fd40bd9b79f542e01e21d7 => generated 345 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:15.100437 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d017b6c4-69a5-45cd-866f-13d6142a2013 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:15.164597 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:15.197160 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d017b6c4-69a5-45cd-866f-13d6142a2013 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:15.230531 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25d2e92-50c2-49e2-b313-a392f37f2455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:15.231163 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25d2e92-50c2-49e2-b313-a392f37f2455 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:15.231447 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25d2e92-50c2-49e2-b313-a392f37f2455 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:15.231722 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25d2e92-50c2-49e2-b313-a392f37f2455 None admin] PATH_INFO: `/v3/groups/68018f8f361f47768eefda30799e7f90` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:15.232881 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25d2e92-50c2-49e2-b313-a392f37f2455 None admin] RBAC: Authorizing `identity:get_group(group_id=68018f8f361f47768eefda30799e7f90)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:15.234333 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25d2e92-50c2-49e2-b313-a392f37f2455 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:15.235911 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 226/454] 10.222.0.102 () {56 vars in 1185 bytes} [Mon Aug 1 15:25:15 2022] GET /identity/v3/groups/68018f8f361f47768eefda30799e7f90 => generated 230 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:15.241847 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcccc92-280b-424a-9c5b-33e6dc683909 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:15.254327 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:15.339960 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcccc92-280b-424a-9c5b-33e6dc683909 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:15.371537 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7680443-6ad9-4088-b9a0-3fff5a0fae16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:15.372133 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7680443-6ad9-4088-b9a0-3fff5a0fae16 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:15.372409 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7680443-6ad9-4088-b9a0-3fff5a0fae16 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:15.372679 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7680443-6ad9-4088-b9a0-3fff5a0fae16 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:15.373488 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7680443-6ad9-4088-b9a0-3fff5a0fae16 None admin] RBAC: Adding query filter params (group.id=68018f8f361f47768eefda30799e7f90, role.id=de1374f966c04c27b579515b54334fd2, scope.project.id=fba62fb532fd40bd9b79f542e01e21d7) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:25:15.373801 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7680443-6ad9-4088-b9a0-3fff5a0fae16 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:15.375218 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7680443-6ad9-4088-b9a0-3fff5a0fae16 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:15.380813 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 229/455] 10.222.0.102 () {56 vars in 1381 bytes} [Mon Aug 1 15:25:15 2022] GET /identity/v3/role_assignments?group.id=68018f8f361f47768eefda30799e7f90&scope.project.id=fba62fb532fd40bd9b79f542e01e21d7&role.id=de1374f966c04c27b579515b54334fd2 => generated 613 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:17.872046 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8916b9e1-a0a5-444c-8117-dd207d2ce222 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:17.872046 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8916b9e1-a0a5-444c-8117-dd207d2ce222 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:17.872046 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8916b9e1-a0a5-444c-8117-dd207d2ce222 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:17.873365 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 227/456] 10.222.0.102 () {54 vars in 931 bytes} [Mon Aug 1 15:25:17 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 15:25:17.877195 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbc41ac-a391-46b6-81db-b68ccb79235b None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:17.877997 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbc41ac-a391-46b6-81db-b68ccb79235b None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:17.878530 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbc41ac-a391-46b6-81db-b68ccb79235b None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:17.880482 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 230/457] 10.222.0.102 () {54 vars in 931 bytes} [Mon Aug 1 15:25:17 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 01 15:25:17.882600 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356732bc-d5bf-456a-b33a-97d45454dc2c None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:17.883730 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356732bc-d5bf-456a-b33a-97d45454dc2c None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:17.884206 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356732bc-d5bf-456a-b33a-97d45454dc2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:17.886047 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2016c3-7c4d-4c1c-96c2-c85df270b77e None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:17.886624 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2016c3-7c4d-4c1c-96c2-c85df270b77e None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:17.887192 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2016c3-7c4d-4c1c-96c2-c85df270b77e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:17.915106 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-3c2016c3-7c4d-4c1c-96c2-c85df270b77e None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:25:17.916297 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-3c2016c3-7c4d-4c1c-96c2-c85df270b77e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:25:17.924501 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-356732bc-d5bf-456a-b33a-97d45454dc2c None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:25:17.925695 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-356732bc-d5bf-456a-b33a-97d45454dc2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:25:18.017732 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 231/458] 10.222.0.102 () {58 vars in 1028 bytes} [Mon Aug 1 15:25:17 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 01 15:25:18.046330 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2016c3-7c4d-4c1c-96c2-c85df270b77e None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:18.049475 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:18.051576 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 228/459] 10.222.0.102 () {58 vars in 1028 bytes} [Mon Aug 1 15:25:17 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 15:25:18.076578 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356732bc-d5bf-456a-b33a-97d45454dc2c None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:18.184095 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2016c3-7c4d-4c1c-96c2-c85df270b77e None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:18.220580 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33beb125-592a-468e-afbd-b97375d0b311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:18.221479 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33beb125-592a-468e-afbd-b97375d0b311 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:18.221922 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33beb125-592a-468e-afbd-b97375d0b311 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:18.222345 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33beb125-592a-468e-afbd-b97375d0b311 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:18.232371 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:18.234175 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33beb125-592a-468e-afbd-b97375d0b311 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:18.235889 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33beb125-592a-468e-afbd-b97375d0b311 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:18.252047 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-33beb125-592a-468e-afbd-b97375d0b311 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:25:18.252047 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:25:18.252047 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:25:18.252047 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:25:18.252047 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:25:18.252047 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:25:18.252047 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:25:18.252047 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:25:18.252047 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:25:18.252047 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:25:18.252047 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:25:18.252047 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:25:18.252047 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:25:18.252047 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:25:18.252047 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:25:18.253028 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:25:18.253028 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:25:18.253028 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:25:18.253028 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:25:18.253028 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:25:18.253028 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:25:18.253028 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:25:18.253028 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:25:18.253028 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 01 15:25:18.253028 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:25:18.253028 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:25:18.253028 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:25:18.253028 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:25:18.253028 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:25:18.253028 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:25:18.253028 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:25:18.253028 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:25:18.253988 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:25:18.253988 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:25:18.253988 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:25:18.253988 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 01 15:25:18.256162 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 232/460] 10.222.0.102 () {56 vars in 1113 bytes} [Mon Aug 1 15:25:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 15:25:18.261583 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33beb125-592a-468e-afbd-b97375d0b311 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:18.312648 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356732bc-d5bf-456a-b33a-97d45454dc2c None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:18.328395 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:18.389298 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33beb125-592a-468e-afbd-b97375d0b311 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:18.395349 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9999fd17-35e2-4c69-8905-7d4f3580738c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:18.396047 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9999fd17-35e2-4c69-8905-7d4f3580738c None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:18.396308 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9999fd17-35e2-4c69-8905-7d4f3580738c None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:18.396581 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9999fd17-35e2-4c69-8905-7d4f3580738c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:18.409952 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9999fd17-35e2-4c69-8905-7d4f3580738c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:18.411456 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9999fd17-35e2-4c69-8905-7d4f3580738c None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:18.430510 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffa181b-ef78-4c27-b36e-24d7937c67db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:18.431132 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffa181b-ef78-4c27-b36e-24d7937c67db None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:18.431416 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffa181b-ef78-4c27-b36e-24d7937c67db None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:18.431693 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffa181b-ef78-4c27-b36e-24d7937c67db None admin] PATH_INFO: `/v3/domains` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:18.432376 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-9999fd17-35e2-4c69-8905-7d4f3580738c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:25:18.432376 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:25:18.432376 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:25:18.432376 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:25:18.432376 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:25:18.432376 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:25:18.432376 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:25:18.432376 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:25:18.432376 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:25:18.432376 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:25:18.432376 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:25:18.432376 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:25:18.432376 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:25:18.432376 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:25:18.432376 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:25:18.433257 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:25:18.433257 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:25:18.433257 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:25:18.433257 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:25:18.433257 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:25:18.433257 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:25:18.433257 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:25:18.433257 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:25:18.433257 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 01 15:25:18.433257 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:25:18.433257 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:25:18.433257 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:25:18.433257 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:25:18.433257 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:25:18.433257 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:25:18.433257 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:25:18.433257 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:25:18.434517 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:25:18.434517 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:25:18.434517 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:25:18.434517 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 01 15:25:18.434752 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffa181b-ef78-4c27-b36e-24d7937c67db None admin] RBAC: Adding query filter params (name=Default) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:25:18.434752 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffa181b-ef78-4c27-b36e-24d7937c67db None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:18.434876 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 229/461] 10.222.0.102 () {56 vars in 1113 bytes} [Mon Aug 1 15:25:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 358 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 15:25:18.434941 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffa181b-ef78-4c27-b36e-24d7937c67db None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:18.435190 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c20fa1-5a21-48bd-8c6b-810dbddec45e None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:18.435438 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c20fa1-5a21-48bd-8c6b-810dbddec45e None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:18.436484 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c20fa1-5a21-48bd-8c6b-810dbddec45e None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:18.437610 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 230/462] 10.222.0.102 () {54 vars in 931 bytes} [Mon Aug 1 15:25:18 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 15:25:18.439152 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8d6445-90c8-4e48-82c9-1faae6b52762 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:18.439429 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8d6445-90c8-4e48-82c9-1faae6b52762 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:18.439799 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8d6445-90c8-4e48-82c9-1faae6b52762 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:18.441494 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 231/463] 10.222.0.102 () {54 vars in 931 bytes} [Mon Aug 1 15:25:18 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 15:25:18.442316 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8d6445-90c8-4e48-82c9-1faae6b52762 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:18.452738 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 233/464] 10.222.0.102 () {56 vars in 1114 bytes} [Mon Aug 1 15:25:18 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:18.454084 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efd4de8-713a-47f0-8904-bebdcd7adbca None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:18.454371 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efd4de8-713a-47f0-8904-bebdcd7adbca None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:18.454647 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efd4de8-713a-47f0-8904-bebdcd7adbca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:18.474418 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-5efd4de8-713a-47f0-8904-bebdcd7adbca None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:25:18.475691 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-5efd4de8-713a-47f0-8904-bebdcd7adbca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:25:18.549585 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 234/465] 10.222.0.102 () {58 vars in 1028 bytes} [Mon Aug 1 15:25:18 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 15:25:18.550978 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cd3b13-4b7b-46db-90ae-9ee791a79c68 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:18.551357 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cd3b13-4b7b-46db-90ae-9ee791a79c68 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:18.551637 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cd3b13-4b7b-46db-90ae-9ee791a79c68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:18.552502 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8d6445-90c8-4e48-82c9-1faae6b52762 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:18.573333 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-b8cd3b13-4b7b-46db-90ae-9ee791a79c68 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:25:18.574096 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:18.575198 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-b8cd3b13-4b7b-46db-90ae-9ee791a79c68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:25:18.591577 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f106ac7-b197-4816-a316-4e3583f0f534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:18.592207 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f106ac7-b197-4816-a316-4e3583f0f534 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:18.592485 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f106ac7-b197-4816-a316-4e3583f0f534 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:18.592758 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f106ac7-b197-4816-a316-4e3583f0f534 None admin] PATH_INFO: `/v3/domains` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:18.593482 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f106ac7-b197-4816-a316-4e3583f0f534 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:25:18.593786 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f106ac7-b197-4816-a316-4e3583f0f534 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:18.595172 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f106ac7-b197-4816-a316-4e3583f0f534 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:18.610430 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 232/466] 10.222.0.102 () {56 vars in 1114 bytes} [Mon Aug 1 15:25:18 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:18.613680 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f106ac7-b197-4816-a316-4e3583f0f534 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:18.627862 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:18.655200 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 235/467] 10.222.0.102 () {58 vars in 1028 bytes} [Mon Aug 1 15:25:18 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 15:25:18.656297 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cd3b13-4b7b-46db-90ae-9ee791a79c68 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:18.727830 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f106ac7-b197-4816-a316-4e3583f0f534 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:18.764896 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d135ae4-8765-440e-88b4-f99b9ff43dee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:18.765524 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d135ae4-8765-440e-88b4-f99b9ff43dee None admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:18.765803 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d135ae4-8765-440e-88b4-f99b9ff43dee None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:18.766012 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cd3b13-4b7b-46db-90ae-9ee791a79c68 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:18.766113 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d135ae4-8765-440e-88b4-f99b9ff43dee None admin] PATH_INFO: `/v3/users` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:18.766737 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d135ae4-8765-440e-88b4-f99b9ff43dee None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:18.768188 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d135ae4-8765-440e-88b4-f99b9ff43dee None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:18.802499 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e4c62e-3979-4646-8a8b-5bf341c3344f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:18.803244 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e4c62e-3979-4646-8a8b-5bf341c3344f None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:18.803593 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e4c62e-3979-4646-8a8b-5bf341c3344f None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:18.803936 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e4c62e-3979-4646-8a8b-5bf341c3344f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:18.814722 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e4c62e-3979-4646-8a8b-5bf341c3344f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:18.816180 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e4c62e-3979-4646-8a8b-5bf341c3344f None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:18.835930 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-c8e4c62e-3979-4646-8a8b-5bf341c3344f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:25:18.835930 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:25:18.835930 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:25:18.835930 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:25:18.835930 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:25:18.835930 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:25:18.835930 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:25:18.835930 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:25:18.835930 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:25:18.835930 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:25:18.835930 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:25:18.835930 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:25:18.835930 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:25:18.835930 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:25:18.835930 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:25:18.840557 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:25:18.840557 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:25:18.840557 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:25:18.840557 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:25:18.840557 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:25:18.840557 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:25:18.840557 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:25:18.840557 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:25:18.840557 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 01 15:25:18.840557 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:25:18.840557 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:25:18.840557 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:25:18.840557 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:25:18.840557 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:25:18.840557 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:25:18.840557 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:25:18.840557 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:25:18.841456 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:25:18.841456 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:25:18.841456 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:25:18.841456 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 01 15:25:18.841456 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 236/468] 10.222.0.102 () {56 vars in 1113 bytes} [Mon Aug 1 15:25:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:25:18.841456 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e4c62e-3979-4646-8a8b-5bf341c3344f None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:18.863413 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 233/469] 10.222.0.102 () {60 vars in 1137 bytes} [Mon Aug 1 15:25:18 2022] POST /identity/v3/users => generated 249 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:25:18.874072 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d135ae4-8765-440e-88b4-f99b9ff43dee None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:18.892196 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:18.936505 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:18.997159 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e4c62e-3979-4646-8a8b-5bf341c3344f None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:19.035815 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d135ae4-8765-440e-88b4-f99b9ff43dee None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:19.039276 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b213ef-ce1c-4e46-8d6f-930b2ec2134f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:19.039907 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b213ef-ce1c-4e46-8d6f-930b2ec2134f None admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:19.040249 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b213ef-ce1c-4e46-8d6f-930b2ec2134f None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:19.040533 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b213ef-ce1c-4e46-8d6f-930b2ec2134f None admin] PATH_INFO: `/v3/users` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:19.041259 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b213ef-ce1c-4e46-8d6f-930b2ec2134f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:19.042779 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b213ef-ce1c-4e46-8d6f-930b2ec2134f None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:19.073380 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3736856-1952-4d18-b750-99980a55e554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:19.074029 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3736856-1952-4d18-b750-99980a55e554 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:19.074327 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3736856-1952-4d18-b750-99980a55e554 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:19.074579 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3736856-1952-4d18-b750-99980a55e554 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:19.086823 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3736856-1952-4d18-b750-99980a55e554 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:19.088318 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3736856-1952-4d18-b750-99980a55e554 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:19.103067 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-c3736856-1952-4d18-b750-99980a55e554 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:25:19.103067 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:25:19.103067 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:25:19.103067 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:25:19.103067 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:25:19.103067 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:25:19.103067 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:25:19.103067 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:25:19.103067 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:25:19.103067 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:25:19.103067 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:25:19.103067 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:25:19.103067 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:25:19.103067 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:25:19.103067 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:25:19.103978 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:25:19.103978 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:25:19.103978 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:25:19.103978 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:25:19.103978 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:25:19.103978 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:25:19.103978 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:25:19.103978 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:25:19.103978 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 01 15:25:19.103978 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:25:19.103978 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:25:19.103978 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:25:19.103978 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:25:19.103978 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:25:19.103978 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:25:19.103978 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:25:19.103978 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:25:19.105209 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:25:19.105209 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:25:19.105209 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:25:19.105209 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 01 15:25:19.105209 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 234/470] 10.222.0.102 () {56 vars in 1113 bytes} [Mon Aug 1 15:25:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:25:19.105553 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3736856-1952-4d18-b750-99980a55e554 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:19.148618 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 237/471] 10.222.0.102 () {60 vars in 1137 bytes} [Mon Aug 1 15:25:18 2022] POST /identity/v3/users => generated 247 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:25:19.149804 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b213ef-ce1c-4e46-8d6f-930b2ec2134f None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:19.247019 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:19.265744 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:19.287434 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b213ef-ce1c-4e46-8d6f-930b2ec2134f None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:19.291973 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3736856-1952-4d18-b750-99980a55e554 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:19.331068 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383661db-2974-4fe1-a09d-8398d92c8c1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:19.331956 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383661db-2974-4fe1-a09d-8398d92c8c1a None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:19.332411 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383661db-2974-4fe1-a09d-8398d92c8c1a None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:19.332870 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383661db-2974-4fe1-a09d-8398d92c8c1a None admin] PATH_INFO: `/v3/domains` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:19.333836 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383661db-2974-4fe1-a09d-8398d92c8c1a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:25:19.334952 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383661db-2974-4fe1-a09d-8398d92c8c1a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:19.336872 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383661db-2974-4fe1-a09d-8398d92c8c1a None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:19.352093 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 238/472] 10.222.0.102 () {56 vars in 1114 bytes} [Mon Aug 1 15:25:19 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:19.359067 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383661db-2974-4fe1-a09d-8398d92c8c1a None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:19.378777 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59be34f5-1496-4f1c-98f8-b21b7c5eb1c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:19.379674 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59be34f5-1496-4f1c-98f8-b21b7c5eb1c0 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:19.380515 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59be34f5-1496-4f1c-98f8-b21b7c5eb1c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:19.380983 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59be34f5-1496-4f1c-98f8-b21b7c5eb1c0 None admin] PATH_INFO: `/v3/domains` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:19.381889 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59be34f5-1496-4f1c-98f8-b21b7c5eb1c0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:25:19.382423 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59be34f5-1496-4f1c-98f8-b21b7c5eb1c0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:19.384638 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59be34f5-1496-4f1c-98f8-b21b7c5eb1c0 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:19.407140 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 235/473] 10.222.0.102 () {56 vars in 1114 bytes} [Mon Aug 1 15:25:19 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:19.407140 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8c3398-1b31-4988-832f-adb433e95cd9 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:19.407140 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8c3398-1b31-4988-832f-adb433e95cd9 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:19.407140 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8c3398-1b31-4988-832f-adb433e95cd9 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:19.408507 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 236/474] 10.222.0.102 () {54 vars in 931 bytes} [Mon Aug 1 15:25:19 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 15:25:19.409193 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8c3398-1b31-4988-832f-adb433e95cd9 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:19.518292 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383661db-2974-4fe1-a09d-8398d92c8c1a None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:19.537396 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8c3398-1b31-4988-832f-adb433e95cd9 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:19.556890 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd4c1a0-22e4-4074-b3c7-44f2b96e7312 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:19.557399 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd4c1a0-22e4-4074-b3c7-44f2b96e7312 None admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:19.557678 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd4c1a0-22e4-4074-b3c7-44f2b96e7312 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:19.557950 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd4c1a0-22e4-4074-b3c7-44f2b96e7312 None admin] PATH_INFO: `/v3/users` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:19.558691 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd4c1a0-22e4-4074-b3c7-44f2b96e7312 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:19.560372 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd4c1a0-22e4-4074-b3c7-44f2b96e7312 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:19.579748 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d36e8d0-1044-4cab-8a7b-a896b276aea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:19.580363 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d36e8d0-1044-4cab-8a7b-a896b276aea9 None admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:19.580640 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d36e8d0-1044-4cab-8a7b-a896b276aea9 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:19.598508 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d36e8d0-1044-4cab-8a7b-a896b276aea9 None admin] PATH_INFO: `/v3/users` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:19.598508 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d36e8d0-1044-4cab-8a7b-a896b276aea9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:19.598508 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d36e8d0-1044-4cab-8a7b-a896b276aea9 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:19.676716 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:19.682604 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 239/475] 10.222.0.102 () {60 vars in 1137 bytes} [Mon Aug 1 15:25:19 2022] POST /identity/v3/users => generated 250 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 15:25:19.684075 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f07cfc-c561-4197-a1ff-e20e75fc6011 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:19.684558 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f07cfc-c561-4197-a1ff-e20e75fc6011 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:19.684994 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f07cfc-c561-4197-a1ff-e20e75fc6011 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:19.705897 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-93f07cfc-c561-4197-a1ff-e20e75fc6011 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:25:19.707411 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-93f07cfc-c561-4197-a1ff-e20e75fc6011 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:25:19.708321 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 237/476] 10.222.0.102 () {60 vars in 1137 bytes} [Mon Aug 1 15:25:19 2022] POST /identity/v3/users => generated 249 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:25:19.811595 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 240/477] 10.222.0.102 () {58 vars in 1028 bytes} [Mon Aug 1 15:25:19 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 15:25:19.850489 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d36e8d0-1044-4cab-8a7b-a896b276aea9 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:19.854415 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:19.972498 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d36e8d0-1044-4cab-8a7b-a896b276aea9 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:20.009057 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd97dc9a-6cb0-4919-95dd-09df44d80feb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:20.009682 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd97dc9a-6cb0-4919-95dd-09df44d80feb None admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:20.009966 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd97dc9a-6cb0-4919-95dd-09df44d80feb None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:20.010242 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd97dc9a-6cb0-4919-95dd-09df44d80feb None admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:20.010955 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd97dc9a-6cb0-4919-95dd-09df44d80feb None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:20.012330 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd97dc9a-6cb0-4919-95dd-09df44d80feb None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:20.051498 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.sql.core [None req-fd97dc9a-6cb0-4919-95dd-09df44d80feb None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 01 15:25:20.051498 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 01 15:25:20.051498 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [parameters: {'id': 'a3871bcd142142c6840fd79392b33646', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 01 15:25:20.051498 dv-cinder-843277-7-smb devstack@keystone.service[80353]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80353) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 01 15:25:20.068614 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-fd97dc9a-6cb0-4919-95dd-09df44d80feb None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 01 15:25:20.068614 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:25:20.068614 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 01 15:25:20.068614 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 01 15:25:20.068614 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 01 15:25:20.068614 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 01 15:25:20.068614 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 01 15:25:20.068614 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application result = self._query(query) Aug 01 15:25:20.068614 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 01 15:25:20.068614 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application conn.query(q) Aug 01 15:25:20.068614 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 01 15:25:20.068614 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 01 15:25:20.068614 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 01 15:25:20.068614 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application result.read() Aug 01 15:25:20.068614 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 01 15:25:20.069624 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 01 15:25:20.069624 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 01 15:25:20.069624 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 01 15:25:20.069624 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 01 15:25:20.069624 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 01 15:25:20.069624 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 01 15:25:20.069624 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 01 15:25:20.069624 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 01 15:25:20.069624 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 01 15:25:20.069624 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 01 15:25:20.069624 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 01 15:25:20.069624 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:25:20.069624 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 01 15:25:20.069624 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 01 15:25:20.069624 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Aug 01 15:25:20.069624 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return ref.to_dict() Aug 01 15:25:20.069624 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 01 15:25:20.069624 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application next(self.gen) Aug 01 15:25:20.070567 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 01 15:25:20.070567 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application yield resource Aug 01 15:25:20.070567 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 01 15:25:20.070567 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application next(self.gen) Aug 01 15:25:20.070567 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 01 15:25:20.070567 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application self.session.rollback() Aug 01 15:25:20.070567 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 01 15:25:20.070567 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application self.force_reraise() Aug 01 15:25:20.070567 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 01 15:25:20.070567 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise self.value Aug 01 15:25:20.070567 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 01 15:25:20.070567 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 01 15:25:20.070567 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 01 15:25:20.070567 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application session.commit() Aug 01 15:25:20.070567 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 01 15:25:20.070567 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 01 15:25:20.070567 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 01 15:25:20.071418 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application self._prepare_impl() Aug 01 15:25:20.071418 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 01 15:25:20.071418 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application self.session.flush() Aug 01 15:25:20.071418 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 01 15:25:20.071418 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application self._flush(objects) Aug 01 15:25:20.071418 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 01 15:25:20.071418 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 01 15:25:20.071418 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 01 15:25:20.071418 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application compat.raise_( Aug 01 15:25:20.071418 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 01 15:25:20.071418 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception Aug 01 15:25:20.071418 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 01 15:25:20.071418 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application flush_context.execute() Aug 01 15:25:20.071418 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 01 15:25:20.071418 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rec.execute(self) Aug 01 15:25:20.071418 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 01 15:25:20.071418 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 01 15:25:20.072302 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 01 15:25:20.072302 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 01 15:25:20.072302 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 01 15:25:20.072302 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 01 15:25:20.072302 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 01 15:25:20.072302 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 01 15:25:20.072302 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 01 15:25:20.072302 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 01 15:25:20.072302 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 01 15:25:20.072302 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 01 15:25:20.072302 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 01 15:25:20.072302 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 01 15:25:20.072302 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 01 15:25:20.072302 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 01 15:25:20.072302 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 01 15:25:20.072302 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception Aug 01 15:25:20.074415 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 01 15:25:20.074415 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 01 15:25:20.074415 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 01 15:25:20.074415 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 01 15:25:20.074415 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 01 15:25:20.074415 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application result = self._query(query) Aug 01 15:25:20.074415 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 01 15:25:20.074415 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application conn.query(q) Aug 01 15:25:20.074415 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 01 15:25:20.074415 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 01 15:25:20.074415 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 01 15:25:20.074415 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application result.read() Aug 01 15:25:20.074415 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 01 15:25:20.074415 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 01 15:25:20.074415 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 01 15:25:20.074415 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 01 15:25:20.077184 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 01 15:25:20.077184 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 01 15:25:20.077184 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 01 15:25:20.077184 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 01 15:25:20.077184 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 01 15:25:20.077184 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 01 15:25:20.077184 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [parameters: {'id': 'a3871bcd142142c6840fd79392b33646', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 01 15:25:20.077184 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 01 15:25:20.077184 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 01 15:25:20.077184 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 15:25:20.077184 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 01 15:25:20.077184 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:25:20.077184 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:25:20.077184 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:25:20.077184 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:25:20.077184 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:25:20.079286 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:25:20.079286 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:25:20.079286 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:25:20.079286 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:25:20.079286 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:25:20.079286 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:25:20.079286 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Aug 01 15:25:20.079286 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Aug 01 15:25:20.079286 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:25:20.079286 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:25:20.079286 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Aug 01 15:25:20.079286 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Aug 01 15:25:20.079286 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 01 15:25:20.079286 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 01 15:25:20.079286 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 01 15:25:20.079286 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 01 15:25:20.081304 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 238/478] 10.222.0.102 () {60 vars in 1136 bytes} [Mon Aug 1 15:25:19 2022] POST /identity/v3/roles => generated 144 bytes in 220 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:25:20.081444 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f07cfc-c561-4197-a1ff-e20e75fc6011 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:20.214335 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f07cfc-c561-4197-a1ff-e20e75fc6011 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:20.252158 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:20.259664 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7460c9f9-17b8-47d6-a701-8f1405b90135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:20.260311 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7460c9f9-17b8-47d6-a701-8f1405b90135 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:20.260593 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7460c9f9-17b8-47d6-a701-8f1405b90135 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:20.260887 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7460c9f9-17b8-47d6-a701-8f1405b90135 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:20.276212 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7460c9f9-17b8-47d6-a701-8f1405b90135 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:25:20.281306 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-7460c9f9-17b8-47d6-a701-8f1405b90135 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 01 15:25:20.281306 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:25:20.281306 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:25:20.281306 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:25:20.281306 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:25:20.281306 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:25:20.281306 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:25:20.281306 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:25:20.281306 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:25:20.281306 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:25:20.281306 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:25:20.281306 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:25:20.281306 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:25:20.281306 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:25:20.281306 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:25:20.281306 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:25:20.282157 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:25:20.282157 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:25:20.282157 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:25:20.282157 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:25:20.282157 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:25:20.282157 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:25:20.282157 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:25:20.282157 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:25:20.282157 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:25:20.282157 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:25:20.282157 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:25:20.282157 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 01 15:25:20.282157 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:25:20.282157 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:25:20.282157 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:25:20.282157 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:25:20.282967 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:25:20.282967 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:25:20.282967 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:25:20.282967 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:25:20.282967 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:25:20.282967 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:25:20.282967 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:25:20.282967 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:25:20.282967 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:25:20.282967 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:25:20.282967 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 01 15:25:20.282967 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 01 15:25:20.282967 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 241/479] 10.222.0.102 () {56 vars in 1119 bytes} [Mon Aug 1 15:25:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:25:20.288699 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd97dc9a-6cb0-4919-95dd-09df44d80feb None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:20.372281 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:20.420547 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd97dc9a-6cb0-4919-95dd-09df44d80feb None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:20.469694 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a85329-d12d-4977-80ca-cc57754178bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:20.470333 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a85329-d12d-4977-80ca-cc57754178bb None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:20.470617 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a85329-d12d-4977-80ca-cc57754178bb None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:20.470891 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a85329-d12d-4977-80ca-cc57754178bb None admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:20.471803 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a85329-d12d-4977-80ca-cc57754178bb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:25:20.472118 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a85329-d12d-4977-80ca-cc57754178bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:20.473546 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a85329-d12d-4977-80ca-cc57754178bb None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:20.482408 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 239/480] 10.222.0.102 () {56 vars in 1116 bytes} [Mon Aug 1 15:25:20 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:21.050498 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095b17af-e471-495a-b786-23002d319eea None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:21.050789 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095b17af-e471-495a-b786-23002d319eea None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:21.051065 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095b17af-e471-495a-b786-23002d319eea None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:21.052578 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 242/481] 10.222.0.102 () {54 vars in 931 bytes} [Mon Aug 1 15:25:21 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 15:25:21.058573 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6155ee8d-5605-4f84-9332-35994ae5e3a5 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:21.059415 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6155ee8d-5605-4f84-9332-35994ae5e3a5 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:21.059906 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6155ee8d-5605-4f84-9332-35994ae5e3a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:21.080220 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-6155ee8d-5605-4f84-9332-35994ae5e3a5 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:25:21.081741 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-6155ee8d-5605-4f84-9332-35994ae5e3a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:25:21.174105 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 240/482] 10.222.0.102 () {58 vars in 1028 bytes} [Mon Aug 1 15:25:21 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 15:25:21.209690 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095b17af-e471-495a-b786-23002d319eea None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:21.330768 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095b17af-e471-495a-b786-23002d319eea None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:21.366417 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b47c8f4-b7db-4a8c-970c-b54ed66beb3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:21.367565 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b47c8f4-b7db-4a8c-970c-b54ed66beb3c None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:21.367849 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b47c8f4-b7db-4a8c-970c-b54ed66beb3c None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:21.368119 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b47c8f4-b7db-4a8c-970c-b54ed66beb3c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:21.378811 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b47c8f4-b7db-4a8c-970c-b54ed66beb3c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:25:21.384172 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-2b47c8f4-b7db-4a8c-970c-b54ed66beb3c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 01 15:25:21.384172 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:25:21.384172 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:25:21.384172 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:25:21.384172 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:25:21.384172 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:25:21.384172 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:25:21.384172 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:25:21.384172 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:25:21.384172 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:25:21.384172 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:25:21.384172 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:25:21.384172 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:25:21.384172 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:25:21.384172 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:25:21.384172 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:25:21.385209 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:25:21.385209 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:25:21.385209 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:25:21.385209 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:25:21.385209 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:25:21.385209 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:25:21.385209 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:25:21.385209 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:25:21.385209 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:25:21.385209 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:25:21.385209 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:25:21.385209 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 01 15:25:21.385209 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:25:21.385209 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:25:21.385209 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:25:21.385209 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:25:21.386613 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:25:21.386613 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:25:21.386613 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:25:21.386613 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:25:21.386613 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:25:21.386613 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:25:21.386613 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:25:21.386613 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:25:21.386613 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:25:21.386613 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:25:21.386613 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 01 15:25:21.386613 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 01 15:25:21.386613 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 243/483] 10.222.0.102 () {56 vars in 1107 bytes} [Mon Aug 1 15:25:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:25:21.393961 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6155ee8d-5605-4f84-9332-35994ae5e3a5 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:21.477793 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:21.526788 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6155ee8d-5605-4f84-9332-35994ae5e3a5 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:21.561994 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a4a704-dbad-4e49-b134-cb122d058778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:21.562623 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a4a704-dbad-4e49-b134-cb122d058778 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:21.562903 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a4a704-dbad-4e49-b134-cb122d058778 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:21.563177 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a4a704-dbad-4e49-b134-cb122d058778 None admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:21.563901 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a4a704-dbad-4e49-b134-cb122d058778 None admin] RBAC: Adding query filter params (name=service) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:25:21.564205 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a4a704-dbad-4e49-b134-cb122d058778 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:21.565625 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a4a704-dbad-4e49-b134-cb122d058778 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:21.575040 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 241/484] 10.222.0.102 () {56 vars in 1108 bytes} [Mon Aug 1 15:25:21 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:21.586061 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b47c8f4-b7db-4a8c-970c-b54ed66beb3c None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:21.654411 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:21.710055 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b47c8f4-b7db-4a8c-970c-b54ed66beb3c None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:21.728256 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dd6acb-3a7b-494e-8c6e-8db6e5ca8658 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:21.728619 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dd6acb-3a7b-494e-8c6e-8db6e5ca8658 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:21.729138 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dd6acb-3a7b-494e-8c6e-8db6e5ca8658 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:21.731173 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 242/485] 10.222.0.102 () {54 vars in 931 bytes} [Mon Aug 1 15:25:21 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 15:25:21.736694 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be98983-31b1-4341-81fa-3426f90c3d08 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:21.737004 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be98983-31b1-4341-81fa-3426f90c3d08 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:21.737275 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be98983-31b1-4341-81fa-3426f90c3d08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:21.756039 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-2be98983-31b1-4341-81fa-3426f90c3d08 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:25:21.757246 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-2be98983-31b1-4341-81fa-3426f90c3d08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:25:21.813268 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f404148-07c5-46cc-a300-3884ea8b8dee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:21.813899 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f404148-07c5-46cc-a300-3884ea8b8dee None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:21.814176 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f404148-07c5-46cc-a300-3884ea8b8dee None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:21.814487 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f404148-07c5-46cc-a300-3884ea8b8dee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:21.828996 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f404148-07c5-46cc-a300-3884ea8b8dee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:21.828996 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f404148-07c5-46cc-a300-3884ea8b8dee None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:21.843256 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-0f404148-07c5-46cc-a300-3884ea8b8dee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:25:21.843256 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:25:21.843256 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:25:21.843256 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:25:21.843256 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:25:21.843256 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:25:21.843256 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:25:21.843256 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:25:21.843256 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:25:21.843256 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:25:21.843256 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:25:21.843256 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:25:21.843256 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:25:21.843256 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:25:21.843256 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:25:21.844149 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:25:21.844149 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:25:21.844149 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:25:21.844149 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:25:21.844149 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:25:21.844149 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:25:21.844149 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:25:21.844149 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:25:21.844149 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 01 15:25:21.844149 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:25:21.844149 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:25:21.844149 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:25:21.844149 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:25:21.844149 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:25:21.844149 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:25:21.844149 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:25:21.844149 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:25:21.845103 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:25:21.845103 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:25:21.845103 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:25:21.845103 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 01 15:25:21.845103 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 244/486] 10.222.0.102 () {56 vars in 1113 bytes} [Mon Aug 1 15:25:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:25:21.854045 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f404148-07c5-46cc-a300-3884ea8b8dee None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:21.899156 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 243/487] 10.222.0.102 () {58 vars in 1028 bytes} [Mon Aug 1 15:25:21 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 01 15:25:21.974794 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be98983-31b1-4341-81fa-3426f90c3d08 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:21.999782 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f404148-07c5-46cc-a300-3884ea8b8dee None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:22.002548 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:22.052875 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bee7063-dbba-417a-a102-3452de60d9dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:22.052875 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bee7063-dbba-417a-a102-3452de60d9dd None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:22.052875 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bee7063-dbba-417a-a102-3452de60d9dd None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:22.052875 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bee7063-dbba-417a-a102-3452de60d9dd None admin] PATH_INFO: `/v3/domains` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:22.053276 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bee7063-dbba-417a-a102-3452de60d9dd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:25:22.053276 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bee7063-dbba-417a-a102-3452de60d9dd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:22.053276 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bee7063-dbba-417a-a102-3452de60d9dd None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:22.064570 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 245/488] 10.222.0.102 () {56 vars in 1114 bytes} [Mon Aug 1 15:25:21 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:22.069580 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bee7063-dbba-417a-a102-3452de60d9dd None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:22.078239 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:22.183721 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be98983-31b1-4341-81fa-3426f90c3d08 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:22.244442 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a04bd2a-ab53-4ce8-b959-4c9bb9590f92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:22.245569 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a04bd2a-ab53-4ce8-b959-4c9bb9590f92 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:22.246146 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a04bd2a-ab53-4ce8-b959-4c9bb9590f92 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:22.246650 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a04bd2a-ab53-4ce8-b959-4c9bb9590f92 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:22.248990 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bee7063-dbba-417a-a102-3452de60d9dd None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:22.259222 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a04bd2a-ab53-4ce8-b959-4c9bb9590f92 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:25:22.264876 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-1a04bd2a-ab53-4ce8-b959-4c9bb9590f92 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 01 15:25:22.264876 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:25:22.264876 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:25:22.264876 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:25:22.264876 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:25:22.264876 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:25:22.264876 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:25:22.264876 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:25:22.264876 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:25:22.264876 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:25:22.264876 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:25:22.264876 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:25:22.264876 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:25:22.264876 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:25:22.264876 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:25:22.264876 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:25:22.265759 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:25:22.265759 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:25:22.265759 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:25:22.265759 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:25:22.265759 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:25:22.265759 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:25:22.265759 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:25:22.265759 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:25:22.265759 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:25:22.265759 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:25:22.265759 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:25:22.265759 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 01 15:25:22.265759 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:25:22.265759 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:25:22.265759 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:25:22.265759 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:25:22.266561 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:25:22.266561 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:25:22.266561 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:25:22.266561 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:25:22.266561 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:25:22.266561 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:25:22.266561 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:25:22.266561 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:25:22.266561 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:25:22.266561 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:25:22.266561 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 01 15:25:22.266561 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 01 15:25:22.269188 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 244/489] 10.222.0.102 () {56 vars in 1107 bytes} [Mon Aug 1 15:25:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:25:22.272913 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9101e5e4-4b11-49e3-85ee-51536cf0b60e None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:22.273980 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9101e5e4-4b11-49e3-85ee-51536cf0b60e None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:22.274468 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9101e5e4-4b11-49e3-85ee-51536cf0b60e None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:22.276319 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 245/490] 10.222.0.102 () {54 vars in 931 bytes} [Mon Aug 1 15:25:22 2022] GET /identity => generated 271 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 15:25:22.281376 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9101e5e4-4b11-49e3-85ee-51536cf0b60e None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:22.291171 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724538a9-f452-4c8e-b331-fb5368d1a4c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:22.291994 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724538a9-f452-4c8e-b331-fb5368d1a4c3 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:22.292105 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724538a9-f452-4c8e-b331-fb5368d1a4c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:22.292380 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724538a9-f452-4c8e-b331-fb5368d1a4c3 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:22.300476 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724538a9-f452-4c8e-b331-fb5368d1a4c3 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:22.301991 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724538a9-f452-4c8e-b331-fb5368d1a4c3 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:22.315069 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-724538a9-f452-4c8e-b331-fb5368d1a4c3 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 01 15:25:22.315069 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:25:22.315069 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:25:22.315069 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:25:22.315069 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:25:22.315069 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:25:22.315069 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:25:22.315069 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:25:22.315069 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:25:22.315069 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:25:22.315069 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:25:22.315069 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:25:22.315069 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 15:25:22.315069 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 15:25:22.315069 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 15:25:22.315069 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 15:25:22.316021 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:25:22.316021 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:25:22.316021 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 15:25:22.316021 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 15:25:22.316021 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 15:25:22.316021 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 15:25:22.316021 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:25:22.316021 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:25:22.316021 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:25:22.316021 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:25:22.316021 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:25:22.316021 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 01 15:25:22.316021 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:25:22.316021 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:25:22.316021 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:25:22.316021 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:25:22.316021 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:25:22.316021 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:25:22.316979 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:25:22.316979 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:25:22.316979 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 15:25:22.316979 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 15:25:22.316979 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 15:25:22.316979 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 15:25:22.316979 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 15:25:22.316979 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 15:25:22.316979 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 01 15:25:22.316979 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 01 15:25:22.316979 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 246/491] 10.222.0.102 () {56 vars in 1104 bytes} [Mon Aug 1 15:25:22 2022] GET /identity/v3/users/glance => generated 84 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:25:22.318029 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674a7aad-0560-4b59-8d40-cf0bbe3c6f94 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:22.318188 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674a7aad-0560-4b59-8d40-cf0bbe3c6f94 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:22.318453 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674a7aad-0560-4b59-8d40-cf0bbe3c6f94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:22.337777 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-674a7aad-0560-4b59-8d40-cf0bbe3c6f94 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:25:22.338997 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-674a7aad-0560-4b59-8d40-cf0bbe3c6f94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:25:22.356958 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:22.403225 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9101e5e4-4b11-49e3-85ee-51536cf0b60e None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:22.416878 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 247/492] 10.222.0.102 () {58 vars in 1028 bytes} [Mon Aug 1 15:25:22 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 15:25:22.416878 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674a7aad-0560-4b59-8d40-cf0bbe3c6f94 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:22.422167 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:22.466771 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b73fe4-ee6e-4484-9f6e-e81a1f374530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:22.467996 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b73fe4-ee6e-4484-9f6e-e81a1f374530 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:22.468477 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b73fe4-ee6e-4484-9f6e-e81a1f374530 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:22.469071 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b73fe4-ee6e-4484-9f6e-e81a1f374530 None admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:22.470036 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b73fe4-ee6e-4484-9f6e-e81a1f374530 None admin] RBAC: Adding query filter params (name=service) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:25:22.470618 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b73fe4-ee6e-4484-9f6e-e81a1f374530 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:22.472577 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b73fe4-ee6e-4484-9f6e-e81a1f374530 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:22.484513 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 246/493] 10.222.0.102 () {56 vars in 1108 bytes} [Mon Aug 1 15:25:22 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:22.485699 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b73fe4-ee6e-4484-9f6e-e81a1f374530 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:22.520427 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674a7aad-0560-4b59-8d40-cf0bbe3c6f94 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:22.556196 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16251c41-fbef-4f9b-ab15-7e8671eee228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:22.556807 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16251c41-fbef-4f9b-ab15-7e8671eee228 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:22.557112 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16251c41-fbef-4f9b-ab15-7e8671eee228 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:22.557379 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16251c41-fbef-4f9b-ab15-7e8671eee228 None admin] PATH_INFO: `/v3/users` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:22.558164 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16251c41-fbef-4f9b-ab15-7e8671eee228 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:25:22.558465 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16251c41-fbef-4f9b-ab15-7e8671eee228 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:22.560100 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16251c41-fbef-4f9b-ab15-7e8671eee228 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:22.598949 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 248/494] 10.222.0.102 () {56 vars in 1142 bytes} [Mon Aug 1 15:25:22 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 374 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:22.600000 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16251c41-fbef-4f9b-ab15-7e8671eee228 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:22.603141 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b73fe4-ee6e-4484-9f6e-e81a1f374530 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:22.611973 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:22.641351 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dc741a-9636-468d-b564-b36449881527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:22.642357 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dc741a-9636-468d-b564-b36449881527 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:22.642862 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dc741a-9636-468d-b564-b36449881527 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:22.643361 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dc741a-9636-468d-b564-b36449881527 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:22.656915 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5dc741a-9636-468d-b564-b36449881527 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:25:22.663158 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-e5dc741a-9636-468d-b564-b36449881527 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 01 15:25:22.663158 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:25:22.663158 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:25:22.663158 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:25:22.663158 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:25:22.663158 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:25:22.663158 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:25:22.663158 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:25:22.663158 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:25:22.663158 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:25:22.663158 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:25:22.663158 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:25:22.663158 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:25:22.663158 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:25:22.663158 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:25:22.663158 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:25:22.664086 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:25:22.664086 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:25:22.664086 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:25:22.664086 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:25:22.664086 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:25:22.664086 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:25:22.664086 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:25:22.664086 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:25:22.664086 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:25:22.664086 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:25:22.664086 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:25:22.664086 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 01 15:25:22.664086 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:25:22.664086 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:25:22.664086 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:25:22.664086 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:25:22.664912 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:25:22.664912 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:25:22.664912 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:25:22.664912 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:25:22.664912 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:25:22.664912 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:25:22.664912 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:25:22.664912 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:25:22.664912 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:25:22.664912 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:25:22.664912 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 01 15:25:22.664912 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 01 15:25:22.672403 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 247/495] 10.222.0.102 () {56 vars in 1107 bytes} [Mon Aug 1 15:25:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:25:22.673759 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dc741a-9636-468d-b564-b36449881527 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:22.704617 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16251c41-fbef-4f9b-ab15-7e8671eee228 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:22.709735 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:22.739748 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d919f96-da05-4b7b-a02c-516c9e916b35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:22.740389 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d919f96-da05-4b7b-a02c-516c9e916b35 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:22.740724 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d919f96-da05-4b7b-a02c-516c9e916b35 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:22.741032 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d919f96-da05-4b7b-a02c-516c9e916b35 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:22.752017 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d919f96-da05-4b7b-a02c-516c9e916b35 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:22.753657 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d919f96-da05-4b7b-a02c-516c9e916b35 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:22.769143 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-7d919f96-da05-4b7b-a02c-516c9e916b35 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:25:22.769143 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:25:22.769143 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:25:22.769143 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:25:22.769143 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:25:22.769143 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:25:22.769143 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:25:22.769143 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:25:22.769143 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:25:22.769143 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:25:22.769143 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:25:22.769143 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:25:22.769143 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:25:22.769143 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:25:22.769143 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:25:22.770019 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:25:22.770019 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:25:22.770019 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:25:22.770019 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:25:22.770019 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:25:22.770019 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:25:22.770019 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:25:22.770019 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:25:22.770019 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 01 15:25:22.770019 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:25:22.770019 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:25:22.770019 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:25:22.770019 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:25:22.770019 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:25:22.770019 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:25:22.770019 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:25:22.770019 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:25:22.770931 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:25:22.770931 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:25:22.770931 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:25:22.770931 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 01 15:25:22.770931 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 249/496] 10.222.0.102 () {56 vars in 1113 bytes} [Mon Aug 1 15:25:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:25:22.771250 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d919f96-da05-4b7b-a02c-516c9e916b35 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:22.794729 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dc741a-9636-468d-b564-b36449881527 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:22.831904 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174a5675-b082-496e-b75e-7bdd7f0aadcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:22.832954 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174a5675-b082-496e-b75e-7bdd7f0aadcb None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:22.833487 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174a5675-b082-496e-b75e-7bdd7f0aadcb None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:22.833955 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174a5675-b082-496e-b75e-7bdd7f0aadcb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:22.835462 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:22.881446 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d919f96-da05-4b7b-a02c-516c9e916b35 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:22.917126 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85630fde-44e4-41b5-a389-098cc4eec3a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:22.917738 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85630fde-44e4-41b5-a389-098cc4eec3a4 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:22.918012 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85630fde-44e4-41b5-a389-098cc4eec3a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:22.918282 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85630fde-44e4-41b5-a389-098cc4eec3a4 None admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:22.918984 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85630fde-44e4-41b5-a389-098cc4eec3a4 None admin] RBAC: Adding query filter params (name=service) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:25:22.919283 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85630fde-44e4-41b5-a389-098cc4eec3a4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:22.920657 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85630fde-44e4-41b5-a389-098cc4eec3a4 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:22.924913 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174a5675-b082-496e-b75e-7bdd7f0aadcb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:22.927207 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174a5675-b082-496e-b75e-7bdd7f0aadcb None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:22.933717 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 250/497] 10.222.0.102 () {56 vars in 1108 bytes} [Mon Aug 1 15:25:22 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:22.933717 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cd5759-3e6e-481f-8b91-1af1dd1dd8b4 None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:22.933717 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cd5759-3e6e-481f-8b91-1af1dd1dd8b4 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:22.933717 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cd5759-3e6e-481f-8b91-1af1dd1dd8b4 None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:22.933717 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 251/498] 10.222.0.102 () {54 vars in 931 bytes} [Mon Aug 1 15:25:22 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 15:25:22.933717 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cd5759-3e6e-481f-8b91-1af1dd1dd8b4 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:22.968793 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:23.042743 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 248/499] 10.222.0.102 () {58 vars in 1287 bytes} [Mon Aug 1 15:25:22 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 15:25:23.043479 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174a5675-b082-496e-b75e-7bdd7f0aadcb None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:23.055212 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cd5759-3e6e-481f-8b91-1af1dd1dd8b4 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:23.083750 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:23.095761 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f335909-52fb-48f4-aefe-3fd3382e4375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:23.096659 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f335909-52fb-48f4-aefe-3fd3382e4375 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:23.096977 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f335909-52fb-48f4-aefe-3fd3382e4375 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:23.097353 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f335909-52fb-48f4-aefe-3fd3382e4375 None admin] PATH_INFO: `/v3/domains` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:23.097931 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f335909-52fb-48f4-aefe-3fd3382e4375 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:25:23.098228 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f335909-52fb-48f4-aefe-3fd3382e4375 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:23.099610 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f335909-52fb-48f4-aefe-3fd3382e4375 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:23.111532 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 252/500] 10.222.0.102 () {56 vars in 1114 bytes} [Mon Aug 1 15:25:22 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:23.112487 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5831b1b2-0b47-49b1-9848-f13dd0e4f65b None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:23.112744 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5831b1b2-0b47-49b1-9848-f13dd0e4f65b None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:23.115145 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5831b1b2-0b47-49b1-9848-f13dd0e4f65b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:23.134048 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-5831b1b2-0b47-49b1-9848-f13dd0e4f65b None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:25:23.135218 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-5831b1b2-0b47-49b1-9848-f13dd0e4f65b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:25:23.160120 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174a5675-b082-496e-b75e-7bdd7f0aadcb None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:23.189850 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:23.194543 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f19d8e-2b30-4343-8b88-9319a3b61ff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:23.195240 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f19d8e-2b30-4343-8b88-9319a3b61ff3 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:23.196043 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f19d8e-2b30-4343-8b88-9319a3b61ff3 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:23.196343 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f19d8e-2b30-4343-8b88-9319a3b61ff3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:23.203727 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 253/501] 10.222.0.102 () {58 vars in 1028 bytes} [Mon Aug 1 15:25:23 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 15:25:23.204561 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5831b1b2-0b47-49b1-9848-f13dd0e4f65b None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:23.209692 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f19d8e-2b30-4343-8b88-9319a3b61ff3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:23.211187 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f19d8e-2b30-4343-8b88-9319a3b61ff3 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:23.225712 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-07f19d8e-2b30-4343-8b88-9319a3b61ff3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:25:23.225712 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:25:23.225712 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:25:23.225712 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:25:23.225712 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:25:23.225712 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:25:23.225712 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:25:23.225712 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:25:23.225712 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:25:23.225712 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:25:23.225712 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:25:23.225712 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:25:23.225712 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:25:23.225712 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:25:23.225712 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:25:23.227250 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:25:23.227250 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:25:23.227250 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:25:23.227250 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:25:23.227250 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:25:23.227250 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:25:23.227250 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:25:23.227250 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:25:23.227250 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 01 15:25:23.227250 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:25:23.227250 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:25:23.227250 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:25:23.227250 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:25:23.227250 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:25:23.227250 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:25:23.227250 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:25:23.227250 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:25:23.228313 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:25:23.228313 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:25:23.228313 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:25:23.228313 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 01 15:25:23.228313 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 249/502] 10.222.0.102 () {56 vars in 1113 bytes} [Mon Aug 1 15:25:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:25:23.228613 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f19d8e-2b30-4343-8b88-9319a3b61ff3 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:23.317240 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5831b1b2-0b47-49b1-9848-f13dd0e4f65b None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:23.327586 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f19d8e-2b30-4343-8b88-9319a3b61ff3 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:23.334582 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:23.354874 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffa3289-ddda-4841-9caf-cc2e11393cad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:23.355534 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffa3289-ddda-4841-9caf-cc2e11393cad None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:23.358902 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffa3289-ddda-4841-9caf-cc2e11393cad None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:23.358902 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffa3289-ddda-4841-9caf-cc2e11393cad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:23.361160 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e5be9a-612b-4365-b6a3-b3ad031ad604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:23.361789 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e5be9a-612b-4365-b6a3-b3ad031ad604 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:23.362068 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e5be9a-612b-4365-b6a3-b3ad031ad604 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:23.362339 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e5be9a-612b-4365-b6a3-b3ad031ad604 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:23.366144 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffa3289-ddda-4841-9caf-cc2e11393cad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:23.367615 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffa3289-ddda-4841-9caf-cc2e11393cad None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:23.369630 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e5be9a-612b-4365-b6a3-b3ad031ad604 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:23.371099 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e5be9a-612b-4365-b6a3-b3ad031ad604 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:23.382244 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-8ffa3289-ddda-4841-9caf-cc2e11393cad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:25:23.382244 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:25:23.382244 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:25:23.382244 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:25:23.382244 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:25:23.382244 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:25:23.382244 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:25:23.382244 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:25:23.382244 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:25:23.382244 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:25:23.382244 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:25:23.382244 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:25:23.382244 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:25:23.382244 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:25:23.382244 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:25:23.383804 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:25:23.383804 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:25:23.383804 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:25:23.383804 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:25:23.383804 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:25:23.383804 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:25:23.383804 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:25:23.383804 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:25:23.383804 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 01 15:25:23.383804 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:25:23.383804 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:25:23.383804 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:25:23.383804 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:25:23.383804 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:25:23.383804 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:25:23.383804 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:25:23.383804 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:25:23.384735 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:25:23.384735 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:25:23.384735 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:25:23.384735 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 01 15:25:23.384978 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-86e5be9a-612b-4365-b6a3-b3ad031ad604 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 01 15:25:23.384978 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:25:23.384978 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:25:23.384978 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:25:23.384978 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:25:23.384978 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:25:23.384978 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:25:23.384978 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:25:23.384978 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:25:23.384978 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:25:23.384978 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:25:23.384978 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:25:23.384978 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 15:25:23.384978 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 15:25:23.384978 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 15:25:23.384978 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 15:25:23.385781 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:25:23.385781 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:25:23.385781 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 15:25:23.385781 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 15:25:23.385781 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 15:25:23.385781 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 15:25:23.385781 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:25:23.385781 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:25:23.385781 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:25:23.385781 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:25:23.385781 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:25:23.385781 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 01 15:25:23.385781 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:25:23.385781 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:25:23.385781 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:25:23.385781 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:25:23.385781 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:25:23.385781 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:25:23.387014 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:25:23.387014 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:25:23.387014 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 15:25:23.387014 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 15:25:23.387014 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 15:25:23.387014 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 15:25:23.387014 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 15:25:23.387014 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 15:25:23.387014 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 01 15:25:23.387014 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 01 15:25:23.387521 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 254/503] 10.222.0.102 () {56 vars in 1113 bytes} [Mon Aug 1 15:25:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:25:23.387589 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 250/504] 10.222.0.102 () {56 vars in 1098 bytes} [Mon Aug 1 15:25:23 2022] GET /identity/v3/users/nova => generated 82 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:25:23.387653 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7487bad-366d-4281-8e8e-4146f08dabe5 None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:23.387653 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7487bad-366d-4281-8e8e-4146f08dabe5 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:23.387778 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e5be9a-612b-4365-b6a3-b3ad031ad604 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:23.387862 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7487bad-366d-4281-8e8e-4146f08dabe5 None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:23.388037 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 255/505] 10.222.0.102 () {54 vars in 931 bytes} [Mon Aug 1 15:25:23 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 15:25:23.389068 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7487bad-366d-4281-8e8e-4146f08dabe5 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:23.436621 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:23.489803 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e5be9a-612b-4365-b6a3-b3ad031ad604 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:23.490841 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7487bad-366d-4281-8e8e-4146f08dabe5 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:23.523214 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7722f3-af10-473c-9689-7a242874ac8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:23.524168 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5f7758-9271-466a-9d1f-562c393af962 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:23.524382 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7722f3-af10-473c-9689-7a242874ac8c None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:23.524657 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7722f3-af10-473c-9689-7a242874ac8c None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:23.524774 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5f7758-9271-466a-9d1f-562c393af962 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:23.524951 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7722f3-af10-473c-9689-7a242874ac8c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:23.525067 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5f7758-9271-466a-9d1f-562c393af962 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:23.525336 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5f7758-9271-466a-9d1f-562c393af962 None admin] PATH_INFO: `/v3/domains` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:23.526018 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5f7758-9271-466a-9d1f-562c393af962 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:25:23.526322 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5f7758-9271-466a-9d1f-562c393af962 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:23.527705 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5f7758-9271-466a-9d1f-562c393af962 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:23.535053 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7722f3-af10-473c-9689-7a242874ac8c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:25:23.539122 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 256/506] 10.222.0.102 () {56 vars in 1114 bytes} [Mon Aug 1 15:25:23 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:23.540278 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c3398d-2885-4f71-92c6-5d0f1ef1b593 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:23.540462 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-8b7722f3-af10-473c-9689-7a242874ac8c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 01 15:25:23.540462 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:25:23.540462 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:25:23.540462 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:25:23.540462 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:25:23.540462 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:25:23.540462 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:25:23.540462 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:25:23.540462 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:25:23.540462 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:25:23.540462 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:25:23.540462 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:25:23.540462 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:25:23.540462 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:25:23.540462 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:25:23.540462 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:25:23.541332 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:25:23.541332 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:25:23.541332 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:25:23.541332 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:25:23.541332 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:25:23.541332 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:25:23.541332 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:25:23.541332 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:25:23.541332 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:25:23.541332 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:25:23.541332 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:25:23.541332 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 01 15:25:23.541332 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:25:23.541332 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:25:23.541332 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:25:23.541332 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:25:23.542144 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:25:23.542144 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:25:23.542144 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:25:23.542144 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:25:23.542144 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:25:23.542144 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:25:23.542144 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:25:23.542144 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:25:23.542144 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:25:23.542144 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:25:23.542144 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 01 15:25:23.542144 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 01 15:25:23.542742 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c3398d-2885-4f71-92c6-5d0f1ef1b593 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:23.542742 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c3398d-2885-4f71-92c6-5d0f1ef1b593 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:23.542860 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 251/507] 10.222.0.102 () {56 vars in 1107 bytes} [Mon Aug 1 15:25:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:25:23.542860 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7722f3-af10-473c-9689-7a242874ac8c None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:23.558449 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-00c3398d-2885-4f71-92c6-5d0f1ef1b593 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:25:23.559641 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-00c3398d-2885-4f71-92c6-5d0f1ef1b593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:25:23.580126 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:23.626067 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 257/508] 10.222.0.102 () {58 vars in 1028 bytes} [Mon Aug 1 15:25:23 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 15:25:23.627031 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c3398d-2885-4f71-92c6-5d0f1ef1b593 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:23.642005 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7722f3-af10-473c-9689-7a242874ac8c None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:23.645296 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:23.676044 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d3e71d-2d4b-46b9-b326-908045735a23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:23.676657 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d3e71d-2d4b-46b9-b326-908045735a23 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:23.676975 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d3e71d-2d4b-46b9-b326-908045735a23 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:23.677249 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d3e71d-2d4b-46b9-b326-908045735a23 None admin] PATH_INFO: `/v3/users` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:23.678046 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d3e71d-2d4b-46b9-b326-908045735a23 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:25:23.678351 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d3e71d-2d4b-46b9-b326-908045735a23 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:23.680309 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d3e71d-2d4b-46b9-b326-908045735a23 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:23.717751 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 252/509] 10.222.0.102 () {56 vars in 1138 bytes} [Mon Aug 1 15:25:23 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 370 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:23.718608 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d3e71d-2d4b-46b9-b326-908045735a23 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:23.732067 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c3398d-2885-4f71-92c6-5d0f1ef1b593 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:23.766818 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de85e52-5a0c-4b01-be21-f2e5b6c82121 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:23.767432 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de85e52-5a0c-4b01-be21-f2e5b6c82121 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:23.767704 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de85e52-5a0c-4b01-be21-f2e5b6c82121 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:23.767971 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de85e52-5a0c-4b01-be21-f2e5b6c82121 None admin] PATH_INFO: `/v3/domains` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:23.768647 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de85e52-5a0c-4b01-be21-f2e5b6c82121 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:25:23.768978 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de85e52-5a0c-4b01-be21-f2e5b6c82121 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:23.770345 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de85e52-5a0c-4b01-be21-f2e5b6c82121 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:23.781628 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 258/510] 10.222.0.102 () {56 vars in 1114 bytes} [Mon Aug 1 15:25:23 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:23.782395 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de85e52-5a0c-4b01-be21-f2e5b6c82121 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:23.800081 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:23.819259 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d3e71d-2d4b-46b9-b326-908045735a23 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:23.852797 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e69b15-a405-4c9d-9c6e-30defed33165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:23.853405 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e69b15-a405-4c9d-9c6e-30defed33165 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:23.853679 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e69b15-a405-4c9d-9c6e-30defed33165 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:23.853945 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e69b15-a405-4c9d-9c6e-30defed33165 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:23.861089 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e69b15-a405-4c9d-9c6e-30defed33165 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:23.862534 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e69b15-a405-4c9d-9c6e-30defed33165 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:23.874713 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-21e69b15-a405-4c9d-9c6e-30defed33165 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 01 15:25:23.874713 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:25:23.874713 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:25:23.874713 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:25:23.874713 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:25:23.874713 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:25:23.874713 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:25:23.874713 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:25:23.874713 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:25:23.874713 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:25:23.874713 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:25:23.874713 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:25:23.874713 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 15:25:23.874713 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 15:25:23.874713 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 15:25:23.874713 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 15:25:23.875641 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:25:23.875641 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:25:23.875641 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 15:25:23.875641 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 15:25:23.875641 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 15:25:23.875641 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 15:25:23.875641 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:25:23.875641 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:25:23.875641 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:25:23.875641 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:25:23.875641 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:25:23.875641 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 01 15:25:23.875641 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:25:23.875641 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:25:23.875641 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:25:23.875641 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:25:23.875641 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:25:23.875641 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:25:23.876529 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:25:23.876529 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:25:23.876529 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 15:25:23.876529 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 15:25:23.876529 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 15:25:23.876529 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 15:25:23.876529 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 15:25:23.876529 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 15:25:23.876529 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 01 15:25:23.876529 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 01 15:25:23.876529 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 253/511] 10.222.0.102 () {56 vars in 1107 bytes} [Mon Aug 1 15:25:23 2022] GET /identity/v3/users/neutron => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:25:23.877125 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e69b15-a405-4c9d-9c6e-30defed33165 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:23.887455 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de85e52-5a0c-4b01-be21-f2e5b6c82121 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:23.902372 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:23.922940 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c26c785-e88d-45fb-b1d9-92a1acac9c38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:23.923551 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c26c785-e88d-45fb-b1d9-92a1acac9c38 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:23.923840 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c26c785-e88d-45fb-b1d9-92a1acac9c38 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:23.924113 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c26c785-e88d-45fb-b1d9-92a1acac9c38 None admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:23.924821 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c26c785-e88d-45fb-b1d9-92a1acac9c38 None admin] RBAC: Adding query filter params (name=service) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:25:23.925159 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c26c785-e88d-45fb-b1d9-92a1acac9c38 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:23.926543 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c26c785-e88d-45fb-b1d9-92a1acac9c38 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:23.935402 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 259/512] 10.222.0.102 () {56 vars in 1108 bytes} [Mon Aug 1 15:25:23 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:23.936189 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c26c785-e88d-45fb-b1d9-92a1acac9c38 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:23.977934 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e69b15-a405-4c9d-9c6e-30defed33165 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:24.011746 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3841100-ac04-4c6f-ad1a-dc02a6bad9c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:24.012382 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3841100-ac04-4c6f-ad1a-dc02a6bad9c3 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:24.012663 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3841100-ac04-4c6f-ad1a-dc02a6bad9c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:24.012971 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3841100-ac04-4c6f-ad1a-dc02a6bad9c3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:24.013091 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:24.023969 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3841100-ac04-4c6f-ad1a-dc02a6bad9c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:24.025603 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3841100-ac04-4c6f-ad1a-dc02a6bad9c3 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:24.034370 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c26c785-e88d-45fb-b1d9-92a1acac9c38 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:24.040012 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-b3841100-ac04-4c6f-ad1a-dc02a6bad9c3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:25:24.040012 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:25:24.040012 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:25:24.040012 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:25:24.040012 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:25:24.040012 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:25:24.040012 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:25:24.040012 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:25:24.040012 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:25:24.040012 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:25:24.040012 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:25:24.040012 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:25:24.040012 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:25:24.040012 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:25:24.040012 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:25:24.041062 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:25:24.041062 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:25:24.041062 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:25:24.041062 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:25:24.041062 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:25:24.041062 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:25:24.041062 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:25:24.041062 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:25:24.041062 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 01 15:25:24.041062 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:25:24.041062 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:25:24.041062 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:25:24.041062 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:25:24.041062 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:25:24.041062 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:25:24.041062 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:25:24.041062 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:25:24.041898 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:25:24.041898 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:25:24.041898 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:25:24.041898 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 01 15:25:24.041898 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 254/513] 10.222.0.102 () {56 vars in 1113 bytes} [Mon Aug 1 15:25:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:25:24.042524 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3841100-ac04-4c6f-ad1a-dc02a6bad9c3 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:24.068739 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660b989e-6a71-44f5-bee5-ca60e2b34929 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:24.069389 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660b989e-6a71-44f5-bee5-ca60e2b34929 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:24.069671 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660b989e-6a71-44f5-bee5-ca60e2b34929 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:24.069942 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660b989e-6a71-44f5-bee5-ca60e2b34929 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:24.114312 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:24.137372 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660b989e-6a71-44f5-bee5-ca60e2b34929 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:24.138083 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3841100-ac04-4c6f-ad1a-dc02a6bad9c3 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:24.138931 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660b989e-6a71-44f5-bee5-ca60e2b34929 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:24.172170 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e79fab-a38a-4960-9adc-a901aaca57a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:24.172797 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e79fab-a38a-4960-9adc-a901aaca57a1 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:24.173185 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e79fab-a38a-4960-9adc-a901aaca57a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:24.173460 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e79fab-a38a-4960-9adc-a901aaca57a1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:24.180071 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e79fab-a38a-4960-9adc-a901aaca57a1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:24.181543 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e79fab-a38a-4960-9adc-a901aaca57a1 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:24.193206 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-54e79fab-a38a-4960-9adc-a901aaca57a1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 15:25:24.193206 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:25:24.193206 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:25:24.193206 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:25:24.193206 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:25:24.193206 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:25:24.193206 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:25:24.193206 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:25:24.193206 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:25:24.193206 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:25:24.193206 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:25:24.193206 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:25:24.193206 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 15:25:24.193206 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 15:25:24.193206 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 15:25:24.194033 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 15:25:24.194033 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:25:24.194033 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:25:24.194033 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:25:24.194033 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:25:24.194033 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:25:24.194033 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:25:24.194033 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:25:24.194033 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 01 15:25:24.194033 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:25:24.194033 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:25:24.194033 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:25:24.194033 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:25:24.194033 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:25:24.194033 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:25:24.194033 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:25:24.194033 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:25:24.195635 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 15:25:24.195635 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 15:25:24.195635 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 15:25:24.195635 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 15:25:24.195635 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 15:25:24.195635 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 15:25:24.195635 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 15:25:24.195635 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 01 15:25:24.195635 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 255/514] 10.222.0.102 () {56 vars in 1116 bytes} [Mon Aug 1 15:25:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:25:24.195635 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e79fab-a38a-4960-9adc-a901aaca57a1 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:24.217984 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:24.239667 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 260/515] 10.222.0.102 () {58 vars in 1287 bytes} [Mon Aug 1 15:25:23 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 15:25:24.240479 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660b989e-6a71-44f5-bee5-ca60e2b34929 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:24.299394 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e79fab-a38a-4960-9adc-a901aaca57a1 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:24.333232 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2ef271-38cb-4cc9-8d5f-5d033f694660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:24.333895 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2ef271-38cb-4cc9-8d5f-5d033f694660 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:24.334177 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2ef271-38cb-4cc9-8d5f-5d033f694660 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:24.334450 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2ef271-38cb-4cc9-8d5f-5d033f694660 None admin] PATH_INFO: `/v3/users` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:24.335239 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2ef271-38cb-4cc9-8d5f-5d033f694660 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:25:24.335544 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2ef271-38cb-4cc9-8d5f-5d033f694660 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:24.338601 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2ef271-38cb-4cc9-8d5f-5d033f694660 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:24.340024 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660b989e-6a71-44f5-bee5-ca60e2b34929 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:24.341396 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:24.362522 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 256/516] 10.222.0.102 () {56 vars in 1144 bytes} [Mon Aug 1 15:25:24 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 376 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:24.363603 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2ef271-38cb-4cc9-8d5f-5d033f694660 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:24.375427 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dcacc3-d231-41bc-b7e9-97a3c1a6944c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:24.376007 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dcacc3-d231-41bc-b7e9-97a3c1a6944c None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:24.376285 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dcacc3-d231-41bc-b7e9-97a3c1a6944c None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:24.376558 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dcacc3-d231-41bc-b7e9-97a3c1a6944c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:24.387562 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78dcacc3-d231-41bc-b7e9-97a3c1a6944c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:24.389035 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78dcacc3-d231-41bc-b7e9-97a3c1a6944c None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:24.403953 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-78dcacc3-d231-41bc-b7e9-97a3c1a6944c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:25:24.403953 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:25:24.403953 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:25:24.403953 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:25:24.403953 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:25:24.403953 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:25:24.403953 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:25:24.403953 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:25:24.403953 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:25:24.403953 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:25:24.403953 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:25:24.403953 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:25:24.403953 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:25:24.403953 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:25:24.403953 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:25:24.404896 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:25:24.404896 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:25:24.404896 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:25:24.404896 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:25:24.404896 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:25:24.404896 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:25:24.404896 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:25:24.404896 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:25:24.404896 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 01 15:25:24.404896 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:25:24.404896 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:25:24.404896 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:25:24.404896 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:25:24.404896 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:25:24.404896 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:25:24.404896 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:25:24.404896 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:25:24.405783 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:25:24.405783 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:25:24.405783 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:25:24.405783 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 01 15:25:24.405783 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 261/517] 10.222.0.102 () {56 vars in 1113 bytes} [Mon Aug 1 15:25:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:25:24.406053 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dcacc3-d231-41bc-b7e9-97a3c1a6944c None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:24.439633 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:24.466338 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2ef271-38cb-4cc9-8d5f-5d033f694660 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:24.499871 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825b5ab7-80ed-46eb-be58-4dade0935c3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:24.500540 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825b5ab7-80ed-46eb-be58-4dade0935c3f None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:24.500822 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825b5ab7-80ed-46eb-be58-4dade0935c3f None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:24.501122 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825b5ab7-80ed-46eb-be58-4dade0935c3f None admin] PATH_INFO: `/v3/domains` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:24.501866 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825b5ab7-80ed-46eb-be58-4dade0935c3f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:25:24.502170 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825b5ab7-80ed-46eb-be58-4dade0935c3f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:24.503535 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825b5ab7-80ed-46eb-be58-4dade0935c3f None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:24.509429 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dcacc3-d231-41bc-b7e9-97a3c1a6944c None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:24.515178 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 257/518] 10.222.0.102 () {56 vars in 1114 bytes} [Mon Aug 1 15:25:24 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:24.515955 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825b5ab7-80ed-46eb-be58-4dade0935c3f None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:24.544215 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc48a87-e3ad-43dd-9dad-bd87c618d64d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:24.544826 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc48a87-e3ad-43dd-9dad-bd87c618d64d None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:24.545150 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc48a87-e3ad-43dd-9dad-bd87c618d64d None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:24.545425 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc48a87-e3ad-43dd-9dad-bd87c618d64d None admin] PATH_INFO: `/v3/projects` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:24.546166 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc48a87-e3ad-43dd-9dad-bd87c618d64d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:25:24.546473 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc48a87-e3ad-43dd-9dad-bd87c618d64d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:24.547918 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc48a87-e3ad-43dd-9dad-bd87c618d64d None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:24.565829 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 262/519] 10.222.0.102 () {56 vars in 1153 bytes} [Mon Aug 1 15:25:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:24.566627 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc48a87-e3ad-43dd-9dad-bd87c618d64d None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:24.567888 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:24.614334 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825b5ab7-80ed-46eb-be58-4dade0935c3f None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:24.648154 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f64934-c547-4159-b6fa-0b134d747b93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:24.648715 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f64934-c547-4159-b6fa-0b134d747b93 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:24.649033 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f64934-c547-4159-b6fa-0b134d747b93 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:24.649307 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f64934-c547-4159-b6fa-0b134d747b93 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:24.658658 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:24.659655 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f64934-c547-4159-b6fa-0b134d747b93 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:24.661143 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f64934-c547-4159-b6fa-0b134d747b93 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:24.667570 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc48a87-e3ad-43dd-9dad-bd87c618d64d None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:24.675168 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-f3f64934-c547-4159-b6fa-0b134d747b93 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:25:24.675168 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:25:24.675168 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:25:24.675168 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:25:24.675168 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:25:24.675168 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:25:24.675168 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:25:24.675168 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:25:24.675168 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:25:24.675168 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:25:24.675168 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:25:24.675168 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:25:24.675168 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:25:24.675168 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:25:24.675168 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:25:24.676184 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:25:24.676184 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:25:24.676184 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:25:24.676184 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:25:24.676184 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:25:24.676184 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:25:24.676184 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:25:24.676184 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:25:24.676184 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 01 15:25:24.676184 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:25:24.676184 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:25:24.676184 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:25:24.676184 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:25:24.676184 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:25:24.676184 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:25:24.676184 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:25:24.676184 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:25:24.677078 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:25:24.677078 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:25:24.677078 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:25:24.677078 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 01 15:25:24.677078 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 258/520] 10.222.0.102 () {56 vars in 1113 bytes} [Mon Aug 1 15:25:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:25:24.677078 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f64934-c547-4159-b6fa-0b134d747b93 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:24.708054 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bb567a-e821-4131-aa18-ff2fa69e4fca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:24.708670 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bb567a-e821-4131-aa18-ff2fa69e4fca None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:24.708975 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bb567a-e821-4131-aa18-ff2fa69e4fca None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:24.709246 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bb567a-e821-4131-aa18-ff2fa69e4fca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:24.777764 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f64934-c547-4159-b6fa-0b134d747b93 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:24.780071 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:24.780200 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bb567a-e821-4131-aa18-ff2fa69e4fca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:24.781562 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bb567a-e821-4131-aa18-ff2fa69e4fca None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:24.811884 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6e5ea1-d055-44ae-aff0-e07a237c5aed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:24.812496 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6e5ea1-d055-44ae-aff0-e07a237c5aed None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:24.812775 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6e5ea1-d055-44ae-aff0-e07a237c5aed None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:24.813082 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6e5ea1-d055-44ae-aff0-e07a237c5aed None admin] PATH_INFO: `/v3/domains` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:24.813771 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6e5ea1-d055-44ae-aff0-e07a237c5aed None admin] RBAC: Adding query filter params (name=Default) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:25:24.814075 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6e5ea1-d055-44ae-aff0-e07a237c5aed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:24.815430 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6e5ea1-d055-44ae-aff0-e07a237c5aed None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:24.827284 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 259/521] 10.222.0.102 () {56 vars in 1114 bytes} [Mon Aug 1 15:25:24 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:24.828049 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6e5ea1-d055-44ae-aff0-e07a237c5aed None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:24.870489 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:24.881138 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 263/522] 10.222.0.102 () {58 vars in 1287 bytes} [Mon Aug 1 15:25:24 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 15:25:24.882032 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bb567a-e821-4131-aa18-ff2fa69e4fca None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:24.935278 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6e5ea1-d055-44ae-aff0-e07a237c5aed None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:24.968409 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f08e27-5144-48c0-a5f2-5c55982e6057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:24.969117 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f08e27-5144-48c0-a5f2-5c55982e6057 None admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:24.969397 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f08e27-5144-48c0-a5f2-5c55982e6057 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:24.969666 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f08e27-5144-48c0-a5f2-5c55982e6057 None admin] PATH_INFO: `/v3/users` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:24.970333 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f08e27-5144-48c0-a5f2-5c55982e6057 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:24.971770 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f08e27-5144-48c0-a5f2-5c55982e6057 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:24.983074 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bb567a-e821-4131-aa18-ff2fa69e4fca None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:25.016448 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24ca114-1e42-47c7-b95e-8823879566f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:25.017081 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24ca114-1e42-47c7-b95e-8823879566f5 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:25.017360 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24ca114-1e42-47c7-b95e-8823879566f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:25.017628 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24ca114-1e42-47c7-b95e-8823879566f5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:25.018403 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24ca114-1e42-47c7-b95e-8823879566f5 None admin] RBAC: Adding query filter params (role.id=3087c03acf8d44d9ae512385924c5d0d, scope.project.id=2eb32fbe631843d8be84d41f8ba88d6e, user.id=613da2657ae34558b355cac53c8bf29a) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:25:25.018711 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24ca114-1e42-47c7-b95e-8823879566f5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:25.020141 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24ca114-1e42-47c7-b95e-8823879566f5 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:25.025456 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 264/523] 10.222.0.102 () {56 vars in 1379 bytes} [Mon Aug 1 15:25:24 2022] GET /identity/v3/role_assignments?user.id=613da2657ae34558b355cac53c8bf29a&scope.project.id=2eb32fbe631843d8be84d41f8ba88d6e&role.id=3087c03acf8d44d9ae512385924c5d0d => generated 260 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:25.026227 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24ca114-1e42-47c7-b95e-8823879566f5 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:25.042091 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 260/524] 10.222.0.102 () {60 vars in 1137 bytes} [Mon Aug 1 15:25:24 2022] POST /identity/v3/users => generated 248 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:25:25.043701 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f08e27-5144-48c0-a5f2-5c55982e6057 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:25.086371 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:25.127183 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:25.169138 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24ca114-1e42-47c7-b95e-8823879566f5 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:25.199885 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f08e27-5144-48c0-a5f2-5c55982e6057 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:25.219140 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d41da54-1de1-4c44-a960-31da570ec3fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:25.220012 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d41da54-1de1-4c44-a960-31da570ec3fd None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:25.220286 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d41da54-1de1-4c44-a960-31da570ec3fd None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:25.220552 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d41da54-1de1-4c44-a960-31da570ec3fd None admin] PATH_INFO: `/v3/domains` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:25.221428 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d41da54-1de1-4c44-a960-31da570ec3fd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:25:25.221740 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d41da54-1de1-4c44-a960-31da570ec3fd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:25.223124 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d41da54-1de1-4c44-a960-31da570ec3fd None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:25.237863 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 265/525] 10.222.0.102 () {56 vars in 1114 bytes} [Mon Aug 1 15:25:25 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:25.238623 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d41da54-1de1-4c44-a960-31da570ec3fd None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:25.248686 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338d01d1-6992-42c2-adfe-67e0c4333356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:25.249550 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338d01d1-6992-42c2-adfe-67e0c4333356 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:25.250020 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338d01d1-6992-42c2-adfe-67e0c4333356 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:25.250430 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338d01d1-6992-42c2-adfe-67e0c4333356 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:25.259011 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338d01d1-6992-42c2-adfe-67e0c4333356 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:25.260796 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338d01d1-6992-42c2-adfe-67e0c4333356 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:25.275455 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-338d01d1-6992-42c2-adfe-67e0c4333356 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 01 15:25:25.275455 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:25:25.275455 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:25:25.275455 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:25:25.275455 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:25:25.275455 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:25:25.275455 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:25:25.275455 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:25:25.275455 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:25:25.275455 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:25:25.275455 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:25:25.275455 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:25:25.275455 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 15:25:25.275455 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 15:25:25.275455 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 15:25:25.275455 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 15:25:25.276581 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:25:25.276581 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:25:25.276581 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 15:25:25.276581 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 15:25:25.276581 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 15:25:25.276581 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 15:25:25.276581 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:25:25.276581 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:25:25.276581 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:25:25.276581 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:25:25.276581 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:25:25.276581 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 01 15:25:25.276581 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:25:25.276581 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:25:25.276581 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:25:25.276581 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:25:25.276581 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:25:25.276581 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:25:25.277609 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:25:25.277609 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:25:25.277609 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 15:25:25.277609 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 15:25:25.277609 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 15:25:25.277609 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 15:25:25.277609 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 15:25:25.277609 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 15:25:25.277609 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 01 15:25:25.277609 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 01 15:25:25.279627 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 261/526] 10.222.0.102 () {56 vars in 1104 bytes} [Mon Aug 1 15:25:25 2022] GET /identity/v3/users/cinder => generated 84 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:25:25.280523 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338d01d1-6992-42c2-adfe-67e0c4333356 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:25.368276 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d41da54-1de1-4c44-a960-31da570ec3fd None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:25.381187 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:25.389349 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:25.403784 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338d01d1-6992-42c2-adfe-67e0c4333356 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:25.412705 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a261ea-866b-40ec-a31c-6075aa13b173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:25.413459 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a261ea-866b-40ec-a31c-6075aa13b173 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:25.413740 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a261ea-866b-40ec-a31c-6075aa13b173 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:25.415020 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a261ea-866b-40ec-a31c-6075aa13b173 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:25.428554 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a261ea-866b-40ec-a31c-6075aa13b173 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:25.430395 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a261ea-866b-40ec-a31c-6075aa13b173 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:25.442600 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7592f5-5df4-40fd-8a43-6e94ef2a430f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:25.443481 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7592f5-5df4-40fd-8a43-6e94ef2a430f None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:25.443905 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7592f5-5df4-40fd-8a43-6e94ef2a430f None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:25.444345 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7592f5-5df4-40fd-8a43-6e94ef2a430f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:25.448554 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-67a261ea-866b-40ec-a31c-6075aa13b173 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:25:25.448554 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:25:25.448554 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:25:25.448554 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:25:25.448554 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:25:25.448554 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:25:25.448554 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:25:25.448554 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:25:25.448554 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:25:25.448554 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:25:25.448554 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:25:25.448554 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:25:25.448554 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:25:25.448554 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:25:25.448554 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:25:25.449781 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:25:25.449781 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:25:25.449781 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:25:25.449781 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:25:25.449781 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:25:25.449781 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:25:25.449781 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:25:25.449781 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:25:25.449781 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 01 15:25:25.449781 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:25:25.449781 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:25:25.449781 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:25:25.449781 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:25:25.449781 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:25:25.449781 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:25:25.449781 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:25:25.449781 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:25:25.450814 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:25:25.450814 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:25:25.450814 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:25:25.450814 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 01 15:25:25.450814 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 266/527] 10.222.0.102 () {56 vars in 1113 bytes} [Mon Aug 1 15:25:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:25:25.451113 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a261ea-866b-40ec-a31c-6075aa13b173 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:25.457110 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7592f5-5df4-40fd-8a43-6e94ef2a430f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:25.458980 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7592f5-5df4-40fd-8a43-6e94ef2a430f None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:25.472685 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-0c7592f5-5df4-40fd-8a43-6e94ef2a430f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 15:25:25.472685 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:25:25.472685 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:25:25.472685 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:25:25.472685 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:25:25.472685 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:25:25.472685 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:25:25.472685 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:25:25.472685 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:25:25.472685 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:25:25.472685 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:25:25.472685 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:25:25.472685 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 15:25:25.472685 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 15:25:25.472685 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 15:25:25.473752 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 15:25:25.473752 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:25:25.473752 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:25:25.473752 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:25:25.473752 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:25:25.473752 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:25:25.473752 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:25:25.473752 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:25:25.473752 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 01 15:25:25.473752 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:25:25.473752 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:25:25.473752 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:25:25.473752 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:25:25.473752 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:25:25.473752 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:25:25.473752 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:25:25.473752 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:25:25.474625 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 15:25:25.474625 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 15:25:25.474625 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 15:25:25.474625 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 15:25:25.474625 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 15:25:25.474625 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 15:25:25.474625 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 15:25:25.474625 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 01 15:25:25.476813 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 262/528] 10.222.0.102 () {56 vars in 1116 bytes} [Mon Aug 1 15:25:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:25:25.477965 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7592f5-5df4-40fd-8a43-6e94ef2a430f None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:25.563917 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a261ea-866b-40ec-a31c-6075aa13b173 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:25.605397 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7592f5-5df4-40fd-8a43-6e94ef2a430f None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:25.609674 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096012c6-946c-483c-834e-d13a82c82cb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:25.610292 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096012c6-946c-483c-834e-d13a82c82cb2 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:25.610569 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096012c6-946c-483c-834e-d13a82c82cb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:25.610837 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096012c6-946c-483c-834e-d13a82c82cb2 None admin] PATH_INFO: `/v3/users` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:25.611633 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096012c6-946c-483c-834e-d13a82c82cb2 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:25:25.611934 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096012c6-946c-483c-834e-d13a82c82cb2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:25.613514 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096012c6-946c-483c-834e-d13a82c82cb2 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:25.635583 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 267/529] 10.222.0.102 () {56 vars in 1142 bytes} [Mon Aug 1 15:25:25 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 374 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:25.637084 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096012c6-946c-483c-834e-d13a82c82cb2 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:25.646442 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bb80ec-6af1-43c3-b268-a79af1899af9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:25.647063 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bb80ec-6af1-43c3-b268-a79af1899af9 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:25.647345 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bb80ec-6af1-43c3-b268-a79af1899af9 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:25.647620 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bb80ec-6af1-43c3-b268-a79af1899af9 None admin] PATH_INFO: `/v3/domains` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:25.648946 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bb80ec-6af1-43c3-b268-a79af1899af9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:25:25.649259 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bb80ec-6af1-43c3-b268-a79af1899af9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:25.650684 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bb80ec-6af1-43c3-b268-a79af1899af9 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:25.664082 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:25.673077 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 263/530] 10.222.0.102 () {56 vars in 1114 bytes} [Mon Aug 1 15:25:25 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:25.673077 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bb80ec-6af1-43c3-b268-a79af1899af9 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:25.687394 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:25.770695 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096012c6-946c-483c-834e-d13a82c82cb2 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:25.808566 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bb80ec-6af1-43c3-b268-a79af1899af9 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:25.821861 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fbca58-0e8d-4dd1-8c0a-a997daf918ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:25.822490 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fbca58-0e8d-4dd1-8c0a-a997daf918ef None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:25.822837 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fbca58-0e8d-4dd1-8c0a-a997daf918ef None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:25.823261 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fbca58-0e8d-4dd1-8c0a-a997daf918ef None admin] PATH_INFO: `/v3/projects` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:25.824158 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fbca58-0e8d-4dd1-8c0a-a997daf918ef None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:25:25.824463 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fbca58-0e8d-4dd1-8c0a-a997daf918ef None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:25.826525 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fbca58-0e8d-4dd1-8c0a-a997daf918ef None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:25.848711 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 268/531] 10.222.0.102 () {56 vars in 1153 bytes} [Mon Aug 1 15:25:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:25.849797 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fbca58-0e8d-4dd1-8c0a-a997daf918ef None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:25.855174 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1db50a-f313-4a5e-a825-c3d53805b5a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:25.855799 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1db50a-f313-4a5e-a825-c3d53805b5a7 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:25.856080 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1db50a-f313-4a5e-a825-c3d53805b5a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:25.856348 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1db50a-f313-4a5e-a825-c3d53805b5a7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:25.943839 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:25.947922 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1db50a-f313-4a5e-a825-c3d53805b5a7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:25.950144 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1db50a-f313-4a5e-a825-c3d53805b5a7 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:25.963515 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:25.987972 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fbca58-0e8d-4dd1-8c0a-a997daf918ef None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:26.028346 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c630563-a87a-44e6-b11c-4a65a9a29d2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:26.028947 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c630563-a87a-44e6-b11c-4a65a9a29d2c None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:26.029233 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c630563-a87a-44e6-b11c-4a65a9a29d2c None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:26.029509 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c630563-a87a-44e6-b11c-4a65a9a29d2c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:26.036894 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c630563-a87a-44e6-b11c-4a65a9a29d2c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:26.038477 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c630563-a87a-44e6-b11c-4a65a9a29d2c None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:26.052241 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-1c630563-a87a-44e6-b11c-4a65a9a29d2c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 15:25:26.052241 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:25:26.052241 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:25:26.052241 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:25:26.052241 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:25:26.052241 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:25:26.052241 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:25:26.052241 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:25:26.052241 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:25:26.052241 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:25:26.052241 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:25:26.052241 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:25:26.052241 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 15:25:26.052241 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 15:25:26.052241 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 15:25:26.053142 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 15:25:26.053142 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:25:26.053142 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:25:26.053142 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:25:26.053142 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:25:26.053142 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:25:26.053142 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:25:26.053142 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:25:26.053142 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 01 15:25:26.053142 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:25:26.053142 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:25:26.053142 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:25:26.053142 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:25:26.053142 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:25:26.053142 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:25:26.053142 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:25:26.053142 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:25:26.054015 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 15:25:26.054015 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 15:25:26.054015 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 15:25:26.054015 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 15:25:26.054015 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 15:25:26.054015 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 15:25:26.054015 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 15:25:26.054015 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 01 15:25:26.058214 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 269/532] 10.222.0.102 () {56 vars in 1116 bytes} [Mon Aug 1 15:25:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:25:26.059049 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c630563-a87a-44e6-b11c-4a65a9a29d2c None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:26.107675 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 264/533] 10.222.0.102 () {58 vars in 1287 bytes} [Mon Aug 1 15:25:25 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 15:25:26.108634 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1db50a-f313-4a5e-a825-c3d53805b5a7 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:26.183363 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c630563-a87a-44e6-b11c-4a65a9a29d2c None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:26.216256 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:26.219408 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1db50a-f313-4a5e-a825-c3d53805b5a7 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:26.222748 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882219e5-0627-46df-9f91-a24fc68c1908 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:26.223530 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882219e5-0627-46df-9f91-a24fc68c1908 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:26.223952 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882219e5-0627-46df-9f91-a24fc68c1908 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:26.224365 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882219e5-0627-46df-9f91-a24fc68c1908 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:26.225377 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882219e5-0627-46df-9f91-a24fc68c1908 None admin] RBAC: Adding query filter params (role.id=3087c03acf8d44d9ae512385924c5d0d, scope.project.id=2eb32fbe631843d8be84d41f8ba88d6e, user.id=77b43f1ee8cc4be3907a494abe90c1cc) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:25:26.225826 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882219e5-0627-46df-9f91-a24fc68c1908 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:26.227936 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882219e5-0627-46df-9f91-a24fc68c1908 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:26.241022 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 270/534] 10.222.0.102 () {56 vars in 1379 bytes} [Mon Aug 1 15:25:26 2022] GET /identity/v3/role_assignments?user.id=77b43f1ee8cc4be3907a494abe90c1cc&scope.project.id=2eb32fbe631843d8be84d41f8ba88d6e&role.id=3087c03acf8d44d9ae512385924c5d0d => generated 260 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:26.242349 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882219e5-0627-46df-9f91-a24fc68c1908 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:26.259312 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201a2fb1-7665-4b87-a5f2-cdb92c5662bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:26.260023 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201a2fb1-7665-4b87-a5f2-cdb92c5662bf None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:26.260305 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201a2fb1-7665-4b87-a5f2-cdb92c5662bf None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:26.260580 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201a2fb1-7665-4b87-a5f2-cdb92c5662bf None admin] PATH_INFO: `/v3/projects` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:26.261498 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201a2fb1-7665-4b87-a5f2-cdb92c5662bf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:25:26.261782 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:26.261895 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201a2fb1-7665-4b87-a5f2-cdb92c5662bf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:26.263338 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201a2fb1-7665-4b87-a5f2-cdb92c5662bf None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:26.297688 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 265/535] 10.222.0.102 () {56 vars in 1153 bytes} [Mon Aug 1 15:25:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:26.311076 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201a2fb1-7665-4b87-a5f2-cdb92c5662bf None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:26.422307 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882219e5-0627-46df-9f91-a24fc68c1908 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:26.482699 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0cccd8-33d8-4b01-8a97-8a99bd2036eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:26.483346 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0cccd8-33d8-4b01-8a97-8a99bd2036eb None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:26.483628 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0cccd8-33d8-4b01-8a97-8a99bd2036eb None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:26.483905 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0cccd8-33d8-4b01-8a97-8a99bd2036eb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:26.500005 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0cccd8-33d8-4b01-8a97-8a99bd2036eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:26.501505 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0cccd8-33d8-4b01-8a97-8a99bd2036eb None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:26.509105 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201a2fb1-7665-4b87-a5f2-cdb92c5662bf None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:26.529016 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-1e0cccd8-33d8-4b01-8a97-8a99bd2036eb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:25:26.529016 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:25:26.529016 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:25:26.529016 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:25:26.529016 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:25:26.529016 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:25:26.529016 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:25:26.529016 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:25:26.529016 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:25:26.529016 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:25:26.529016 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:25:26.529016 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:25:26.529016 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:25:26.529016 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:25:26.529016 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:25:26.530024 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:25:26.530024 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:25:26.530024 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:25:26.530024 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:25:26.530024 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:25:26.530024 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:25:26.530024 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:25:26.530024 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:25:26.530024 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 01 15:25:26.530024 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:25:26.530024 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:25:26.530024 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:25:26.530024 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:25:26.530024 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:25:26.530024 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:25:26.530024 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:25:26.530024 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:25:26.530851 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:25:26.530851 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:25:26.530851 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:25:26.530851 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 01 15:25:26.531791 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 271/536] 10.222.0.102 () {56 vars in 1113 bytes} [Mon Aug 1 15:25:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:25:26.536370 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0cccd8-33d8-4b01-8a97-8a99bd2036eb None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:26.577061 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a27601c-82dd-4f54-aeb0-2a4e8bfa5a24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:26.577660 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a27601c-82dd-4f54-aeb0-2a4e8bfa5a24 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:26.577939 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a27601c-82dd-4f54-aeb0-2a4e8bfa5a24 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:26.578263 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a27601c-82dd-4f54-aeb0-2a4e8bfa5a24 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:26.579061 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a27601c-82dd-4f54-aeb0-2a4e8bfa5a24 None admin] RBAC: Adding query filter params (role.id=3087c03acf8d44d9ae512385924c5d0d, scope.project.id=2eb32fbe631843d8be84d41f8ba88d6e, user.id=a856a413100443939fe9b10daa868518) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:25:26.580391 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a27601c-82dd-4f54-aeb0-2a4e8bfa5a24 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:26.582092 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a27601c-82dd-4f54-aeb0-2a4e8bfa5a24 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:26.594527 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 266/537] 10.222.0.102 () {56 vars in 1379 bytes} [Mon Aug 1 15:25:26 2022] GET /identity/v3/role_assignments?user.id=a856a413100443939fe9b10daa868518&scope.project.id=2eb32fbe631843d8be84d41f8ba88d6e&role.id=3087c03acf8d44d9ae512385924c5d0d => generated 260 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:26.625764 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:26.671422 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0cccd8-33d8-4b01-8a97-8a99bd2036eb None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:26.710844 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94e8d0c-d0c2-4957-99ad-a45ac8252070 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:26.711483 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94e8d0c-d0c2-4957-99ad-a45ac8252070 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:26.711764 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94e8d0c-d0c2-4957-99ad-a45ac8252070 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:26.712036 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94e8d0c-d0c2-4957-99ad-a45ac8252070 None admin] PATH_INFO: `/v3/domains` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:26.712810 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94e8d0c-d0c2-4957-99ad-a45ac8252070 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:25:26.713154 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94e8d0c-d0c2-4957-99ad-a45ac8252070 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:26.714653 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94e8d0c-d0c2-4957-99ad-a45ac8252070 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:26.729344 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 272/538] 10.222.0.102 () {56 vars in 1114 bytes} [Mon Aug 1 15:25:26 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:26.734571 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a27601c-82dd-4f54-aeb0-2a4e8bfa5a24 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:26.791951 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:26.893706 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a27601c-82dd-4f54-aeb0-2a4e8bfa5a24 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:26.938309 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91b54e8-ccaf-4832-af2e-32997ccb55c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:26.939336 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91b54e8-ccaf-4832-af2e-32997ccb55c4 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:26.939817 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91b54e8-ccaf-4832-af2e-32997ccb55c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:26.940284 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91b54e8-ccaf-4832-af2e-32997ccb55c4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:26.954064 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91b54e8-ccaf-4832-af2e-32997ccb55c4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:26.955539 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91b54e8-ccaf-4832-af2e-32997ccb55c4 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:26.974415 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-f91b54e8-ccaf-4832-af2e-32997ccb55c4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 15:25:26.974415 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:25:26.974415 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:25:26.974415 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:25:26.974415 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:25:26.974415 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:25:26.974415 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:25:26.974415 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:25:26.974415 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:25:26.974415 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:25:26.974415 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:25:26.974415 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:25:26.974415 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 15:25:26.974415 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 15:25:26.974415 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 15:25:26.975318 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 15:25:26.975318 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:25:26.975318 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:25:26.975318 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:25:26.975318 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:25:26.975318 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:25:26.975318 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:25:26.975318 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:25:26.975318 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 01 15:25:26.975318 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:25:26.975318 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:25:26.975318 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:25:26.975318 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:25:26.975318 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:25:26.975318 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:25:26.975318 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:25:26.975318 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:25:26.976807 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 15:25:26.976807 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 15:25:26.976807 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 15:25:26.976807 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 15:25:26.976807 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 15:25:26.976807 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 15:25:26.976807 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 15:25:26.976807 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 01 15:25:26.976807 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 267/539] 10.222.0.102 () {56 vars in 1116 bytes} [Mon Aug 1 15:25:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:25:26.981451 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94e8d0c-d0c2-4957-99ad-a45ac8252070 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:27.139905 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94e8d0c-d0c2-4957-99ad-a45ac8252070 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:27.168629 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:27.189937 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66879dc-cc2b-450a-95ce-e1e3d1d4af6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:27.190570 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66879dc-cc2b-450a-95ce-e1e3d1d4af6c None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:27.190845 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66879dc-cc2b-450a-95ce-e1e3d1d4af6c None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:27.191114 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66879dc-cc2b-450a-95ce-e1e3d1d4af6c None admin] PATH_INFO: `/v3/projects` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:27.191870 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66879dc-cc2b-450a-95ce-e1e3d1d4af6c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:25:27.192177 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66879dc-cc2b-450a-95ce-e1e3d1d4af6c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:27.193724 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66879dc-cc2b-450a-95ce-e1e3d1d4af6c None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:27.210025 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 273/540] 10.222.0.102 () {56 vars in 1153 bytes} [Mon Aug 1 15:25:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:27.215695 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91b54e8-ccaf-4832-af2e-32997ccb55c4 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:27.314333 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:27.325309 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63f6a55-75a8-4549-8344-d35e642a696e None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:27.326657 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63f6a55-75a8-4549-8344-d35e642a696e None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:27.326657 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63f6a55-75a8-4549-8344-d35e642a696e None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:27.328053 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 274/541] 10.222.0.102 () {54 vars in 931 bytes} [Mon Aug 1 15:25:27 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 15:25:27.333818 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354bf356-d916-403c-9e66-70ab9d253d1d None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:27.334249 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354bf356-d916-403c-9e66-70ab9d253d1d None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:27.334527 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354bf356-d916-403c-9e66-70ab9d253d1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:27.339301 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91b54e8-ccaf-4832-af2e-32997ccb55c4 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:27.361310 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-354bf356-d916-403c-9e66-70ab9d253d1d None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:25:27.362737 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-354bf356-d916-403c-9e66-70ab9d253d1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:25:27.405561 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6593b9f7-baa5-4ea3-8393-caab991b561f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:27.406202 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6593b9f7-baa5-4ea3-8393-caab991b561f None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:27.406489 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6593b9f7-baa5-4ea3-8393-caab991b561f None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:27.406769 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6593b9f7-baa5-4ea3-8393-caab991b561f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:27.407779 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6593b9f7-baa5-4ea3-8393-caab991b561f None admin] RBAC: Adding query filter params (role.id=3087c03acf8d44d9ae512385924c5d0d, scope.project.id=2eb32fbe631843d8be84d41f8ba88d6e, user.id=ff810b37183c4729859c1b05edff1703) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:25:27.407939 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6593b9f7-baa5-4ea3-8393-caab991b561f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:27.409418 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6593b9f7-baa5-4ea3-8393-caab991b561f None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:27.421414 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 268/542] 10.222.0.102 () {56 vars in 1379 bytes} [Mon Aug 1 15:25:27 2022] GET /identity/v3/role_assignments?user.id=ff810b37183c4729859c1b05edff1703&scope.project.id=2eb32fbe631843d8be84d41f8ba88d6e&role.id=3087c03acf8d44d9ae512385924c5d0d => generated 260 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:27.436878 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 275/543] 10.222.0.102 () {58 vars in 1028 bytes} [Mon Aug 1 15:25:27 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 15:25:27.472407 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6593b9f7-baa5-4ea3-8393-caab991b561f None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:27.533640 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fe685f-e25f-410f-b119-a7b201919d46 None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:27.533935 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fe685f-e25f-410f-b119-a7b201919d46 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:27.534202 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fe685f-e25f-410f-b119-a7b201919d46 None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:27.536410 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 276/544] 10.222.0.102 () {54 vars in 931 bytes} [Mon Aug 1 15:25:27 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 01 15:25:27.542071 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92752f9-4c46-4728-93a8-c89845d88f76 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:27.542350 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92752f9-4c46-4728-93a8-c89845d88f76 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:27.542686 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92752f9-4c46-4728-93a8-c89845d88f76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:27.578096 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-e92752f9-4c46-4728-93a8-c89845d88f76 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:25:27.579322 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-e92752f9-4c46-4728-93a8-c89845d88f76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:25:27.628029 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6593b9f7-baa5-4ea3-8393-caab991b561f None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:27.656546 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 277/545] 10.222.0.102 () {58 vars in 1028 bytes} [Mon Aug 1 15:25:27 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 15:25:27.681447 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92752f9-4c46-4728-93a8-c89845d88f76 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:27.692294 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4272fd7-538b-4b6f-82bb-d0175dd262aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:27.692294 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4272fd7-538b-4b6f-82bb-d0175dd262aa None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:27.692294 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4272fd7-538b-4b6f-82bb-d0175dd262aa None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:27.692294 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4272fd7-538b-4b6f-82bb-d0175dd262aa None admin] PATH_INFO: `/v3/roles/service` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:27.709838 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4272fd7-538b-4b6f-82bb-d0175dd262aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:25:27.715837 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-e4272fd7-538b-4b6f-82bb-d0175dd262aa None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 01 15:25:27.715837 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:25:27.715837 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:25:27.715837 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:25:27.715837 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:25:27.715837 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:25:27.715837 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:25:27.715837 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:25:27.715837 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:25:27.715837 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:25:27.715837 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:25:27.715837 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:25:27.715837 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:25:27.715837 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:25:27.715837 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:25:27.715837 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:25:27.716712 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:25:27.716712 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:25:27.716712 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:25:27.716712 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:25:27.716712 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:25:27.716712 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:25:27.716712 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:25:27.716712 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:25:27.716712 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:25:27.716712 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:25:27.716712 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:25:27.716712 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 01 15:25:27.716712 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:25:27.716712 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:25:27.716712 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:25:27.716712 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:25:27.717536 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:25:27.717536 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:25:27.717536 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:25:27.717536 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:25:27.717536 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:25:27.717536 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:25:27.717536 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:25:27.717536 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:25:27.717536 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:25:27.717536 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:25:27.717536 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 01 15:25:27.717536 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 01 15:25:27.718128 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 269/546] 10.222.0.102 () {56 vars in 1107 bytes} [Mon Aug 1 15:25:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:25:27.725770 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4272fd7-538b-4b6f-82bb-d0175dd262aa None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:27.735209 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:27.747653 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:27.817605 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92752f9-4c46-4728-93a8-c89845d88f76 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:27.890750 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4272fd7-538b-4b6f-82bb-d0175dd262aa None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:27.917638 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fea7a10-010a-4a18-9a05-873256a9746d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:27.918221 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fea7a10-010a-4a18-9a05-873256a9746d None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:27.918497 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fea7a10-010a-4a18-9a05-873256a9746d None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:27.918768 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fea7a10-010a-4a18-9a05-873256a9746d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:27.931709 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adff879-1706-41d2-98de-1bd31018f9a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:27.932334 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adff879-1706-41d2-98de-1bd31018f9a0 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:27.932613 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adff879-1706-41d2-98de-1bd31018f9a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:27.932899 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adff879-1706-41d2-98de-1bd31018f9a0 None admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:27.933621 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adff879-1706-41d2-98de-1bd31018f9a0 None admin] RBAC: Adding query filter params (name=service) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:25:27.933925 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adff879-1706-41d2-98de-1bd31018f9a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:27.937343 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adff879-1706-41d2-98de-1bd31018f9a0 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:27.942110 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fea7a10-010a-4a18-9a05-873256a9746d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:25:27.951898 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-2fea7a10-010a-4a18-9a05-873256a9746d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 01 15:25:27.951898 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:25:27.951898 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:25:27.951898 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:25:27.951898 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:25:27.951898 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:25:27.951898 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:25:27.951898 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:25:27.951898 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:25:27.951898 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:25:27.951898 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:25:27.951898 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:25:27.951898 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:25:27.951898 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:25:27.951898 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:25:27.951898 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:25:27.952807 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:25:27.952807 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:25:27.952807 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:25:27.952807 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:25:27.952807 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:25:27.952807 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:25:27.952807 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:25:27.952807 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:25:27.952807 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:25:27.952807 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:25:27.952807 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:25:27.952807 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 01 15:25:27.952807 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:25:27.952807 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:25:27.952807 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:25:27.952807 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:25:27.953721 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:25:27.953721 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:25:27.953721 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:25:27.953721 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:25:27.953721 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:25:27.953721 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:25:27.953721 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:25:27.953721 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:25:27.953721 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:25:27.953721 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:25:27.953721 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 01 15:25:27.953721 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 01 15:25:27.956509 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 270/547] 10.222.0.102 () {56 vars in 1108 bytes} [Mon Aug 1 15:25:27 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:27.957162 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 278/548] 10.222.0.102 () {56 vars in 1107 bytes} [Mon Aug 1 15:25:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 15:25:27.962851 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adff879-1706-41d2-98de-1bd31018f9a0 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:27.964453 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fea7a10-010a-4a18-9a05-873256a9746d None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:28.087512 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:28.122152 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adff879-1706-41d2-98de-1bd31018f9a0 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:28.160081 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:28.162826 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6159ca-3c95-4732-a3f9-255282045f7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:28.163901 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6159ca-3c95-4732-a3f9-255282045f7e None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:28.165524 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6159ca-3c95-4732-a3f9-255282045f7e None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:28.166542 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fea7a10-010a-4a18-9a05-873256a9746d None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:28.167039 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6159ca-3c95-4732-a3f9-255282045f7e None admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:28.172608 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6159ca-3c95-4732-a3f9-255282045f7e None admin] RBAC: Adding query filter params (name=service) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:25:28.172608 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6159ca-3c95-4732-a3f9-255282045f7e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:28.172608 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6159ca-3c95-4732-a3f9-255282045f7e None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:28.187013 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 271/549] 10.222.0.102 () {56 vars in 1108 bytes} [Mon Aug 1 15:25:27 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:28.193008 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6159ca-3c95-4732-a3f9-255282045f7e None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:28.212895 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352812ca-36db-4c2d-91ea-9276c80d8821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:28.212895 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352812ca-36db-4c2d-91ea-9276c80d8821 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:28.212895 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352812ca-36db-4c2d-91ea-9276c80d8821 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:28.212895 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352812ca-36db-4c2d-91ea-9276c80d8821 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:28.222408 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352812ca-36db-4c2d-91ea-9276c80d8821 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:28.227422 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352812ca-36db-4c2d-91ea-9276c80d8821 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:28.240890 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-352812ca-36db-4c2d-91ea-9276c80d8821 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:25:28.240890 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:25:28.240890 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:25:28.240890 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:25:28.240890 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:25:28.240890 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:25:28.240890 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:25:28.240890 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:25:28.240890 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:25:28.240890 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:25:28.240890 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:25:28.240890 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:25:28.240890 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:25:28.240890 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:25:28.240890 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:25:28.242484 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:25:28.242484 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:25:28.242484 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:25:28.242484 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:25:28.242484 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:25:28.242484 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:25:28.242484 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:25:28.242484 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:25:28.242484 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 01 15:25:28.242484 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:25:28.242484 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:25:28.242484 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:25:28.242484 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:25:28.242484 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:25:28.242484 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:25:28.242484 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:25:28.242484 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:25:28.243594 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:25:28.243594 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:25:28.243594 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:25:28.243594 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 01 15:25:28.243594 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 279/550] 10.222.0.102 () {56 vars in 1113 bytes} [Mon Aug 1 15:25:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:25:28.246366 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352812ca-36db-4c2d-91ea-9276c80d8821 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:28.389037 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6159ca-3c95-4732-a3f9-255282045f7e None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:28.432803 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:28.436103 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352812ca-36db-4c2d-91ea-9276c80d8821 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:28.445292 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f8c06c-e61f-4730-becc-50767afe8a9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:28.446197 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f8c06c-e61f-4730-becc-50767afe8a9a None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:28.446626 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f8c06c-e61f-4730-becc-50767afe8a9a None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:28.447045 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f8c06c-e61f-4730-becc-50767afe8a9a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:28.466312 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f8c06c-e61f-4730-becc-50767afe8a9a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:28.468154 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f8c06c-e61f-4730-becc-50767afe8a9a None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:28.491185 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-60f8c06c-e61f-4730-becc-50767afe8a9a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:25:28.491185 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:25:28.491185 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:25:28.491185 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:25:28.491185 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:25:28.491185 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:25:28.491185 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:25:28.491185 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:25:28.491185 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:25:28.491185 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:25:28.491185 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:25:28.491185 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:25:28.491185 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:25:28.491185 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:25:28.491185 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:25:28.492461 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:25:28.492461 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:25:28.492461 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:25:28.492461 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:25:28.492461 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:25:28.492461 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:25:28.492461 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:25:28.492461 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:25:28.492461 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 01 15:25:28.492461 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:25:28.492461 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:25:28.492461 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:25:28.492461 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:25:28.492461 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:25:28.492461 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:25:28.492461 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:25:28.492461 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:25:28.493588 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:25:28.493588 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:25:28.493588 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:25:28.493588 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 01 15:25:28.502754 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 272/551] 10.222.0.102 () {56 vars in 1113 bytes} [Mon Aug 1 15:25:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:25:28.504435 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e4f8d8-7457-40e3-868b-05fd2bf9a11f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:28.505601 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e4f8d8-7457-40e3-868b-05fd2bf9a11f None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:28.506030 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e4f8d8-7457-40e3-868b-05fd2bf9a11f None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:28.506462 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e4f8d8-7457-40e3-868b-05fd2bf9a11f None admin] PATH_INFO: `/v3/domains` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:28.507298 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e4f8d8-7457-40e3-868b-05fd2bf9a11f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:25:28.508362 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e4f8d8-7457-40e3-868b-05fd2bf9a11f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:28.509408 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f8c06c-e61f-4730-becc-50767afe8a9a None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:28.513552 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e4f8d8-7457-40e3-868b-05fd2bf9a11f None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:28.537857 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 280/552] 10.222.0.102 () {56 vars in 1114 bytes} [Mon Aug 1 15:25:28 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:25:28.549744 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e4f8d8-7457-40e3-868b-05fd2bf9a11f None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:28.583028 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:28.679675 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f8c06c-e61f-4730-becc-50767afe8a9a None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:28.709371 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e4f8d8-7457-40e3-868b-05fd2bf9a11f None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:28.726767 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71919486-4ba2-4c63-a6c8-fcc22af36d05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:28.727764 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71919486-4ba2-4c63-a6c8-fcc22af36d05 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:28.728247 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71919486-4ba2-4c63-a6c8-fcc22af36d05 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:28.728735 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71919486-4ba2-4c63-a6c8-fcc22af36d05 None admin] PATH_INFO: `/v3/domains` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:28.729654 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71919486-4ba2-4c63-a6c8-fcc22af36d05 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:25:28.730155 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71919486-4ba2-4c63-a6c8-fcc22af36d05 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:28.731741 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71919486-4ba2-4c63-a6c8-fcc22af36d05 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:28.748675 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 273/553] 10.222.0.102 () {56 vars in 1114 bytes} [Mon Aug 1 15:25:28 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:28.748675 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed6e4df-438a-4569-bf57-e876a1923ba8 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:28.748675 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed6e4df-438a-4569-bf57-e876a1923ba8 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:28.748675 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed6e4df-438a-4569-bf57-e876a1923ba8 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:28.748675 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 274/554] 10.222.0.102 () {54 vars in 931 bytes} [Mon Aug 1 15:25:28 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 15:25:28.753664 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed6e4df-438a-4569-bf57-e876a1923ba8 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:28.805084 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2756559b-ee60-4806-8002-4a4118034d54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:28.805728 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2756559b-ee60-4806-8002-4a4118034d54 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:28.806015 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2756559b-ee60-4806-8002-4a4118034d54 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:28.806290 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2756559b-ee60-4806-8002-4a4118034d54 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:28.813805 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2756559b-ee60-4806-8002-4a4118034d54 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:28.815344 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:28.815497 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2756559b-ee60-4806-8002-4a4118034d54 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:28.828628 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-2756559b-ee60-4806-8002-4a4118034d54 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 01 15:25:28.828628 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:25:28.828628 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:25:28.828628 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:25:28.828628 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:25:28.828628 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:25:28.828628 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:25:28.828628 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:25:28.828628 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:25:28.828628 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:25:28.828628 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:25:28.828628 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:25:28.828628 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 15:25:28.828628 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 15:25:28.828628 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 15:25:28.828628 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 15:25:28.831017 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:25:28.831017 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:25:28.831017 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 15:25:28.831017 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 15:25:28.831017 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 15:25:28.831017 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 15:25:28.831017 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:25:28.831017 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:25:28.831017 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:25:28.831017 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:25:28.831017 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:25:28.831017 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 01 15:25:28.831017 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:25:28.831017 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:25:28.831017 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:25:28.831017 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:25:28.831017 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:25:28.831017 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:25:28.831940 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:25:28.831940 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:25:28.831940 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 15:25:28.831940 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 15:25:28.831940 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 15:25:28.831940 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 15:25:28.831940 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 15:25:28.831940 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 15:25:28.831940 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 01 15:25:28.831940 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 01 15:25:28.831940 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 281/555] 10.222.0.102 () {56 vars in 1104 bytes} [Mon Aug 1 15:25:28 2022] GET /identity/v3/users/glance => generated 84 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:25:28.831940 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f724d055-d08d-4bca-b59f-cc06cdc001de None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:28.831940 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f724d055-d08d-4bca-b59f-cc06cdc001de None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:28.832616 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f724d055-d08d-4bca-b59f-cc06cdc001de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:28.850842 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-f724d055-d08d-4bca-b59f-cc06cdc001de None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:25:28.852072 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-f724d055-d08d-4bca-b59f-cc06cdc001de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:25:28.884833 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed6e4df-438a-4569-bf57-e876a1923ba8 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:28.924005 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5800cc-398b-4a21-b3ba-56b1a560a945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:28.924906 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 282/556] 10.222.0.102 () {58 vars in 1028 bytes} [Mon Aug 1 15:25:28 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 15:25:28.925364 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5800cc-398b-4a21-b3ba-56b1a560a945 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:28.925712 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5800cc-398b-4a21-b3ba-56b1a560a945 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:28.926044 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5800cc-398b-4a21-b3ba-56b1a560a945 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:28.930115 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f724d055-d08d-4bca-b59f-cc06cdc001de None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:28.939876 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:28.943393 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5800cc-398b-4a21-b3ba-56b1a560a945 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:28.949568 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5800cc-398b-4a21-b3ba-56b1a560a945 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:28.965045 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-bd5800cc-398b-4a21-b3ba-56b1a560a945 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 01 15:25:28.965045 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:25:28.965045 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:25:28.965045 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:25:28.965045 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:25:28.965045 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:25:28.965045 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:25:28.965045 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:25:28.965045 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:25:28.965045 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:25:28.965045 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:25:28.965045 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:25:28.965045 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 15:25:28.965045 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 15:25:28.965045 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 15:25:28.965045 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 15:25:28.966008 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:25:28.966008 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:25:28.966008 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 15:25:28.966008 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 15:25:28.966008 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 15:25:28.966008 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 15:25:28.966008 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:25:28.966008 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:25:28.966008 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:25:28.966008 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:25:28.966008 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:25:28.966008 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 01 15:25:28.966008 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:25:28.966008 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:25:28.966008 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:25:28.966008 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:25:28.966008 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:25:28.966008 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:25:28.967428 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:25:28.967428 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:25:28.967428 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 15:25:28.967428 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 15:25:28.967428 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 15:25:28.967428 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 15:25:28.967428 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 15:25:28.967428 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 15:25:28.967428 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 01 15:25:28.967428 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 01 15:25:28.967428 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 275/557] 10.222.0.102 () {56 vars in 1101 bytes} [Mon Aug 1 15:25:28 2022] GET /identity/v3/users/swift => generated 83 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:25:28.968031 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5800cc-398b-4a21-b3ba-56b1a560a945 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:29.064554 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f724d055-d08d-4bca-b59f-cc06cdc001de None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:29.089365 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5800cc-398b-4a21-b3ba-56b1a560a945 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:29.091753 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:29.103998 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18de34b3-051d-480c-a65d-bfc30f4f6baf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:29.105090 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18de34b3-051d-480c-a65d-bfc30f4f6baf None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:29.107205 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18de34b3-051d-480c-a65d-bfc30f4f6baf None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:29.107205 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18de34b3-051d-480c-a65d-bfc30f4f6baf None admin] PATH_INFO: `/v3/users` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:29.107205 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18de34b3-051d-480c-a65d-bfc30f4f6baf None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:25:29.107205 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18de34b3-051d-480c-a65d-bfc30f4f6baf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:29.108782 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18de34b3-051d-480c-a65d-bfc30f4f6baf None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:29.127320 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204988a0-1de9-4aac-86ce-e7100e43b03d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:29.128223 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204988a0-1de9-4aac-86ce-e7100e43b03d None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:29.128647 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204988a0-1de9-4aac-86ce-e7100e43b03d None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:29.129089 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204988a0-1de9-4aac-86ce-e7100e43b03d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:29.129671 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 283/558] 10.222.0.102 () {56 vars in 1142 bytes} [Mon Aug 1 15:25:28 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 374 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:29.130858 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18de34b3-051d-480c-a65d-bfc30f4f6baf None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:29.141101 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204988a0-1de9-4aac-86ce-e7100e43b03d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:25:29.147287 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-204988a0-1de9-4aac-86ce-e7100e43b03d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 01 15:25:29.147287 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:25:29.147287 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:25:29.147287 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:25:29.147287 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:25:29.147287 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:25:29.147287 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:25:29.147287 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:25:29.147287 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:25:29.147287 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:25:29.147287 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:25:29.147287 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:25:29.147287 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:25:29.147287 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:25:29.147287 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:25:29.147287 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:25:29.149052 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:25:29.149052 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:25:29.149052 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:25:29.149052 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:25:29.149052 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:25:29.149052 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:25:29.149052 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:25:29.149052 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:25:29.149052 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:25:29.149052 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:25:29.149052 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:25:29.149052 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 01 15:25:29.149052 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:25:29.149052 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:25:29.149052 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:25:29.149052 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:25:29.150408 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:25:29.150408 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:25:29.150408 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:25:29.150408 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:25:29.150408 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:25:29.150408 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:25:29.150408 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:25:29.150408 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:25:29.150408 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:25:29.150408 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:25:29.150408 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 01 15:25:29.150408 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 01 15:25:29.150408 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 276/559] 10.222.0.102 () {56 vars in 1107 bytes} [Mon Aug 1 15:25:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:25:29.150408 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204988a0-1de9-4aac-86ce-e7100e43b03d None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:29.198331 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:29.244804 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18de34b3-051d-480c-a65d-bfc30f4f6baf None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:29.257533 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204988a0-1de9-4aac-86ce-e7100e43b03d None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:29.279867 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62fe002-3969-464c-bdcd-7e73c8686f53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:29.280478 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62fe002-3969-464c-bdcd-7e73c8686f53 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:29.280753 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62fe002-3969-464c-bdcd-7e73c8686f53 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:29.281047 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62fe002-3969-464c-bdcd-7e73c8686f53 None admin] PATH_INFO: `/v3/users` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:29.281839 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62fe002-3969-464c-bdcd-7e73c8686f53 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:25:29.282138 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62fe002-3969-464c-bdcd-7e73c8686f53 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:29.283560 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62fe002-3969-464c-bdcd-7e73c8686f53 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:29.293063 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9d81b8-9bda-4176-addf-42d8c45c593a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:29.294360 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9d81b8-9bda-4176-addf-42d8c45c593a None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:29.294360 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9d81b8-9bda-4176-addf-42d8c45c593a None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:29.294360 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9d81b8-9bda-4176-addf-42d8c45c593a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:29.307140 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 284/560] 10.222.0.102 () {56 vars in 1140 bytes} [Mon Aug 1 15:25:29 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 372 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:29.307140 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb4e6f8-0016-4e9a-8702-f2fb7824240a None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:29.307140 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb4e6f8-0016-4e9a-8702-f2fb7824240a None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:29.307140 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb4e6f8-0016-4e9a-8702-f2fb7824240a None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:29.307140 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 285/561] 10.222.0.102 () {54 vars in 931 bytes} [Mon Aug 1 15:25:29 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 15:25:29.307140 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb4e6f8-0016-4e9a-8702-f2fb7824240a None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:29.312807 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9d81b8-9bda-4176-addf-42d8c45c593a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:29.314328 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9d81b8-9bda-4176-addf-42d8c45c593a None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:29.329740 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-7e9d81b8-9bda-4176-addf-42d8c45c593a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:25:29.329740 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:25:29.329740 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:25:29.329740 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:25:29.329740 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:25:29.329740 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:25:29.329740 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:25:29.329740 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:25:29.329740 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:25:29.329740 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:25:29.329740 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:25:29.329740 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:25:29.329740 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:25:29.329740 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:25:29.329740 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:25:29.335574 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:25:29.335574 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:25:29.335574 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:25:29.335574 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:25:29.335574 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:25:29.335574 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:25:29.335574 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:25:29.335574 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:25:29.335574 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 01 15:25:29.335574 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:25:29.335574 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:25:29.335574 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:25:29.335574 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:25:29.335574 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:25:29.335574 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:25:29.335574 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:25:29.335574 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:25:29.336601 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:25:29.336601 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:25:29.336601 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:25:29.336601 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 01 15:25:29.336601 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 277/562] 10.222.0.102 () {56 vars in 1113 bytes} [Mon Aug 1 15:25:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:25:29.336601 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9d81b8-9bda-4176-addf-42d8c45c593a None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:29.355752 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:29.424974 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb4e6f8-0016-4e9a-8702-f2fb7824240a None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:29.443238 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:29.446336 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9d81b8-9bda-4176-addf-42d8c45c593a None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:29.463493 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255221e5-b822-4728-af81-d5930c0abebd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:29.464107 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255221e5-b822-4728-af81-d5930c0abebd None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:29.464389 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255221e5-b822-4728-af81-d5930c0abebd None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:29.464661 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255221e5-b822-4728-af81-d5930c0abebd None admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:29.465402 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255221e5-b822-4728-af81-d5930c0abebd None admin] RBAC: Adding query filter params (name=service) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:25:29.465703 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255221e5-b822-4728-af81-d5930c0abebd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:29.467113 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255221e5-b822-4728-af81-d5930c0abebd None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:29.475950 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 286/563] 10.222.0.102 () {56 vars in 1108 bytes} [Mon Aug 1 15:25:29 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:29.477712 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ab5691-bdeb-4cef-af53-22e376d77311 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:29.478000 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ab5691-bdeb-4cef-af53-22e376d77311 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:29.478269 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ab5691-bdeb-4cef-af53-22e376d77311 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:29.489469 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ba0442-6629-4a6b-94f8-9329b45a2ba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:29.490457 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ba0442-6629-4a6b-94f8-9329b45a2ba6 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:29.491089 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ba0442-6629-4a6b-94f8-9329b45a2ba6 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:29.491436 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ba0442-6629-4a6b-94f8-9329b45a2ba6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:29.497082 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-88ab5691-bdeb-4cef-af53-22e376d77311 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:25:29.498207 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-88ab5691-bdeb-4cef-af53-22e376d77311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:25:29.562548 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ba0442-6629-4a6b-94f8-9329b45a2ba6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:29.564014 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ba0442-6629-4a6b-94f8-9329b45a2ba6 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:29.580873 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 287/564] 10.222.0.102 () {58 vars in 1028 bytes} [Mon Aug 1 15:25:29 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 15:25:29.580873 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ab5691-bdeb-4cef-af53-22e376d77311 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:29.592326 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:29.677298 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 278/565] 10.222.0.102 () {58 vars in 1287 bytes} [Mon Aug 1 15:25:29 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 15:25:29.678380 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ba0442-6629-4a6b-94f8-9329b45a2ba6 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:29.686619 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ab5691-bdeb-4cef-af53-22e376d77311 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:29.698461 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:29.725010 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cee2ab9-24f3-4913-90e5-a21ca70321e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:29.725629 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cee2ab9-24f3-4913-90e5-a21ca70321e9 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:29.725910 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cee2ab9-24f3-4913-90e5-a21ca70321e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:29.726183 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cee2ab9-24f3-4913-90e5-a21ca70321e9 None admin] PATH_INFO: `/v3/domains` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:29.727427 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cee2ab9-24f3-4913-90e5-a21ca70321e9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:25:29.727732 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cee2ab9-24f3-4913-90e5-a21ca70321e9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:29.729179 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cee2ab9-24f3-4913-90e5-a21ca70321e9 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:29.740636 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 288/566] 10.222.0.102 () {56 vars in 1114 bytes} [Mon Aug 1 15:25:29 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:29.741678 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cee2ab9-24f3-4913-90e5-a21ca70321e9 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:29.793173 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ba0442-6629-4a6b-94f8-9329b45a2ba6 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:29.809876 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:29.827468 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d39254-cbbc-4785-80e6-5023b9b7a3f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:29.828061 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d39254-cbbc-4785-80e6-5023b9b7a3f9 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:29.828352 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d39254-cbbc-4785-80e6-5023b9b7a3f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:29.828615 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d39254-cbbc-4785-80e6-5023b9b7a3f9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:29.838805 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d39254-cbbc-4785-80e6-5023b9b7a3f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:29.839816 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cee2ab9-24f3-4913-90e5-a21ca70321e9 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:29.840245 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d39254-cbbc-4785-80e6-5023b9b7a3f9 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:29.855124 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-88d39254-cbbc-4785-80e6-5023b9b7a3f9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:25:29.855124 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:25:29.855124 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:25:29.855124 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:25:29.855124 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:25:29.855124 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:25:29.855124 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:25:29.855124 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:25:29.855124 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:25:29.855124 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:25:29.855124 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:25:29.855124 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:25:29.855124 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:25:29.855124 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:25:29.855124 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:25:29.864361 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:25:29.864361 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:25:29.864361 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:25:29.864361 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:25:29.864361 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:25:29.864361 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:25:29.864361 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:25:29.864361 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:25:29.864361 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 01 15:25:29.864361 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:25:29.864361 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:25:29.864361 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:25:29.864361 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:25:29.864361 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:25:29.864361 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:25:29.864361 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:25:29.864361 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:25:29.865464 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:25:29.865464 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:25:29.865464 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:25:29.865464 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 01 15:25:29.865464 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 279/567] 10.222.0.102 () {56 vars in 1113 bytes} [Mon Aug 1 15:25:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:25:29.865464 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629642f3-e4b1-41fc-8f5f-1cb12e96f945 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:29.865464 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629642f3-e4b1-41fc-8f5f-1cb12e96f945 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:29.865464 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629642f3-e4b1-41fc-8f5f-1cb12e96f945 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:29.865464 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 280/568] 10.222.0.102 () {54 vars in 931 bytes} [Mon Aug 1 15:25:29 2022] GET /identity => generated 271 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 15:25:29.866075 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629642f3-e4b1-41fc-8f5f-1cb12e96f945 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:29.881895 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b3ea1a-656c-448b-b5ba-c62450a6afeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:29.882585 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b3ea1a-656c-448b-b5ba-c62450a6afeb None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:29.882867 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b3ea1a-656c-448b-b5ba-c62450a6afeb None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:29.883142 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b3ea1a-656c-448b-b5ba-c62450a6afeb None admin] PATH_INFO: `/v3/roles/service` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:29.894405 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b3ea1a-656c-448b-b5ba-c62450a6afeb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:25:29.900343 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-84b3ea1a-656c-448b-b5ba-c62450a6afeb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 01 15:25:29.900343 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:25:29.900343 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:25:29.900343 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:25:29.900343 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:25:29.900343 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:25:29.900343 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:25:29.900343 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:25:29.900343 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:25:29.900343 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:25:29.900343 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:25:29.900343 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:25:29.900343 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:25:29.900343 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:25:29.900343 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:25:29.900343 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:25:29.901465 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:25:29.901465 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:25:29.901465 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:25:29.901465 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:25:29.901465 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:25:29.901465 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:25:29.901465 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:25:29.901465 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:25:29.901465 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:25:29.901465 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:25:29.901465 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:25:29.901465 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 01 15:25:29.901465 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:25:29.901465 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:25:29.901465 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:25:29.901465 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:25:29.902495 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:25:29.902495 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:25:29.902495 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:25:29.902495 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:25:29.902495 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:25:29.902495 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:25:29.902495 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:25:29.902495 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:25:29.902495 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:25:29.902495 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:25:29.902495 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 01 15:25:29.902495 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 01 15:25:29.902495 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 289/569] 10.222.0.102 () {56 vars in 1107 bytes} [Mon Aug 1 15:25:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:25:29.902495 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b3ea1a-656c-448b-b5ba-c62450a6afeb None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:29.932762 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:29.970234 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629642f3-e4b1-41fc-8f5f-1cb12e96f945 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:30.004215 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8434ecf5-cd36-49f2-bab8-59abe804259f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:30.004880 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8434ecf5-cd36-49f2-bab8-59abe804259f None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:30.005168 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8434ecf5-cd36-49f2-bab8-59abe804259f None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:30.005443 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8434ecf5-cd36-49f2-bab8-59abe804259f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:30.010138 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b3ea1a-656c-448b-b5ba-c62450a6afeb None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:30.016297 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8434ecf5-cd36-49f2-bab8-59abe804259f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:30.017775 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8434ecf5-cd36-49f2-bab8-59abe804259f None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:30.032583 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-8434ecf5-cd36-49f2-bab8-59abe804259f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:25:30.032583 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:25:30.032583 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:25:30.032583 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:25:30.032583 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:25:30.032583 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:25:30.032583 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:25:30.032583 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:25:30.032583 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:25:30.032583 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:25:30.032583 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:25:30.032583 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:25:30.032583 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:25:30.032583 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:25:30.032583 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:25:30.033698 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:25:30.033698 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:25:30.033698 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:25:30.033698 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:25:30.033698 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:25:30.033698 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:25:30.033698 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:25:30.033698 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:25:30.033698 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 01 15:25:30.033698 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:25:30.033698 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:25:30.033698 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:25:30.033698 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:25:30.033698 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:25:30.033698 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:25:30.033698 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:25:30.033698 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:25:30.034822 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:25:30.034822 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:25:30.034822 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:25:30.034822 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 01 15:25:30.034822 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 281/570] 10.222.0.102 () {56 vars in 1113 bytes} [Mon Aug 1 15:25:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:25:30.034822 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8434ecf5-cd36-49f2-bab8-59abe804259f None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:30.049216 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12514df4-f8db-4447-90b1-b746eb000416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:30.049793 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12514df4-f8db-4447-90b1-b746eb000416 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:30.050071 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12514df4-f8db-4447-90b1-b746eb000416 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:30.050346 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12514df4-f8db-4447-90b1-b746eb000416 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:30.056977 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:30.057118 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12514df4-f8db-4447-90b1-b746eb000416 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:30.058436 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12514df4-f8db-4447-90b1-b746eb000416 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:30.069787 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-12514df4-f8db-4447-90b1-b746eb000416 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 15:25:30.069787 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:25:30.069787 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:25:30.069787 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:25:30.069787 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:25:30.069787 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:25:30.069787 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:25:30.069787 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:25:30.069787 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:25:30.069787 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:25:30.069787 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:25:30.069787 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:25:30.069787 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 15:25:30.069787 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 15:25:30.069787 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 15:25:30.071375 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 15:25:30.071375 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:25:30.071375 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:25:30.071375 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:25:30.071375 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:25:30.071375 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:25:30.071375 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:25:30.071375 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:25:30.071375 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 01 15:25:30.071375 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:25:30.071375 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:25:30.071375 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:25:30.071375 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:25:30.071375 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:25:30.071375 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:25:30.071375 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:25:30.071375 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:25:30.072583 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 15:25:30.072583 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 15:25:30.072583 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 15:25:30.072583 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 15:25:30.072583 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 15:25:30.072583 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 15:25:30.072583 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 15:25:30.072583 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 01 15:25:30.072583 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 290/571] 10.222.0.102 () {56 vars in 1116 bytes} [Mon Aug 1 15:25:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:25:30.072583 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda1878a-95fc-495d-a3e0-c167f4ab2ea8 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:30.074069 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda1878a-95fc-495d-a3e0-c167f4ab2ea8 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:30.074069 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda1878a-95fc-495d-a3e0-c167f4ab2ea8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:30.091447 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-dda1878a-95fc-495d-a3e0-c167f4ab2ea8 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:25:30.092642 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-dda1878a-95fc-495d-a3e0-c167f4ab2ea8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:25:30.137647 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8434ecf5-cd36-49f2-bab8-59abe804259f None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:30.160143 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 291/572] 10.222.0.102 () {58 vars in 1028 bytes} [Mon Aug 1 15:25:30 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 15:25:30.161056 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda1878a-95fc-495d-a3e0-c167f4ab2ea8 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:30.181846 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:30.184497 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca08aca-c82e-4faf-a51a-fcc5f4f47d1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:30.185221 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca08aca-c82e-4faf-a51a-fcc5f4f47d1d None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:30.185515 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca08aca-c82e-4faf-a51a-fcc5f4f47d1d None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:30.185846 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca08aca-c82e-4faf-a51a-fcc5f4f47d1d None admin] PATH_INFO: `/v3/domains` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:30.186537 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca08aca-c82e-4faf-a51a-fcc5f4f47d1d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:25:30.186837 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca08aca-c82e-4faf-a51a-fcc5f4f47d1d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:30.188263 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca08aca-c82e-4faf-a51a-fcc5f4f47d1d None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:30.200720 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 282/573] 10.222.0.102 () {56 vars in 1114 bytes} [Mon Aug 1 15:25:30 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:30.201814 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca08aca-c82e-4faf-a51a-fcc5f4f47d1d None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:30.259773 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda1878a-95fc-495d-a3e0-c167f4ab2ea8 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:30.283460 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:30.293444 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d632e43a-4f0d-46e6-9219-efb5c8520fab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:30.294057 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d632e43a-4f0d-46e6-9219-efb5c8520fab None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:30.294330 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d632e43a-4f0d-46e6-9219-efb5c8520fab None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:30.294596 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d632e43a-4f0d-46e6-9219-efb5c8520fab None admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:30.295297 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d632e43a-4f0d-46e6-9219-efb5c8520fab None admin] RBAC: Adding query filter params (name=service) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:25:30.295591 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d632e43a-4f0d-46e6-9219-efb5c8520fab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:30.296970 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d632e43a-4f0d-46e6-9219-efb5c8520fab None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:30.302039 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca08aca-c82e-4faf-a51a-fcc5f4f47d1d None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:30.304692 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 292/574] 10.222.0.102 () {56 vars in 1108 bytes} [Mon Aug 1 15:25:30 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:30.305508 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d632e43a-4f0d-46e6-9219-efb5c8520fab None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:30.341418 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96ac6ad-c298-4240-9e04-239e80d60de2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:30.342027 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96ac6ad-c298-4240-9e04-239e80d60de2 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:30.342305 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96ac6ad-c298-4240-9e04-239e80d60de2 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:30.342572 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96ac6ad-c298-4240-9e04-239e80d60de2 None admin] PATH_INFO: `/v3/domains` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:30.343257 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96ac6ad-c298-4240-9e04-239e80d60de2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:25:30.343552 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96ac6ad-c298-4240-9e04-239e80d60de2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:30.345035 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96ac6ad-c298-4240-9e04-239e80d60de2 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:30.356076 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 283/575] 10.222.0.102 () {56 vars in 1114 bytes} [Mon Aug 1 15:25:30 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:30.356872 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96ac6ad-c298-4240-9e04-239e80d60de2 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:30.389059 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:30.407825 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d632e43a-4f0d-46e6-9219-efb5c8520fab None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:30.444037 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30943b4-658d-49da-b1ab-d5e802c6e062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:30.444642 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30943b4-658d-49da-b1ab-d5e802c6e062 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:30.444950 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30943b4-658d-49da-b1ab-d5e802c6e062 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:30.445272 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30943b4-658d-49da-b1ab-d5e802c6e062 None admin] PATH_INFO: `/v3/projects` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:30.446014 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30943b4-658d-49da-b1ab-d5e802c6e062 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:25:30.446315 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30943b4-658d-49da-b1ab-d5e802c6e062 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:30.447739 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30943b4-658d-49da-b1ab-d5e802c6e062 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:30.455047 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96ac6ad-c298-4240-9e04-239e80d60de2 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:30.459239 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 293/576] 10.222.0.102 () {56 vars in 1153 bytes} [Mon Aug 1 15:25:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:30.460019 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30943b4-658d-49da-b1ab-d5e802c6e062 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:30.491780 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f0b1f1-f11d-4f02-9c21-21370db18ce2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:30.492419 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f0b1f1-f11d-4f02-9c21-21370db18ce2 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:30.492700 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f0b1f1-f11d-4f02-9c21-21370db18ce2 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:30.493016 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f0b1f1-f11d-4f02-9c21-21370db18ce2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:30.500509 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:30.503902 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f0b1f1-f11d-4f02-9c21-21370db18ce2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:25:30.508752 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-94f0b1f1-f11d-4f02-9c21-21370db18ce2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 01 15:25:30.508752 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:25:30.508752 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:25:30.508752 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:25:30.508752 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:25:30.508752 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:25:30.508752 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:25:30.508752 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:25:30.508752 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:25:30.508752 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:25:30.508752 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:25:30.508752 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:25:30.508752 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:25:30.508752 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:25:30.508752 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:25:30.508752 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:25:30.509713 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:25:30.509713 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:25:30.509713 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:25:30.509713 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:25:30.509713 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:25:30.509713 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:25:30.509713 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:25:30.509713 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:25:30.509713 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:25:30.509713 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:25:30.509713 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:25:30.509713 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 01 15:25:30.509713 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:25:30.509713 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:25:30.509713 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:25:30.509713 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:25:30.510643 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:25:30.510643 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:25:30.510643 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:25:30.510643 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:25:30.510643 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:25:30.510643 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:25:30.510643 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:25:30.510643 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:25:30.510643 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:25:30.510643 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:25:30.510643 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 01 15:25:30.510643 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 01 15:25:30.510643 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 284/577] 10.222.0.102 () {56 vars in 1107 bytes} [Mon Aug 1 15:25:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:25:30.511361 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f0b1f1-f11d-4f02-9c21-21370db18ce2 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:30.559920 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30943b4-658d-49da-b1ab-d5e802c6e062 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:30.593659 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83551be-66ac-457e-8c21-212d69854284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:30.594287 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83551be-66ac-457e-8c21-212d69854284 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:30.594564 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83551be-66ac-457e-8c21-212d69854284 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:30.594842 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83551be-66ac-457e-8c21-212d69854284 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:30.602630 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83551be-66ac-457e-8c21-212d69854284 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:30.604066 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83551be-66ac-457e-8c21-212d69854284 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:30.613590 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f0b1f1-f11d-4f02-9c21-21370db18ce2 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:30.615026 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-a83551be-66ac-457e-8c21-212d69854284 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 01 15:25:30.615026 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:25:30.615026 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:25:30.615026 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:25:30.615026 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:25:30.615026 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:25:30.615026 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:25:30.615026 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:25:30.615026 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:25:30.615026 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:25:30.615026 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:25:30.615026 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:25:30.615026 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 15:25:30.615026 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 15:25:30.615026 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 15:25:30.615026 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 15:25:30.615931 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:25:30.615931 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:25:30.615931 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 15:25:30.615931 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 15:25:30.615931 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 15:25:30.615931 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 15:25:30.615931 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:25:30.615931 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:25:30.615931 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:25:30.615931 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:25:30.615931 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:25:30.615931 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 01 15:25:30.615931 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:25:30.615931 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:25:30.615931 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:25:30.615931 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:25:30.615931 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:25:30.615931 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:25:30.616946 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:25:30.616946 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:25:30.616946 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 15:25:30.616946 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 15:25:30.616946 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 15:25:30.616946 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 15:25:30.616946 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 15:25:30.616946 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 15:25:30.616946 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 01 15:25:30.616946 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 01 15:25:30.616946 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 294/578] 10.222.0.102 () {56 vars in 1098 bytes} [Mon Aug 1 15:25:30 2022] GET /identity/v3/users/nova => generated 82 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:25:30.616946 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83551be-66ac-457e-8c21-212d69854284 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:30.619432 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:30.649971 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8642eca8-ed56-4c7c-a82a-d3c570d0029f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:30.650609 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8642eca8-ed56-4c7c-a82a-d3c570d0029f None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:30.650887 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8642eca8-ed56-4c7c-a82a-d3c570d0029f None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:30.651161 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8642eca8-ed56-4c7c-a82a-d3c570d0029f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:30.661435 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8642eca8-ed56-4c7c-a82a-d3c570d0029f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:30.662893 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8642eca8-ed56-4c7c-a82a-d3c570d0029f None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:30.677227 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-8642eca8-ed56-4c7c-a82a-d3c570d0029f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:25:30.677227 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:25:30.677227 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:25:30.677227 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:25:30.677227 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:25:30.677227 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:25:30.677227 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:25:30.677227 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:25:30.677227 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:25:30.677227 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:25:30.677227 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:25:30.677227 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:25:30.677227 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:25:30.677227 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:25:30.677227 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:25:30.678139 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:25:30.678139 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:25:30.678139 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:25:30.678139 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:25:30.678139 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:25:30.678139 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:25:30.678139 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:25:30.678139 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:25:30.678139 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 01 15:25:30.678139 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:25:30.678139 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:25:30.678139 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:25:30.678139 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:25:30.678139 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:25:30.678139 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:25:30.678139 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:25:30.678139 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:25:30.679113 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:25:30.679113 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:25:30.679113 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:25:30.679113 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 01 15:25:30.679113 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 285/579] 10.222.0.102 () {56 vars in 1113 bytes} [Mon Aug 1 15:25:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:25:30.679113 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8642eca8-ed56-4c7c-a82a-d3c570d0029f None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:30.723671 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83551be-66ac-457e-8c21-212d69854284 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:30.753101 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:30.756868 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1ec6c6-fe61-403b-883e-897de167a109 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:30.757504 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1ec6c6-fe61-403b-883e-897de167a109 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:30.758286 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1ec6c6-fe61-403b-883e-897de167a109 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:30.758557 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1ec6c6-fe61-403b-883e-897de167a109 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:30.765401 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1ec6c6-fe61-403b-883e-897de167a109 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:30.766838 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1ec6c6-fe61-403b-883e-897de167a109 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:30.778733 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-4b1ec6c6-fe61-403b-883e-897de167a109 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 15:25:30.778733 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:25:30.778733 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:25:30.778733 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:25:30.778733 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:25:30.778733 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:25:30.778733 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:25:30.778733 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:25:30.778733 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:25:30.778733 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:25:30.778733 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:25:30.778733 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:25:30.778733 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 15:25:30.778733 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 15:25:30.778733 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 15:25:30.779824 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 15:25:30.779824 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:25:30.779824 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:25:30.779824 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:25:30.779824 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:25:30.779824 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:25:30.779824 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:25:30.779824 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:25:30.779824 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 01 15:25:30.779824 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:25:30.779824 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:25:30.779824 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:25:30.779824 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:25:30.779824 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:25:30.779824 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:25:30.779824 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:25:30.779824 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:25:30.781128 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 15:25:30.781128 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 15:25:30.781128 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 15:25:30.781128 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 15:25:30.781128 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 15:25:30.781128 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 15:25:30.781128 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 15:25:30.781128 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 01 15:25:30.781128 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 295/580] 10.222.0.102 () {56 vars in 1116 bytes} [Mon Aug 1 15:25:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:25:30.781128 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1ec6c6-fe61-403b-883e-897de167a109 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:30.803974 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8642eca8-ed56-4c7c-a82a-d3c570d0029f None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:30.837652 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29be52d1-744c-4600-bd9e-4a84e52c226b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:30.838249 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29be52d1-744c-4600-bd9e-4a84e52c226b None admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:30.838532 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29be52d1-744c-4600-bd9e-4a84e52c226b None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:30.838805 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29be52d1-744c-4600-bd9e-4a84e52c226b None admin] PATH_INFO: `/v3/projects/2eb32fbe631843d8be84d41f8ba88d6e/users/613da2657ae34558b355cac53c8bf29a/roles/3087c03acf8d44d9ae512385924c5d0d` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:30.845215 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:30.853186 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29be52d1-744c-4600-bd9e-4a84e52c226b None admin] RBAC: Authorizing `identity:create_grant(project_id=2eb32fbe631843d8be84d41f8ba88d6e, user_id=613da2657ae34558b355cac53c8bf29a, role_id=3087c03acf8d44d9ae512385924c5d0d)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:30.854694 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29be52d1-744c-4600-bd9e-4a84e52c226b None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:30.884477 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1ec6c6-fe61-403b-883e-897de167a109 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:30.917900 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9b95f3-c786-455e-986c-d802cb6c76f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:30.918500 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9b95f3-c786-455e-986c-d802cb6c76f1 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:30.918806 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9b95f3-c786-455e-986c-d802cb6c76f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:30.919081 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9b95f3-c786-455e-986c-d802cb6c76f1 None admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:30.919783 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9b95f3-c786-455e-986c-d802cb6c76f1 None admin] RBAC: Adding query filter params (name=service) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:25:30.920086 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9b95f3-c786-455e-986c-d802cb6c76f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:30.921474 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9b95f3-c786-455e-986c-d802cb6c76f1 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:30.926130 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 286/581] 10.222.0.102 () {58 vars in 1444 bytes} [Mon Aug 1 15:25:30 2022] PUT /identity/v3/projects/2eb32fbe631843d8be84d41f8ba88d6e/users/613da2657ae34558b355cac53c8bf29a/roles/3087c03acf8d44d9ae512385924c5d0d => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:25:30.926754 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29be52d1-744c-4600-bd9e-4a84e52c226b None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:30.929612 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 296/582] 10.222.0.102 () {56 vars in 1108 bytes} [Mon Aug 1 15:25:30 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:30.930443 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9b95f3-c786-455e-986c-d802cb6c76f1 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:31.045214 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9b95f3-c786-455e-986c-d802cb6c76f1 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:31.061010 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29be52d1-744c-4600-bd9e-4a84e52c226b None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:31.062698 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:31.073384 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:31.089947 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a937b774-c4e3-45f3-96d9-bb68829d1e0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:31.090500 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a937b774-c4e3-45f3-96d9-bb68829d1e0b None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:31.090939 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a937b774-c4e3-45f3-96d9-bb68829d1e0b None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:31.091217 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a937b774-c4e3-45f3-96d9-bb68829d1e0b None admin] PATH_INFO: `/v3/domains` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:31.092256 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a937b774-c4e3-45f3-96d9-bb68829d1e0b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:25:31.092564 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a937b774-c4e3-45f3-96d9-bb68829d1e0b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:31.093988 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a937b774-c4e3-45f3-96d9-bb68829d1e0b None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:31.106463 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 297/583] 10.222.0.102 () {56 vars in 1114 bytes} [Mon Aug 1 15:25:30 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:31.107637 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a937b774-c4e3-45f3-96d9-bb68829d1e0b None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:31.108499 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32275c9d-6d03-43ee-8984-a79ab439e423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:31.109348 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32275c9d-6d03-43ee-8984-a79ab439e423 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:31.109786 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32275c9d-6d03-43ee-8984-a79ab439e423 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:31.110194 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32275c9d-6d03-43ee-8984-a79ab439e423 None admin] PATH_INFO: `/v3/users` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:31.111204 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32275c9d-6d03-43ee-8984-a79ab439e423 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:25:31.111675 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32275c9d-6d03-43ee-8984-a79ab439e423 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:31.113372 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32275c9d-6d03-43ee-8984-a79ab439e423 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:31.136672 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 287/584] 10.222.0.102 () {56 vars in 1138 bytes} [Mon Aug 1 15:25:30 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 370 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:31.136672 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32275c9d-6d03-43ee-8984-a79ab439e423 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:31.219558 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a937b774-c4e3-45f3-96d9-bb68829d1e0b None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:31.246370 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32275c9d-6d03-43ee-8984-a79ab439e423 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:31.254773 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425c3671-81d6-4d5c-9b7e-905571bb4960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:31.255393 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425c3671-81d6-4d5c-9b7e-905571bb4960 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:31.255733 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425c3671-81d6-4d5c-9b7e-905571bb4960 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:31.256009 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425c3671-81d6-4d5c-9b7e-905571bb4960 None admin] PATH_INFO: `/v3/projects` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:31.256785 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425c3671-81d6-4d5c-9b7e-905571bb4960 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:25:31.257117 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425c3671-81d6-4d5c-9b7e-905571bb4960 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:31.258591 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425c3671-81d6-4d5c-9b7e-905571bb4960 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:31.270229 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 298/585] 10.222.0.102 () {56 vars in 1153 bytes} [Mon Aug 1 15:25:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:31.271039 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425c3671-81d6-4d5c-9b7e-905571bb4960 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:31.291807 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4c965f-3f0f-4a70-b59d-40960b2cf061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:31.292450 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4c965f-3f0f-4a70-b59d-40960b2cf061 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:31.292780 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4c965f-3f0f-4a70-b59d-40960b2cf061 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:31.293097 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4c965f-3f0f-4a70-b59d-40960b2cf061 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:31.304175 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4c965f-3f0f-4a70-b59d-40960b2cf061 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:31.305684 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4c965f-3f0f-4a70-b59d-40960b2cf061 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:31.321032 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-4c4c965f-3f0f-4a70-b59d-40960b2cf061 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:25:31.321032 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:25:31.321032 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:25:31.321032 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:25:31.321032 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:25:31.321032 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:25:31.321032 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:25:31.321032 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:25:31.321032 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:25:31.321032 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:25:31.321032 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:25:31.321032 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:25:31.321032 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:25:31.321032 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:25:31.321032 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:25:31.321960 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:25:31.321960 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:25:31.321960 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:25:31.321960 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:25:31.321960 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:25:31.321960 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:25:31.321960 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:25:31.321960 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:25:31.321960 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 01 15:25:31.321960 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:25:31.321960 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:25:31.321960 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:25:31.321960 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:25:31.321960 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:25:31.321960 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:25:31.321960 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:25:31.321960 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:25:31.322860 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:25:31.322860 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:25:31.322860 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:25:31.322860 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 01 15:25:31.322860 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 288/586] 10.222.0.102 () {56 vars in 1113 bytes} [Mon Aug 1 15:25:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:25:31.323141 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:31.323833 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4c965f-3f0f-4a70-b59d-40960b2cf061 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:31.339648 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:31.393838 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425c3671-81d6-4d5c-9b7e-905571bb4960 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:31.430486 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4c965f-3f0f-4a70-b59d-40960b2cf061 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:31.430838 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca634c6-35dc-4211-aada-13272e3c035b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:31.431467 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca634c6-35dc-4211-aada-13272e3c035b None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:31.431740 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca634c6-35dc-4211-aada-13272e3c035b None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:31.432116 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca634c6-35dc-4211-aada-13272e3c035b None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:31.441050 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca634c6-35dc-4211-aada-13272e3c035b None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:31.442492 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca634c6-35dc-4211-aada-13272e3c035b None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:31.454738 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-0ca634c6-35dc-4211-aada-13272e3c035b None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 01 15:25:31.454738 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:25:31.454738 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:25:31.454738 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:25:31.454738 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:25:31.454738 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:25:31.454738 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:25:31.454738 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:25:31.454738 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:25:31.454738 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:25:31.454738 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:25:31.454738 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:25:31.454738 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 15:25:31.454738 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 15:25:31.454738 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 15:25:31.454738 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 15:25:31.455858 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:25:31.455858 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:25:31.455858 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 15:25:31.455858 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 15:25:31.455858 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 15:25:31.455858 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 15:25:31.455858 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:25:31.455858 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:25:31.455858 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:25:31.455858 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:25:31.455858 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:25:31.455858 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 01 15:25:31.455858 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:25:31.455858 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:25:31.455858 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:25:31.455858 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:25:31.455858 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:25:31.455858 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:25:31.456810 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:25:31.456810 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:25:31.456810 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 15:25:31.456810 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 15:25:31.456810 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 15:25:31.456810 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 15:25:31.456810 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 15:25:31.456810 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 15:25:31.456810 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 01 15:25:31.456810 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 01 15:25:31.456810 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 299/587] 10.222.0.102 () {56 vars in 1107 bytes} [Mon Aug 1 15:25:31 2022] GET /identity/v3/users/neutron => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:25:31.457424 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca634c6-35dc-4211-aada-13272e3c035b None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:31.474013 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4147403c-0f38-4908-8d09-71884bf7a370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:31.474856 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4147403c-0f38-4908-8d09-71884bf7a370 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:31.475095 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4147403c-0f38-4908-8d09-71884bf7a370 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:31.475348 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4147403c-0f38-4908-8d09-71884bf7a370 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:31.488264 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4147403c-0f38-4908-8d09-71884bf7a370 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:31.489727 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4147403c-0f38-4908-8d09-71884bf7a370 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:31.504492 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-4147403c-0f38-4908-8d09-71884bf7a370 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:25:31.504492 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:25:31.504492 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:25:31.504492 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:25:31.504492 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:25:31.504492 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:25:31.504492 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:25:31.504492 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:25:31.504492 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:25:31.504492 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:25:31.504492 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:25:31.504492 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:25:31.504492 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:25:31.504492 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:25:31.504492 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:25:31.505470 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:25:31.505470 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:25:31.505470 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:25:31.505470 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:25:31.505470 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:25:31.505470 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:25:31.505470 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:25:31.505470 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:25:31.505470 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 01 15:25:31.505470 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:25:31.505470 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:25:31.505470 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:25:31.505470 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:25:31.505470 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:25:31.505470 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:25:31.505470 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:25:31.505470 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:25:31.506417 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:25:31.506417 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:25:31.506417 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:25:31.506417 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 01 15:25:31.506417 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 289/588] 10.222.0.102 () {56 vars in 1113 bytes} [Mon Aug 1 15:25:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:25:31.506417 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4147403c-0f38-4908-8d09-71884bf7a370 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:31.572683 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca634c6-35dc-4211-aada-13272e3c035b None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:31.573911 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:31.576075 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:31.612135 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0a85ae-c556-4d90-baa3-0be5cdc53005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:31.612805 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0a85ae-c556-4d90-baa3-0be5cdc53005 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:31.613071 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0a85ae-c556-4d90-baa3-0be5cdc53005 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:31.613342 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0a85ae-c556-4d90-baa3-0be5cdc53005 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:31.614195 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0a85ae-c556-4d90-baa3-0be5cdc53005 None admin] RBAC: Adding query filter params (role.id=3087c03acf8d44d9ae512385924c5d0d, scope.project.id=2eb32fbe631843d8be84d41f8ba88d6e, user.id=90673f47354f4403aa0e12e3658441c8) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:25:31.614554 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0a85ae-c556-4d90-baa3-0be5cdc53005 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:31.616065 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0a85ae-c556-4d90-baa3-0be5cdc53005 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:31.618462 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4147403c-0f38-4908-8d09-71884bf7a370 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:31.621772 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 300/589] 10.222.0.102 () {56 vars in 1379 bytes} [Mon Aug 1 15:25:31 2022] GET /identity/v3/role_assignments?user.id=90673f47354f4403aa0e12e3658441c8&scope.project.id=2eb32fbe631843d8be84d41f8ba88d6e&role.id=3087c03acf8d44d9ae512385924c5d0d => generated 260 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:31.629118 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0a85ae-c556-4d90-baa3-0be5cdc53005 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:31.659147 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e9b45b-616c-4de7-926e-8deb5b3804d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:31.659970 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e9b45b-616c-4de7-926e-8deb5b3804d4 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:31.660364 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e9b45b-616c-4de7-926e-8deb5b3804d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:31.660728 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e9b45b-616c-4de7-926e-8deb5b3804d4 None admin] PATH_INFO: `/v3/domains` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:31.661569 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e9b45b-616c-4de7-926e-8deb5b3804d4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:25:31.662011 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e9b45b-616c-4de7-926e-8deb5b3804d4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:31.663588 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e9b45b-616c-4de7-926e-8deb5b3804d4 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:31.679270 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 290/590] 10.222.0.102 () {56 vars in 1114 bytes} [Mon Aug 1 15:25:31 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:31.681125 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e9b45b-616c-4de7-926e-8deb5b3804d4 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:31.771127 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0a85ae-c556-4d90-baa3-0be5cdc53005 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:31.797470 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e9b45b-616c-4de7-926e-8deb5b3804d4 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:31.809404 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02e5844-5db6-4d66-8c2e-f8f82c458452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:31.810023 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02e5844-5db6-4d66-8c2e-f8f82c458452 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:31.810302 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02e5844-5db6-4d66-8c2e-f8f82c458452 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:31.810576 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02e5844-5db6-4d66-8c2e-f8f82c458452 None admin] PATH_INFO: `/v3/users` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:31.811371 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02e5844-5db6-4d66-8c2e-f8f82c458452 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:25:31.811677 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02e5844-5db6-4d66-8c2e-f8f82c458452 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:31.813140 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02e5844-5db6-4d66-8c2e-f8f82c458452 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:31.836771 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 301/591] 10.222.0.102 () {56 vars in 1144 bytes} [Mon Aug 1 15:25:31 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 376 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:31.836771 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02e5844-5db6-4d66-8c2e-f8f82c458452 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:31.843442 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:31.854872 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e556b3d-b359-4170-ab73-e823176d6d83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:31.855490 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e556b3d-b359-4170-ab73-e823176d6d83 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:31.856683 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e556b3d-b359-4170-ab73-e823176d6d83 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:31.856683 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e556b3d-b359-4170-ab73-e823176d6d83 None admin] PATH_INFO: `/v3/domains` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:31.856883 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e556b3d-b359-4170-ab73-e823176d6d83 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:25:31.857148 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e556b3d-b359-4170-ab73-e823176d6d83 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:31.858786 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e556b3d-b359-4170-ab73-e823176d6d83 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:31.875337 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 291/592] 10.222.0.102 () {56 vars in 1114 bytes} [Mon Aug 1 15:25:31 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:31.875337 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e556b3d-b359-4170-ab73-e823176d6d83 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:31.882421 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:31.980758 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02e5844-5db6-4d66-8c2e-f8f82c458452 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:31.988363 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e556b3d-b359-4170-ab73-e823176d6d83 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:32.022453 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ae6ca8-069b-4865-bbf4-4d8a6d1f4743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:32.023105 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ae6ca8-069b-4865-bbf4-4d8a6d1f4743 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:32.024061 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ae6ca8-069b-4865-bbf4-4d8a6d1f4743 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:32.024281 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ae6ca8-069b-4865-bbf4-4d8a6d1f4743 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:32.032233 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ae6ca8-069b-4865-bbf4-4d8a6d1f4743 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:32.033728 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ae6ca8-069b-4865-bbf4-4d8a6d1f4743 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:32.034698 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a937c200-7719-493b-a809-2c8f9aa603b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:32.035826 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a937c200-7719-493b-a809-2c8f9aa603b4 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:32.036919 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a937c200-7719-493b-a809-2c8f9aa603b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:32.037412 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a937c200-7719-493b-a809-2c8f9aa603b4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:32.047366 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-b2ae6ca8-069b-4865-bbf4-4d8a6d1f4743 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 01 15:25:32.047366 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:25:32.047366 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:25:32.047366 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:25:32.047366 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:25:32.047366 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:25:32.047366 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:25:32.047366 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:25:32.047366 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:25:32.047366 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:25:32.047366 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:25:32.047366 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:25:32.047366 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 15:25:32.047366 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 15:25:32.047366 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 15:25:32.047366 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 15:25:32.048407 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:25:32.048407 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:25:32.048407 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 15:25:32.048407 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 15:25:32.048407 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 15:25:32.048407 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 15:25:32.048407 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:25:32.048407 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:25:32.048407 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:25:32.048407 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:25:32.048407 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:25:32.048407 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 01 15:25:32.048407 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:25:32.048407 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:25:32.048407 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:25:32.048407 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:25:32.048407 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:25:32.048407 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:25:32.049408 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:25:32.049408 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:25:32.049408 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 15:25:32.049408 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 15:25:32.049408 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 15:25:32.049408 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 15:25:32.049408 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 15:25:32.049408 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 15:25:32.049408 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 01 15:25:32.049408 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 01 15:25:32.053198 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 302/593] 10.222.0.102 () {56 vars in 1104 bytes} [Mon Aug 1 15:25:31 2022] GET /identity/v3/users/cinder => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:25:32.054313 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ae6ca8-069b-4865-bbf4-4d8a6d1f4743 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:32.055272 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a937c200-7719-493b-a809-2c8f9aa603b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:32.057028 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a937c200-7719-493b-a809-2c8f9aa603b4 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:32.075944 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-a937c200-7719-493b-a809-2c8f9aa603b4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:25:32.075944 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:25:32.075944 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:25:32.075944 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:25:32.075944 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:25:32.075944 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:25:32.075944 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:25:32.075944 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:25:32.075944 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:25:32.075944 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:25:32.075944 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:25:32.075944 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:25:32.075944 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:25:32.075944 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:25:32.075944 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:25:32.077219 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:25:32.077219 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:25:32.077219 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:25:32.077219 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:25:32.077219 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:25:32.077219 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:25:32.077219 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:25:32.077219 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:25:32.077219 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 01 15:25:32.077219 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:25:32.077219 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:25:32.077219 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:25:32.077219 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:25:32.077219 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:25:32.077219 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:25:32.077219 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:25:32.077219 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:25:32.078129 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:25:32.078129 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:25:32.078129 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:25:32.078129 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 01 15:25:32.082037 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 292/594] 10.222.0.102 () {56 vars in 1113 bytes} [Mon Aug 1 15:25:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:25:32.082893 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a937c200-7719-493b-a809-2c8f9aa603b4 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:32.120971 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:32.172386 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:32.189003 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ae6ca8-069b-4865-bbf4-4d8a6d1f4743 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:32.198226 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a937c200-7719-493b-a809-2c8f9aa603b4 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:32.228808 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a6ecb7-a67c-473d-aa23-f690940b1775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:32.229887 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a6ecb7-a67c-473d-aa23-f690940b1775 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:32.230388 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a6ecb7-a67c-473d-aa23-f690940b1775 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:32.230918 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a6ecb7-a67c-473d-aa23-f690940b1775 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:32.238659 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a6ecb7-a67c-473d-aa23-f690940b1775 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:32.240374 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a6ecb7-a67c-473d-aa23-f690940b1775 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:32.240729 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddca8b21-5ea6-484d-89fb-8c4bf39b6d2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:32.241380 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddca8b21-5ea6-484d-89fb-8c4bf39b6d2f None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:32.241649 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddca8b21-5ea6-484d-89fb-8c4bf39b6d2f None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:32.241961 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddca8b21-5ea6-484d-89fb-8c4bf39b6d2f None admin] PATH_INFO: `/v3/users` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:32.242795 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddca8b21-5ea6-484d-89fb-8c4bf39b6d2f None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:25:32.243100 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddca8b21-5ea6-484d-89fb-8c4bf39b6d2f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:32.245243 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddca8b21-5ea6-484d-89fb-8c4bf39b6d2f None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:32.264574 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 293/595] 10.222.0.102 () {56 vars in 1142 bytes} [Mon Aug 1 15:25:32 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 374 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:32.265550 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddca8b21-5ea6-484d-89fb-8c4bf39b6d2f None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:32.377505 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-75a6ecb7-a67c-473d-aa23-f690940b1775 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 15:25:32.377505 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:25:32.377505 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:25:32.377505 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:25:32.377505 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:25:32.377505 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:25:32.377505 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:25:32.377505 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:25:32.377505 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:25:32.377505 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:25:32.377505 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:25:32.377505 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:25:32.377505 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 15:25:32.377505 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 15:25:32.377505 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 15:25:32.378457 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 15:25:32.378457 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:25:32.378457 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:25:32.378457 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:25:32.378457 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:25:32.378457 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:25:32.378457 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:25:32.378457 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:25:32.378457 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 01 15:25:32.378457 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:25:32.378457 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:25:32.378457 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:25:32.378457 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:25:32.378457 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:25:32.378457 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:25:32.378457 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:25:32.378457 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:25:32.379345 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 15:25:32.379345 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 15:25:32.379345 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 15:25:32.379345 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 15:25:32.379345 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 15:25:32.379345 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 15:25:32.379345 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 15:25:32.379345 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 01 15:25:32.381733 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 303/596] 10.222.0.102 () {56 vars in 1116 bytes} [Mon Aug 1 15:25:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 328 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:25:32.382984 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a6ecb7-a67c-473d-aa23-f690940b1775 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:32.386195 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:32.402528 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddca8b21-5ea6-484d-89fb-8c4bf39b6d2f None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:32.450242 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7794558f-a93d-4fac-9534-c249a9bd482c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:32.451555 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7794558f-a93d-4fac-9534-c249a9bd482c None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:32.451886 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7794558f-a93d-4fac-9534-c249a9bd482c None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:32.452185 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7794558f-a93d-4fac-9534-c249a9bd482c None admin] PATH_INFO: `/v3/domains` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:32.453196 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7794558f-a93d-4fac-9534-c249a9bd482c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:25:32.453506 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7794558f-a93d-4fac-9534-c249a9bd482c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:32.455133 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7794558f-a93d-4fac-9534-c249a9bd482c None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:32.475333 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 294/597] 10.222.0.102 () {56 vars in 1114 bytes} [Mon Aug 1 15:25:32 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:32.475333 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7794558f-a93d-4fac-9534-c249a9bd482c None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:32.521224 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a6ecb7-a67c-473d-aa23-f690940b1775 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:32.559172 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c6e3d5-c453-4a3e-bde0-83df2fa392e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:32.560184 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c6e3d5-c453-4a3e-bde0-83df2fa392e8 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:32.560747 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c6e3d5-c453-4a3e-bde0-83df2fa392e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:32.561265 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c6e3d5-c453-4a3e-bde0-83df2fa392e8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:32.573158 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c6e3d5-c453-4a3e-bde0-83df2fa392e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:32.574969 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c6e3d5-c453-4a3e-bde0-83df2fa392e8 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:32.583379 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:32.592500 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-46c6e3d5-c453-4a3e-bde0-83df2fa392e8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:25:32.592500 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:25:32.592500 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:25:32.592500 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:25:32.592500 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:25:32.592500 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:25:32.592500 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:25:32.592500 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:25:32.592500 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:25:32.592500 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:25:32.592500 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:25:32.592500 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:25:32.592500 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:25:32.592500 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:25:32.592500 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:25:32.598748 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:25:32.598748 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:25:32.598748 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:25:32.598748 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:25:32.598748 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:25:32.598748 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:25:32.598748 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:25:32.598748 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:25:32.598748 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 01 15:25:32.598748 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:25:32.598748 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:25:32.598748 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:25:32.598748 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:25:32.598748 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:25:32.598748 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:25:32.598748 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:25:32.598748 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:25:32.599665 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:25:32.599665 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:25:32.599665 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:25:32.599665 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 01 15:25:32.599665 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 304/598] 10.222.0.102 () {56 vars in 1113 bytes} [Mon Aug 1 15:25:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:25:32.599665 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c6e3d5-c453-4a3e-bde0-83df2fa392e8 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:32.599992 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7794558f-a93d-4fac-9534-c249a9bd482c None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:32.643015 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80eab0f9-bf6a-4085-88f5-dc74481f9948 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:32.644133 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eab0f9-bf6a-4085-88f5-dc74481f9948 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:32.644422 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eab0f9-bf6a-4085-88f5-dc74481f9948 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:32.644700 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eab0f9-bf6a-4085-88f5-dc74481f9948 None admin] PATH_INFO: `/v3/projects` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:32.645495 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80eab0f9-bf6a-4085-88f5-dc74481f9948 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:25:32.645803 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80eab0f9-bf6a-4085-88f5-dc74481f9948 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:32.647925 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80eab0f9-bf6a-4085-88f5-dc74481f9948 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:32.666015 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 295/599] 10.222.0.102 () {56 vars in 1153 bytes} [Mon Aug 1 15:25:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:32.666949 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80eab0f9-bf6a-4085-88f5-dc74481f9948 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:32.687805 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:32.711956 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c6e3d5-c453-4a3e-bde0-83df2fa392e8 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:32.761622 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d11e55-f233-427c-831b-e58f5b88a35c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:32.762451 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d11e55-f233-427c-831b-e58f5b88a35c None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:32.762945 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d11e55-f233-427c-831b-e58f5b88a35c None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:32.763430 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d11e55-f233-427c-831b-e58f5b88a35c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:32.774459 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d11e55-f233-427c-831b-e58f5b88a35c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:32.775879 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d11e55-f233-427c-831b-e58f5b88a35c None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:32.789996 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-d1d11e55-f233-427c-831b-e58f5b88a35c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 15:25:32.789996 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:25:32.789996 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:25:32.789996 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:25:32.789996 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:25:32.789996 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:25:32.789996 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:25:32.789996 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:25:32.789996 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:25:32.789996 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:25:32.789996 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:25:32.789996 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:25:32.789996 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 15:25:32.789996 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 15:25:32.789996 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 15:25:32.790961 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 15:25:32.790961 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:25:32.790961 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:25:32.790961 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:25:32.790961 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:25:32.790961 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:25:32.790961 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:25:32.790961 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:25:32.790961 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 01 15:25:32.790961 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:25:32.790961 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:25:32.790961 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:25:32.790961 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:25:32.790961 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:25:32.790961 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:25:32.790961 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:25:32.790961 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:25:32.791835 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 15:25:32.791835 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 15:25:32.791835 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 15:25:32.791835 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 15:25:32.791835 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 15:25:32.791835 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 15:25:32.791835 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 15:25:32.791835 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 01 15:25:32.791835 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 305/600] 10.222.0.102 () {56 vars in 1116 bytes} [Mon Aug 1 15:25:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:25:32.792780 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d11e55-f233-427c-831b-e58f5b88a35c None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:32.809592 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80eab0f9-bf6a-4085-88f5-dc74481f9948 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:32.849665 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8f1fd8-8a02-4f5d-9ff2-1749c0936453 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:32.850386 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8f1fd8-8a02-4f5d-9ff2-1749c0936453 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:32.850670 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8f1fd8-8a02-4f5d-9ff2-1749c0936453 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:32.850942 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8f1fd8-8a02-4f5d-9ff2-1749c0936453 None admin] PATH_INFO: `/v3/domains` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:32.852196 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8f1fd8-8a02-4f5d-9ff2-1749c0936453 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:25:32.852496 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8f1fd8-8a02-4f5d-9ff2-1749c0936453 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:32.854011 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8f1fd8-8a02-4f5d-9ff2-1749c0936453 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:32.859484 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:32.871544 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 296/601] 10.222.0.102 () {56 vars in 1114 bytes} [Mon Aug 1 15:25:32 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:32.872390 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8f1fd8-8a02-4f5d-9ff2-1749c0936453 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:32.911070 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d11e55-f233-427c-831b-e58f5b88a35c None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:32.946308 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d37711f-b571-4752-bf41-6faddcf9205d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:32.946972 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d37711f-b571-4752-bf41-6faddcf9205d None admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:32.947245 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d37711f-b571-4752-bf41-6faddcf9205d None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:32.947511 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d37711f-b571-4752-bf41-6faddcf9205d None admin] PATH_INFO: `/v3/projects/2eb32fbe631843d8be84d41f8ba88d6e/users/77b43f1ee8cc4be3907a494abe90c1cc/roles/3087c03acf8d44d9ae512385924c5d0d` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:32.963672 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d37711f-b571-4752-bf41-6faddcf9205d None admin] RBAC: Authorizing `identity:create_grant(project_id=2eb32fbe631843d8be84d41f8ba88d6e, user_id=77b43f1ee8cc4be3907a494abe90c1cc, role_id=3087c03acf8d44d9ae512385924c5d0d)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:32.963861 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:32.966716 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d37711f-b571-4752-bf41-6faddcf9205d None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:32.990265 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8f1fd8-8a02-4f5d-9ff2-1749c0936453 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:33.025938 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1483a68d-9a9d-4c33-a231-d79c05a5bd25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:33.026501 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1483a68d-9a9d-4c33-a231-d79c05a5bd25 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:33.026760 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1483a68d-9a9d-4c33-a231-d79c05a5bd25 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:33.027027 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1483a68d-9a9d-4c33-a231-d79c05a5bd25 None admin] PATH_INFO: `/v3/projects` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:33.027768 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1483a68d-9a9d-4c33-a231-d79c05a5bd25 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:25:33.028067 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1483a68d-9a9d-4c33-a231-d79c05a5bd25 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:33.029524 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1483a68d-9a9d-4c33-a231-d79c05a5bd25 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:33.046757 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 306/602] 10.222.0.102 () {58 vars in 1444 bytes} [Mon Aug 1 15:25:32 2022] PUT /identity/v3/projects/2eb32fbe631843d8be84d41f8ba88d6e/users/77b43f1ee8cc4be3907a494abe90c1cc/roles/3087c03acf8d44d9ae512385924c5d0d => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:25:33.046954 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 297/603] 10.222.0.102 () {56 vars in 1153 bytes} [Mon Aug 1 15:25:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:33.047049 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d37711f-b571-4752-bf41-6faddcf9205d None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:33.047160 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8706ca-7cb3-4061-ace1-fe7adc7ad9e3 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:33.047160 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8706ca-7cb3-4061-ace1-fe7adc7ad9e3 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:33.047160 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8706ca-7cb3-4061-ace1-fe7adc7ad9e3 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:33.047160 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 298/604] 10.222.0.102 () {54 vars in 931 bytes} [Mon Aug 1 15:25:33 2022] GET /identity => generated 271 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 15:25:33.052418 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b960f6-879c-4b29-be15-0ba7ecf17ee5 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:33.052418 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b960f6-879c-4b29-be15-0ba7ecf17ee5 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:33.052418 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b960f6-879c-4b29-be15-0ba7ecf17ee5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:33.074071 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-52b960f6-879c-4b29-be15-0ba7ecf17ee5 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:25:33.075289 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-52b960f6-879c-4b29-be15-0ba7ecf17ee5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:25:33.184004 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d37711f-b571-4752-bf41-6faddcf9205d None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:33.194583 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:33.208870 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 299/605] 10.222.0.102 () {58 vars in 1028 bytes} [Mon Aug 1 15:25:33 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 01 15:25:33.208870 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b960f6-879c-4b29-be15-0ba7ecf17ee5 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:33.247263 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee00086-a40b-4ccb-857a-f437fd63ad34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:33.248214 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee00086-a40b-4ccb-857a-f437fd63ad34 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:33.248698 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee00086-a40b-4ccb-857a-f437fd63ad34 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:33.249233 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee00086-a40b-4ccb-857a-f437fd63ad34 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:33.259601 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee00086-a40b-4ccb-857a-f437fd63ad34 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:33.261344 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee00086-a40b-4ccb-857a-f437fd63ad34 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:33.276579 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-fee00086-a40b-4ccb-857a-f437fd63ad34 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 15:25:33.276579 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:25:33.276579 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:25:33.276579 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:25:33.276579 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:25:33.276579 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:25:33.276579 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:25:33.276579 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:25:33.276579 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:25:33.276579 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:25:33.276579 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:25:33.276579 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:25:33.276579 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 15:25:33.276579 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 15:25:33.276579 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 15:25:33.277666 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 15:25:33.277666 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:25:33.277666 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:25:33.277666 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:25:33.277666 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:25:33.277666 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:25:33.277666 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:25:33.277666 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:25:33.277666 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 01 15:25:33.277666 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:25:33.277666 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:25:33.277666 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:25:33.277666 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:25:33.277666 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:25:33.277666 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:25:33.277666 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:25:33.277666 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:25:33.278727 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 15:25:33.278727 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 15:25:33.278727 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 15:25:33.278727 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 15:25:33.278727 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 15:25:33.278727 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 15:25:33.278727 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 15:25:33.278727 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 01 15:25:33.280918 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 307/606] 10.222.0.102 () {56 vars in 1116 bytes} [Mon Aug 1 15:25:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:25:33.281865 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee00086-a40b-4ccb-857a-f437fd63ad34 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:33.285874 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:33.333815 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b960f6-879c-4b29-be15-0ba7ecf17ee5 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:33.378894 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9151a058-913a-4c94-a7fa-acd48e39be85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:33.380002 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9151a058-913a-4c94-a7fa-acd48e39be85 None admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:33.380516 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9151a058-913a-4c94-a7fa-acd48e39be85 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:33.381051 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9151a058-913a-4c94-a7fa-acd48e39be85 None admin] PATH_INFO: `/v3/projects/2eb32fbe631843d8be84d41f8ba88d6e/users/a856a413100443939fe9b10daa868518/roles/3087c03acf8d44d9ae512385924c5d0d` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:33.392109 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee00086-a40b-4ccb-857a-f437fd63ad34 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:33.398707 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9151a058-913a-4c94-a7fa-acd48e39be85 None admin] RBAC: Authorizing `identity:create_grant(project_id=2eb32fbe631843d8be84d41f8ba88d6e, user_id=a856a413100443939fe9b10daa868518, role_id=3087c03acf8d44d9ae512385924c5d0d)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:33.400508 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9151a058-913a-4c94-a7fa-acd48e39be85 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:33.428056 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef66a30f-c0d4-466f-bc94-059e65986cda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:33.428692 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef66a30f-c0d4-466f-bc94-059e65986cda None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:33.428997 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef66a30f-c0d4-466f-bc94-059e65986cda None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:33.429261 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef66a30f-c0d4-466f-bc94-059e65986cda None admin] PATH_INFO: `/v3/roles/service` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:33.441340 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef66a30f-c0d4-466f-bc94-059e65986cda None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:25:33.446808 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-ef66a30f-c0d4-466f-bc94-059e65986cda None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 01 15:25:33.446808 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:25:33.446808 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:25:33.446808 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:25:33.446808 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:25:33.446808 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:25:33.446808 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:25:33.446808 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:25:33.446808 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:25:33.446808 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:25:33.446808 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:25:33.446808 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:25:33.446808 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:25:33.446808 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:25:33.446808 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:25:33.446808 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:25:33.448738 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:25:33.448738 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:25:33.448738 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:25:33.448738 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:25:33.448738 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:25:33.448738 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:25:33.448738 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:25:33.448738 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:25:33.448738 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:25:33.448738 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:25:33.448738 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:25:33.448738 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 01 15:25:33.448738 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:25:33.448738 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:25:33.448738 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:25:33.448738 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:25:33.450057 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:25:33.450057 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:25:33.450057 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:25:33.450057 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:25:33.450057 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:25:33.450057 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:25:33.450057 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:25:33.450057 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:25:33.450057 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:25:33.450057 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:25:33.450057 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 01 15:25:33.450057 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 01 15:25:33.450057 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 308/607] 10.222.0.102 () {56 vars in 1107 bytes} [Mon Aug 1 15:25:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:25:33.450057 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef66a30f-c0d4-466f-bc94-059e65986cda None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:33.480653 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:33.504728 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 300/608] 10.222.0.102 () {58 vars in 1444 bytes} [Mon Aug 1 15:25:33 2022] PUT /identity/v3/projects/2eb32fbe631843d8be84d41f8ba88d6e/users/a856a413100443939fe9b10daa868518/roles/3087c03acf8d44d9ae512385924c5d0d => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:25:33.510463 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9151a058-913a-4c94-a7fa-acd48e39be85 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:33.609641 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef66a30f-c0d4-466f-bc94-059e65986cda None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:33.649096 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f50f95-4a43-4d38-a446-0c4b6a003306 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:33.649980 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f50f95-4a43-4d38-a446-0c4b6a003306 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:33.650723 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f50f95-4a43-4d38-a446-0c4b6a003306 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:33.651172 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f50f95-4a43-4d38-a446-0c4b6a003306 None admin] PATH_INFO: `/v3/projects` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:33.652119 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f50f95-4a43-4d38-a446-0c4b6a003306 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:25:33.652570 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f50f95-4a43-4d38-a446-0c4b6a003306 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:33.654555 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f50f95-4a43-4d38-a446-0c4b6a003306 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:33.671151 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 309/609] 10.222.0.102 () {56 vars in 1153 bytes} [Mon Aug 1 15:25:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:33.678359 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f50f95-4a43-4d38-a446-0c4b6a003306 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:33.741509 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9151a058-913a-4c94-a7fa-acd48e39be85 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:33.758977 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:33.790840 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2615dfcb-52ce-4b11-a32d-bca8598fb1eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:33.791472 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2615dfcb-52ce-4b11-a32d-bca8598fb1eb None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:33.791783 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2615dfcb-52ce-4b11-a32d-bca8598fb1eb None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:33.792057 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2615dfcb-52ce-4b11-a32d-bca8598fb1eb None admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:33.792788 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2615dfcb-52ce-4b11-a32d-bca8598fb1eb None admin] RBAC: Adding query filter params (name=service) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:25:33.793136 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2615dfcb-52ce-4b11-a32d-bca8598fb1eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:33.795244 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2615dfcb-52ce-4b11-a32d-bca8598fb1eb None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:33.795781 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:33.806549 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 301/610] 10.222.0.102 () {56 vars in 1108 bytes} [Mon Aug 1 15:25:33 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:33.807164 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f50f95-4a43-4d38-a446-0c4b6a003306 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:33.812057 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f32d67e-3188-4515-a8db-945598e1e332 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:33.812057 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f32d67e-3188-4515-a8db-945598e1e332 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:33.812057 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f32d67e-3188-4515-a8db-945598e1e332 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:33.812057 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 302/611] 10.222.0.102 () {54 vars in 931 bytes} [Mon Aug 1 15:25:33 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 15:25:33.816111 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f32d67e-3188-4515-a8db-945598e1e332 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:33.852918 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a124763d-68cc-4a2f-9217-17198a295c79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:33.852918 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a124763d-68cc-4a2f-9217-17198a295c79 None admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:33.852918 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a124763d-68cc-4a2f-9217-17198a295c79 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:33.852918 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a124763d-68cc-4a2f-9217-17198a295c79 None admin] PATH_INFO: `/v3/projects/2eb32fbe631843d8be84d41f8ba88d6e/users/ff810b37183c4729859c1b05edff1703/roles/3087c03acf8d44d9ae512385924c5d0d` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:33.869051 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a124763d-68cc-4a2f-9217-17198a295c79 None admin] RBAC: Authorizing `identity:create_grant(project_id=2eb32fbe631843d8be84d41f8ba88d6e, user_id=ff810b37183c4729859c1b05edff1703, role_id=3087c03acf8d44d9ae512385924c5d0d)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:33.870561 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a124763d-68cc-4a2f-9217-17198a295c79 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:33.934439 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f32d67e-3188-4515-a8db-945598e1e332 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:33.968176 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 310/612] 10.222.0.102 () {58 vars in 1444 bytes} [Mon Aug 1 15:25:33 2022] PUT /identity/v3/projects/2eb32fbe631843d8be84d41f8ba88d6e/users/ff810b37183c4729859c1b05edff1703/roles/3087c03acf8d44d9ae512385924c5d0d => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:25:33.969566 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4aa042-f4f6-4e59-a15f-ddb1acd911cc None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:33.969854 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4aa042-f4f6-4e59-a15f-ddb1acd911cc None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:33.970131 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4aa042-f4f6-4e59-a15f-ddb1acd911cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:33.975542 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacbc8d4-bf1b-4950-bba5-aab70d96a87b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:33.976798 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacbc8d4-bf1b-4950-bba5-aab70d96a87b None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:33.977387 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacbc8d4-bf1b-4950-bba5-aab70d96a87b None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:33.978735 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacbc8d4-bf1b-4950-bba5-aab70d96a87b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:33.989439 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-5b4aa042-f4f6-4e59-a15f-ddb1acd911cc None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:25:33.990674 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-5b4aa042-f4f6-4e59-a15f-ddb1acd911cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:25:33.993414 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacbc8d4-bf1b-4950-bba5-aab70d96a87b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:33.995959 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacbc8d4-bf1b-4950-bba5-aab70d96a87b None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:34.017620 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-cacbc8d4-bf1b-4950-bba5-aab70d96a87b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:25:34.017620 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:25:34.017620 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:25:34.017620 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:25:34.017620 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:25:34.017620 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:25:34.017620 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:25:34.017620 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:25:34.017620 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:25:34.017620 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:25:34.017620 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:25:34.017620 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:25:34.017620 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:25:34.017620 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:25:34.017620 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:25:34.018962 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:25:34.018962 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:25:34.018962 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:25:34.018962 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:25:34.018962 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:25:34.018962 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:25:34.018962 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:25:34.018962 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:25:34.018962 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 01 15:25:34.018962 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:25:34.018962 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:25:34.018962 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:25:34.018962 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:25:34.018962 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:25:34.018962 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:25:34.018962 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:25:34.018962 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:25:34.020106 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:25:34.020106 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:25:34.020106 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:25:34.020106 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 01 15:25:34.020106 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 303/613] 10.222.0.102 () {56 vars in 1113 bytes} [Mon Aug 1 15:25:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:25:34.030014 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacbc8d4-bf1b-4950-bba5-aab70d96a87b None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:34.063531 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:34.107441 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 311/614] 10.222.0.102 () {58 vars in 1028 bytes} [Mon Aug 1 15:25:33 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 15:25:34.146154 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4aa042-f4f6-4e59-a15f-ddb1acd911cc None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:34.146775 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacbc8d4-bf1b-4950-bba5-aab70d96a87b None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:34.188711 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea4dc91-5474-48d2-9fe8-90b885019e14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:34.190170 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea4dc91-5474-48d2-9fe8-90b885019e14 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:34.190447 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea4dc91-5474-48d2-9fe8-90b885019e14 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:34.190715 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea4dc91-5474-48d2-9fe8-90b885019e14 None admin] PATH_INFO: `/v3/domains` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:34.191424 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea4dc91-5474-48d2-9fe8-90b885019e14 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:25:34.191786 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea4dc91-5474-48d2-9fe8-90b885019e14 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:34.193274 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea4dc91-5474-48d2-9fe8-90b885019e14 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:34.208141 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 304/615] 10.222.0.102 () {56 vars in 1114 bytes} [Mon Aug 1 15:25:34 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:34.218751 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea4dc91-5474-48d2-9fe8-90b885019e14 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:34.240057 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:34.278471 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4aa042-f4f6-4e59-a15f-ddb1acd911cc None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:34.323777 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:34.327011 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac295743-98ac-4140-8724-1dd4c9d05bb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:34.327665 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac295743-98ac-4140-8724-1dd4c9d05bb4 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:34.327944 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac295743-98ac-4140-8724-1dd4c9d05bb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:34.328215 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac295743-98ac-4140-8724-1dd4c9d05bb4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:34.340326 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea4dc91-5474-48d2-9fe8-90b885019e14 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:34.344626 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac295743-98ac-4140-8724-1dd4c9d05bb4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:25:34.357799 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-ac295743-98ac-4140-8724-1dd4c9d05bb4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 01 15:25:34.357799 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:25:34.357799 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:25:34.357799 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:25:34.357799 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:25:34.357799 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:25:34.357799 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:25:34.357799 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:25:34.357799 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:25:34.357799 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:25:34.357799 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:25:34.357799 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:25:34.357799 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:25:34.357799 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:25:34.357799 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:25:34.357799 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:25:34.358807 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:25:34.358807 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:25:34.358807 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:25:34.358807 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:25:34.358807 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:25:34.358807 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:25:34.358807 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:25:34.358807 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:25:34.358807 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:25:34.358807 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:25:34.358807 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:25:34.358807 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 01 15:25:34.358807 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:25:34.358807 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:25:34.358807 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:25:34.358807 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:25:34.359623 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:25:34.359623 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:25:34.359623 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:25:34.359623 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:25:34.359623 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:25:34.359623 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:25:34.359623 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:25:34.359623 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:25:34.359623 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:25:34.359623 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:25:34.359623 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 01 15:25:34.359623 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 01 15:25:34.359623 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 312/616] 10.222.0.102 () {56 vars in 1107 bytes} [Mon Aug 1 15:25:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 15:25:34.364771 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac295743-98ac-4140-8724-1dd4c9d05bb4 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:34.387441 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0056dec-6358-45d2-a809-34112d343f49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:34.388567 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0056dec-6358-45d2-a809-34112d343f49 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:34.389862 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0056dec-6358-45d2-a809-34112d343f49 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:34.390522 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0056dec-6358-45d2-a809-34112d343f49 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:34.407927 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0056dec-6358-45d2-a809-34112d343f49 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:34.411076 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0056dec-6358-45d2-a809-34112d343f49 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:34.434618 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-d0056dec-6358-45d2-a809-34112d343f49 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 01 15:25:34.434618 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:25:34.434618 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:25:34.434618 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:25:34.434618 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:25:34.434618 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:25:34.434618 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:25:34.434618 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:25:34.434618 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:25:34.434618 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:25:34.434618 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:25:34.434618 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:25:34.434618 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 15:25:34.434618 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 15:25:34.434618 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 15:25:34.434618 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 15:25:34.435621 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:25:34.435621 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:25:34.435621 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 15:25:34.435621 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 15:25:34.435621 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 15:25:34.435621 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 15:25:34.435621 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:25:34.435621 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:25:34.435621 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:25:34.435621 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:25:34.435621 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:25:34.435621 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 01 15:25:34.435621 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:25:34.435621 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:25:34.435621 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:25:34.435621 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:25:34.435621 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:25:34.435621 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:25:34.436538 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:25:34.436538 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:25:34.436538 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 15:25:34.436538 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 15:25:34.436538 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 15:25:34.436538 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 15:25:34.436538 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 15:25:34.436538 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 15:25:34.436538 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 01 15:25:34.436538 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 01 15:25:34.439677 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 305/617] 10.222.0.102 () {56 vars in 1104 bytes} [Mon Aug 1 15:25:34 2022] GET /identity/v3/users/glance => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 15:25:34.446052 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0056dec-6358-45d2-a809-34112d343f49 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:34.553321 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac295743-98ac-4140-8724-1dd4c9d05bb4 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:34.586888 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:34.605963 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c60678a-0832-4dbf-bbed-3b61ababe523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:34.606636 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c60678a-0832-4dbf-bbed-3b61ababe523 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:34.607112 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c60678a-0832-4dbf-bbed-3b61ababe523 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:34.607222 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c60678a-0832-4dbf-bbed-3b61ababe523 None admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:34.607864 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c60678a-0832-4dbf-bbed-3b61ababe523 None admin] RBAC: Adding query filter params (name=service) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:25:34.608165 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c60678a-0832-4dbf-bbed-3b61ababe523 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:34.609569 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c60678a-0832-4dbf-bbed-3b61ababe523 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:34.624945 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 313/618] 10.222.0.102 () {56 vars in 1108 bytes} [Mon Aug 1 15:25:34 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:34.632428 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0056dec-6358-45d2-a809-34112d343f49 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:34.633772 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c60678a-0832-4dbf-bbed-3b61ababe523 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:34.670366 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8faf34-107d-4c74-831e-88c1dba49038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:34.671325 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8faf34-107d-4c74-831e-88c1dba49038 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:34.671824 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8faf34-107d-4c74-831e-88c1dba49038 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:34.672295 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8faf34-107d-4c74-831e-88c1dba49038 None admin] PATH_INFO: `/v3/users` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:34.673330 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8faf34-107d-4c74-831e-88c1dba49038 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:25:34.673839 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8faf34-107d-4c74-831e-88c1dba49038 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:34.675613 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8faf34-107d-4c74-831e-88c1dba49038 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:34.696256 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 306/619] 10.222.0.102 () {56 vars in 1142 bytes} [Mon Aug 1 15:25:34 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 374 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:25:34.702411 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8faf34-107d-4c74-831e-88c1dba49038 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:34.715817 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:34.824537 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8faf34-107d-4c74-831e-88c1dba49038 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:34.842187 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c60678a-0832-4dbf-bbed-3b61ababe523 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:34.864982 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20585959-7d41-45e3-9c01-243708f4debd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:34.866001 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20585959-7d41-45e3-9c01-243708f4debd None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:34.866641 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20585959-7d41-45e3-9c01-243708f4debd None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:34.867152 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20585959-7d41-45e3-9c01-243708f4debd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:34.926382 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f901c05-02a4-4c53-b7bb-168a27f2828c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:34.926965 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f901c05-02a4-4c53-b7bb-168a27f2828c None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:34.927235 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f901c05-02a4-4c53-b7bb-168a27f2828c None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:34.927505 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f901c05-02a4-4c53-b7bb-168a27f2828c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:34.941250 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f901c05-02a4-4c53-b7bb-168a27f2828c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:34.943560 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f901c05-02a4-4c53-b7bb-168a27f2828c None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:34.953027 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20585959-7d41-45e3-9c01-243708f4debd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:34.954644 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20585959-7d41-45e3-9c01-243708f4debd None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:34.963572 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:34.966563 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-0f901c05-02a4-4c53-b7bb-168a27f2828c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:25:34.966563 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:25:34.966563 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:25:34.966563 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:25:34.966563 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:25:34.966563 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:25:34.966563 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:25:34.966563 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:25:34.966563 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:25:34.966563 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:25:34.966563 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:25:34.966563 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:25:34.966563 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:25:34.966563 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:25:34.966563 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:25:34.967468 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:25:34.967468 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:25:34.967468 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:25:34.967468 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:25:34.967468 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:25:34.967468 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:25:34.967468 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:25:34.967468 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:25:34.967468 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 01 15:25:34.967468 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:25:34.967468 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:25:34.967468 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:25:34.967468 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:25:34.967468 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:25:34.967468 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:25:34.967468 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:25:34.967468 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:25:34.968344 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:25:34.968344 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:25:34.968344 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:25:34.968344 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 01 15:25:34.969129 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 314/620] 10.222.0.102 () {56 vars in 1113 bytes} [Mon Aug 1 15:25:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 335 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:25:34.977012 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f901c05-02a4-4c53-b7bb-168a27f2828c None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:35.022314 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:35.068450 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 307/621] 10.222.0.102 () {58 vars in 1287 bytes} [Mon Aug 1 15:25:34 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 15:25:35.075931 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20585959-7d41-45e3-9c01-243708f4debd None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:35.081715 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f901c05-02a4-4c53-b7bb-168a27f2828c None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:35.125654 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a03a94-451a-46f6-886c-e7acc165baa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:35.126272 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a03a94-451a-46f6-886c-e7acc165baa8 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:35.126555 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a03a94-451a-46f6-886c-e7acc165baa8 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:35.126828 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a03a94-451a-46f6-886c-e7acc165baa8 None admin] PATH_INFO: `/v3/domains` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:35.127522 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a03a94-451a-46f6-886c-e7acc165baa8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:25:35.127820 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a03a94-451a-46f6-886c-e7acc165baa8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:35.129228 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a03a94-451a-46f6-886c-e7acc165baa8 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:35.159150 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 315/622] 10.222.0.102 () {56 vars in 1114 bytes} [Mon Aug 1 15:25:34 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:25:35.182995 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a03a94-451a-46f6-886c-e7acc165baa8 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:35.264609 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20585959-7d41-45e3-9c01-243708f4debd None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:35.277727 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:35.313904 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a03a94-451a-46f6-886c-e7acc165baa8 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:35.322299 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:35.343171 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d1bdc0-1cde-4afb-bc10-94b90c9e987b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:35.343864 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d1bdc0-1cde-4afb-bc10-94b90c9e987b None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:35.344144 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d1bdc0-1cde-4afb-bc10-94b90c9e987b None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:35.344466 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d1bdc0-1cde-4afb-bc10-94b90c9e987b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:35.353197 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8f30b1-3e05-4ef4-bb55-ab3778ebf15a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:35.353837 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8f30b1-3e05-4ef4-bb55-ab3778ebf15a None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:35.354113 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8f30b1-3e05-4ef4-bb55-ab3778ebf15a None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:35.354384 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8f30b1-3e05-4ef4-bb55-ab3778ebf15a None admin] PATH_INFO: `/v3/users/swift` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:35.359641 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d1bdc0-1cde-4afb-bc10-94b90c9e987b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:35.361130 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d1bdc0-1cde-4afb-bc10-94b90c9e987b None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:35.363263 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8f30b1-3e05-4ef4-bb55-ab3778ebf15a None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:35.365116 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8f30b1-3e05-4ef4-bb55-ab3778ebf15a None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:35.376641 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-a0d1bdc0-1cde-4afb-bc10-94b90c9e987b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:25:35.376641 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:25:35.376641 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:25:35.376641 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:25:35.376641 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:25:35.376641 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:25:35.376641 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:25:35.376641 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:25:35.376641 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:25:35.376641 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:25:35.376641 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:25:35.376641 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:25:35.376641 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:25:35.376641 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:25:35.376641 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:25:35.377554 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:25:35.377554 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:25:35.377554 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:25:35.377554 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:25:35.377554 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:25:35.377554 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:25:35.377554 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:25:35.377554 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:25:35.377554 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 01 15:25:35.377554 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:25:35.377554 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:25:35.377554 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:25:35.377554 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:25:35.377554 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:25:35.377554 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:25:35.377554 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:25:35.377554 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:25:35.378861 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:25:35.378861 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:25:35.378861 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:25:35.378861 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 01 15:25:35.378861 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 308/623] 10.222.0.102 () {56 vars in 1113 bytes} [Mon Aug 1 15:25:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:25:35.379144 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-ad8f30b1-3e05-4ef4-bb55-ab3778ebf15a None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 01 15:25:35.379144 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:25:35.379144 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:25:35.379144 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:25:35.379144 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:25:35.379144 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:25:35.379144 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:25:35.379144 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:25:35.379144 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:25:35.379144 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:25:35.379144 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:25:35.379144 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:25:35.379144 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 15:25:35.379144 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 15:25:35.379144 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 15:25:35.379144 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 15:25:35.380419 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:25:35.380419 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:25:35.380419 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 15:25:35.380419 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 15:25:35.380419 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 15:25:35.380419 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 15:25:35.380419 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:25:35.380419 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:25:35.380419 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:25:35.380419 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:25:35.380419 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:25:35.380419 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 01 15:25:35.380419 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:25:35.380419 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:25:35.380419 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:25:35.380419 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:25:35.380419 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:25:35.380419 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:25:35.381573 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:25:35.381573 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:25:35.381573 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 15:25:35.381573 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 15:25:35.381573 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 15:25:35.381573 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 15:25:35.381573 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 15:25:35.381573 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 15:25:35.381573 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 01 15:25:35.381573 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 01 15:25:35.382126 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04ab615-a813-4e88-9e6c-78db504d38ec None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:35.382126 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04ab615-a813-4e88-9e6c-78db504d38ec None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:35.382250 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 316/624] 10.222.0.102 () {56 vars in 1101 bytes} [Mon Aug 1 15:25:35 2022] GET /identity/v3/users/swift => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 15:25:35.382317 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04ab615-a813-4e88-9e6c-78db504d38ec None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:35.382317 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 309/625] 10.222.0.102 () {54 vars in 931 bytes} [Mon Aug 1 15:25:35 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 15:25:35.385955 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8f30b1-3e05-4ef4-bb55-ab3778ebf15a None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:35.392536 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b4aecd-0f39-4bab-93ee-7418d6648cdb None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:35.392818 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b4aecd-0f39-4bab-93ee-7418d6648cdb None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:35.393139 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b4aecd-0f39-4bab-93ee-7418d6648cdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:35.412194 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-52b4aecd-0f39-4bab-93ee-7418d6648cdb None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:25:35.413410 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-52b4aecd-0f39-4bab-93ee-7418d6648cdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:25:35.504953 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 310/626] 10.222.0.102 () {58 vars in 1028 bytes} [Mon Aug 1 15:25:35 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 15:25:35.504953 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b4aecd-0f39-4bab-93ee-7418d6648cdb None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:35.528594 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8f30b1-3e05-4ef4-bb55-ab3778ebf15a None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:35.568793 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfee36f7-0159-47e3-a5d7-ee9f52a1eb2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:35.569441 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfee36f7-0159-47e3-a5d7-ee9f52a1eb2c None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:35.569723 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfee36f7-0159-47e3-a5d7-ee9f52a1eb2c None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:35.570519 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfee36f7-0159-47e3-a5d7-ee9f52a1eb2c None admin] PATH_INFO: `/v3/users` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:35.571315 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfee36f7-0159-47e3-a5d7-ee9f52a1eb2c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:25:35.571621 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfee36f7-0159-47e3-a5d7-ee9f52a1eb2c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:35.573218 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfee36f7-0159-47e3-a5d7-ee9f52a1eb2c None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:35.594688 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 317/627] 10.222.0.102 () {56 vars in 1140 bytes} [Mon Aug 1 15:25:35 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 372 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:35.595583 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfee36f7-0159-47e3-a5d7-ee9f52a1eb2c None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:35.622559 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:35.625106 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:35.637462 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b4aecd-0f39-4bab-93ee-7418d6648cdb None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:35.677966 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d8e9f7-f5d6-4028-9ca4-68c51fd44d75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:35.680784 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d8e9f7-f5d6-4028-9ca4-68c51fd44d75 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:35.681305 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d8e9f7-f5d6-4028-9ca4-68c51fd44d75 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:35.681840 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d8e9f7-f5d6-4028-9ca4-68c51fd44d75 None admin] PATH_INFO: `/v3/domains` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:35.682780 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d8e9f7-f5d6-4028-9ca4-68c51fd44d75 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:25:35.683292 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d8e9f7-f5d6-4028-9ca4-68c51fd44d75 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:35.686001 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d8e9f7-f5d6-4028-9ca4-68c51fd44d75 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:35.707431 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 311/628] 10.222.0.102 () {56 vars in 1114 bytes} [Mon Aug 1 15:25:35 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:35.707431 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d8e9f7-f5d6-4028-9ca4-68c51fd44d75 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:35.724796 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfee36f7-0159-47e3-a5d7-ee9f52a1eb2c None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:35.771468 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d9cbf6-31d3-4113-a9ba-007b0c305e6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:35.772673 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d9cbf6-31d3-4113-a9ba-007b0c305e6e None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:35.773313 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d9cbf6-31d3-4113-a9ba-007b0c305e6e None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:35.774054 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d9cbf6-31d3-4113-a9ba-007b0c305e6e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:35.787839 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d9cbf6-31d3-4113-a9ba-007b0c305e6e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:25:35.794108 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-92d9cbf6-31d3-4113-a9ba-007b0c305e6e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 01 15:25:35.794108 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:25:35.794108 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:25:35.794108 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:25:35.794108 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:25:35.794108 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:25:35.794108 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:25:35.794108 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:25:35.794108 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:25:35.794108 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:25:35.794108 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:25:35.794108 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:25:35.794108 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:25:35.794108 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:25:35.794108 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:25:35.794108 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:25:35.795305 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:25:35.795305 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:25:35.795305 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:25:35.795305 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:25:35.795305 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:25:35.795305 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:25:35.795305 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:25:35.795305 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:25:35.795305 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:25:35.795305 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:25:35.795305 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:25:35.795305 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 01 15:25:35.795305 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:25:35.795305 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:25:35.795305 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:25:35.795305 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:25:35.796325 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:25:35.796325 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:25:35.796325 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:25:35.796325 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:25:35.796325 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:25:35.796325 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:25:35.796325 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:25:35.796325 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:25:35.796325 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:25:35.796325 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:25:35.796325 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 01 15:25:35.796325 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 01 15:25:35.803503 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 318/629] 10.222.0.102 () {56 vars in 1107 bytes} [Mon Aug 1 15:25:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:25:35.803503 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d9cbf6-31d3-4113-a9ba-007b0c305e6e None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:35.832343 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d8e9f7-f5d6-4028-9ca4-68c51fd44d75 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:35.890347 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24696761-ddca-4562-b4d9-9844a91d82e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:35.891727 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24696761-ddca-4562-b4d9-9844a91d82e2 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:35.892226 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24696761-ddca-4562-b4d9-9844a91d82e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:35.893163 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24696761-ddca-4562-b4d9-9844a91d82e2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:35.897578 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:35.912584 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24696761-ddca-4562-b4d9-9844a91d82e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:35.914835 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24696761-ddca-4562-b4d9-9844a91d82e2 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:35.918149 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d9cbf6-31d3-4113-a9ba-007b0c305e6e None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:35.925733 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:35.936632 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-24696761-ddca-4562-b4d9-9844a91d82e2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:25:35.936632 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:25:35.936632 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:25:35.936632 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:25:35.936632 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:25:35.936632 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:25:35.936632 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:25:35.936632 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:25:35.936632 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:25:35.936632 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:25:35.936632 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:25:35.936632 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:25:35.936632 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:25:35.936632 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:25:35.936632 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:25:35.937565 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:25:35.937565 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:25:35.937565 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:25:35.937565 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:25:35.937565 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:25:35.937565 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:25:35.937565 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:25:35.937565 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:25:35.937565 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 01 15:25:35.937565 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:25:35.937565 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:25:35.937565 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:25:35.937565 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:25:35.937565 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:25:35.937565 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:25:35.937565 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:25:35.937565 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:25:35.938456 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:25:35.938456 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:25:35.938456 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:25:35.938456 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 01 15:25:35.941073 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 312/630] 10.222.0.102 () {56 vars in 1113 bytes} [Mon Aug 1 15:25:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:25:35.945801 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24696761-ddca-4562-b4d9-9844a91d82e2 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:35.971532 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247de186-65d2-49b8-9f02-8cda2c74c1d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:35.972420 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247de186-65d2-49b8-9f02-8cda2c74c1d3 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:35.973023 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247de186-65d2-49b8-9f02-8cda2c74c1d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:35.973447 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247de186-65d2-49b8-9f02-8cda2c74c1d3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:35.982262 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247de186-65d2-49b8-9f02-8cda2c74c1d3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:35.983937 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247de186-65d2-49b8-9f02-8cda2c74c1d3 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:35.997883 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-247de186-65d2-49b8-9f02-8cda2c74c1d3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 15:25:35.997883 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:25:35.997883 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:25:35.997883 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:25:35.997883 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:25:35.997883 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:25:35.997883 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:25:35.997883 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:25:35.997883 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:25:35.997883 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:25:35.997883 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:25:35.997883 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:25:35.997883 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 15:25:35.997883 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 15:25:35.997883 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 15:25:35.998878 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 15:25:35.998878 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:25:35.998878 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:25:35.998878 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:25:35.998878 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:25:35.998878 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:25:35.998878 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:25:35.998878 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:25:35.998878 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 01 15:25:35.998878 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:25:35.998878 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:25:35.998878 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:25:35.998878 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:25:35.998878 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:25:35.998878 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:25:35.998878 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:25:35.998878 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:25:35.999812 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 15:25:35.999812 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 15:25:35.999812 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 15:25:35.999812 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 15:25:35.999812 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 15:25:35.999812 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 15:25:35.999812 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 15:25:35.999812 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 01 15:25:36.003880 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 319/631] 10.222.0.102 () {56 vars in 1116 bytes} [Mon Aug 1 15:25:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:25:36.004913 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247de186-65d2-49b8-9f02-8cda2c74c1d3 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:36.062235 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24696761-ddca-4562-b4d9-9844a91d82e2 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:36.097205 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f448a267-f816-4996-98de-98d207063b4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:36.097933 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f448a267-f816-4996-98de-98d207063b4f None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:36.098200 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f448a267-f816-4996-98de-98d207063b4f None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:36.098475 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f448a267-f816-4996-98de-98d207063b4f None admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:36.099358 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f448a267-f816-4996-98de-98d207063b4f None admin] RBAC: Adding query filter params (name=service) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:25:36.099537 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f448a267-f816-4996-98de-98d207063b4f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:36.100880 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f448a267-f816-4996-98de-98d207063b4f None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:36.115058 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 313/632] 10.222.0.102 () {56 vars in 1108 bytes} [Mon Aug 1 15:25:35 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:36.115058 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9ca9d4-4dbd-45fc-89ed-c84e331391c3 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:36.115058 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9ca9d4-4dbd-45fc-89ed-c84e331391c3 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:36.115058 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9ca9d4-4dbd-45fc-89ed-c84e331391c3 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:36.115442 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247de186-65d2-49b8-9f02-8cda2c74c1d3 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:36.115521 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 314/633] 10.222.0.102 () {54 vars in 931 bytes} [Mon Aug 1 15:25:36 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 15:25:36.115521 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9ca9d4-4dbd-45fc-89ed-c84e331391c3 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:36.152715 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1abdb4-dd03-4341-9083-0769cdb9c755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:36.153366 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1abdb4-dd03-4341-9083-0769cdb9c755 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:36.153654 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1abdb4-dd03-4341-9083-0769cdb9c755 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:36.153930 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1abdb4-dd03-4341-9083-0769cdb9c755 None admin] PATH_INFO: `/v3/domains` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:36.154935 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1abdb4-dd03-4341-9083-0769cdb9c755 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:25:36.154935 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1abdb4-dd03-4341-9083-0769cdb9c755 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:36.156275 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1abdb4-dd03-4341-9083-0769cdb9c755 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:36.166216 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:36.173798 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 320/634] 10.222.0.102 () {56 vars in 1114 bytes} [Mon Aug 1 15:25:36 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:36.174367 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1abdb4-dd03-4341-9083-0769cdb9c755 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:36.184229 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:36.225641 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9ca9d4-4dbd-45fc-89ed-c84e331391c3 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:36.263468 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78686591-1faf-4193-97ef-72a68af53e54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:36.264371 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78686591-1faf-4193-97ef-72a68af53e54 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:36.264649 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78686591-1faf-4193-97ef-72a68af53e54 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:36.264953 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78686591-1faf-4193-97ef-72a68af53e54 None admin] PATH_INFO: `/v3/projects` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:36.265698 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78686591-1faf-4193-97ef-72a68af53e54 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:25:36.266004 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78686591-1faf-4193-97ef-72a68af53e54 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:36.267681 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78686591-1faf-4193-97ef-72a68af53e54 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:36.275411 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1abdb4-dd03-4341-9083-0769cdb9c755 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:36.280570 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 315/635] 10.222.0.102 () {56 vars in 1153 bytes} [Mon Aug 1 15:25:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:36.281999 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393acddb-3ed8-465b-9918-052d21fbd2dc None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:36.282459 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393acddb-3ed8-465b-9918-052d21fbd2dc None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:36.283033 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393acddb-3ed8-465b-9918-052d21fbd2dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:36.300921 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-393acddb-3ed8-465b-9918-052d21fbd2dc None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:25:36.302121 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-393acddb-3ed8-465b-9918-052d21fbd2dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:25:36.318151 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea229d5e-db7f-4461-b66c-6a479d952d0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:36.318775 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea229d5e-db7f-4461-b66c-6a479d952d0f None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:36.318994 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea229d5e-db7f-4461-b66c-6a479d952d0f None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:36.319263 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea229d5e-db7f-4461-b66c-6a479d952d0f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:36.330482 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea229d5e-db7f-4461-b66c-6a479d952d0f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:36.331840 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea229d5e-db7f-4461-b66c-6a479d952d0f None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:36.347431 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-ea229d5e-db7f-4461-b66c-6a479d952d0f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:25:36.347431 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:25:36.347431 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:25:36.347431 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:25:36.347431 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:25:36.347431 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:25:36.347431 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:25:36.347431 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:25:36.347431 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:25:36.347431 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:25:36.347431 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:25:36.347431 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:25:36.347431 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:25:36.347431 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:25:36.347431 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:25:36.348378 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:25:36.348378 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:25:36.348378 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:25:36.348378 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:25:36.348378 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:25:36.348378 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:25:36.348378 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:25:36.348378 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:25:36.348378 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 01 15:25:36.348378 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:25:36.348378 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:25:36.348378 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:25:36.348378 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:25:36.348378 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:25:36.348378 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:25:36.348378 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:25:36.348378 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:25:36.349656 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:25:36.349656 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:25:36.349656 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:25:36.349656 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 01 15:25:36.349656 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 321/636] 10.222.0.102 () {56 vars in 1113 bytes} [Mon Aug 1 15:25:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:25:36.349974 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea229d5e-db7f-4461-b66c-6a479d952d0f None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:36.400905 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 316/637] 10.222.0.102 () {58 vars in 1028 bytes} [Mon Aug 1 15:25:36 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 15:25:36.401877 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393acddb-3ed8-465b-9918-052d21fbd2dc None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:36.422552 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:36.458834 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:36.474771 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea229d5e-db7f-4461-b66c-6a479d952d0f None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:36.509260 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393acddb-3ed8-465b-9918-052d21fbd2dc None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:36.513132 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a081e55f-e81e-47bc-b281-2c6c4e0b5d93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:36.513775 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a081e55f-e81e-47bc-b281-2c6c4e0b5d93 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:36.514057 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a081e55f-e81e-47bc-b281-2c6c4e0b5d93 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:36.514329 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a081e55f-e81e-47bc-b281-2c6c4e0b5d93 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:36.521681 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a081e55f-e81e-47bc-b281-2c6c4e0b5d93 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:36.523882 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a081e55f-e81e-47bc-b281-2c6c4e0b5d93 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:36.535593 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-a081e55f-e81e-47bc-b281-2c6c4e0b5d93 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 15:25:36.535593 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:25:36.535593 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:25:36.535593 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:25:36.535593 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:25:36.535593 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:25:36.535593 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:25:36.535593 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:25:36.535593 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:25:36.535593 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:25:36.535593 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:25:36.535593 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:25:36.535593 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 15:25:36.535593 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 15:25:36.535593 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 15:25:36.536658 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 15:25:36.536658 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:25:36.536658 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:25:36.536658 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:25:36.536658 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:25:36.536658 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:25:36.536658 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:25:36.536658 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:25:36.536658 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 01 15:25:36.536658 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:25:36.536658 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:25:36.536658 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:25:36.536658 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:25:36.536658 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:25:36.536658 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:25:36.536658 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:25:36.536658 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:25:36.537586 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 15:25:36.537586 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 15:25:36.537586 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 15:25:36.537586 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 15:25:36.537586 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 15:25:36.537586 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 15:25:36.537586 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 15:25:36.537586 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 01 15:25:36.541895 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 322/638] 10.222.0.102 () {56 vars in 1116 bytes} [Mon Aug 1 15:25:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:25:36.542588 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a081e55f-e81e-47bc-b281-2c6c4e0b5d93 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:36.543892 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5294fba8-770f-473d-b9b0-bdff7bf8a5a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:36.544509 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5294fba8-770f-473d-b9b0-bdff7bf8a5a9 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:36.544787 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5294fba8-770f-473d-b9b0-bdff7bf8a5a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:36.545092 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5294fba8-770f-473d-b9b0-bdff7bf8a5a9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:36.546656 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5294fba8-770f-473d-b9b0-bdff7bf8a5a9 None admin] RBAC: Adding query filter params (role.id=3087c03acf8d44d9ae512385924c5d0d, scope.project.id=2eb32fbe631843d8be84d41f8ba88d6e, user.id=613da2657ae34558b355cac53c8bf29a) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:25:36.546656 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5294fba8-770f-473d-b9b0-bdff7bf8a5a9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:36.547594 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5294fba8-770f-473d-b9b0-bdff7bf8a5a9 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:36.553397 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 317/639] 10.222.0.102 () {56 vars in 1379 bytes} [Mon Aug 1 15:25:36 2022] GET /identity/v3/role_assignments?user.id=613da2657ae34558b355cac53c8bf29a&scope.project.id=2eb32fbe631843d8be84d41f8ba88d6e&role.id=3087c03acf8d44d9ae512385924c5d0d => generated 610 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:36.554154 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5294fba8-770f-473d-b9b0-bdff7bf8a5a9 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:36.651752 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a081e55f-e81e-47bc-b281-2c6c4e0b5d93 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:36.666470 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:36.691649 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619fbea5-847e-4ccb-8bb2-d8a22ae1ec8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:36.692672 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619fbea5-847e-4ccb-8bb2-d8a22ae1ec8b None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:36.693200 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619fbea5-847e-4ccb-8bb2-d8a22ae1ec8b None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:36.693703 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619fbea5-847e-4ccb-8bb2-d8a22ae1ec8b None admin] PATH_INFO: `/v3/domains` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:36.694658 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619fbea5-847e-4ccb-8bb2-d8a22ae1ec8b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:25:36.696840 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619fbea5-847e-4ccb-8bb2-d8a22ae1ec8b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:36.698465 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5294fba8-770f-473d-b9b0-bdff7bf8a5a9 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:36.699127 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619fbea5-847e-4ccb-8bb2-d8a22ae1ec8b None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:36.713918 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 323/640] 10.222.0.102 () {56 vars in 1114 bytes} [Mon Aug 1 15:25:36 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:36.716021 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f863be69-7e3d-4fed-89c5-0d0eb8bb450e None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:36.716021 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f863be69-7e3d-4fed-89c5-0d0eb8bb450e None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:36.716021 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f863be69-7e3d-4fed-89c5-0d0eb8bb450e None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:36.717204 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 324/641] 10.222.0.102 () {54 vars in 931 bytes} [Mon Aug 1 15:25:36 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 15:25:36.718090 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f863be69-7e3d-4fed-89c5-0d0eb8bb450e None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:36.728057 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:36.746453 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9440d262-9f3a-4b42-a61a-dc96238ad815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:36.747180 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9440d262-9f3a-4b42-a61a-dc96238ad815 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:36.747468 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9440d262-9f3a-4b42-a61a-dc96238ad815 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:36.747743 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9440d262-9f3a-4b42-a61a-dc96238ad815 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:36.761649 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9440d262-9f3a-4b42-a61a-dc96238ad815 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:25:36.766784 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-9440d262-9f3a-4b42-a61a-dc96238ad815 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 01 15:25:36.766784 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:25:36.766784 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:25:36.766784 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:25:36.766784 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:25:36.766784 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:25:36.766784 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:25:36.766784 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:25:36.766784 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:25:36.766784 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:25:36.766784 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:25:36.766784 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:25:36.766784 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:25:36.766784 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:25:36.766784 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:25:36.766784 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:25:36.767788 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:25:36.767788 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:25:36.767788 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:25:36.767788 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:25:36.767788 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:25:36.767788 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:25:36.767788 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:25:36.767788 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:25:36.767788 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:25:36.767788 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:25:36.767788 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:25:36.767788 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 01 15:25:36.767788 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:25:36.767788 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:25:36.767788 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:25:36.767788 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:25:36.768625 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:25:36.768625 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:25:36.768625 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:25:36.768625 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:25:36.768625 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:25:36.768625 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:25:36.768625 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:25:36.768625 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:25:36.768625 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:25:36.768625 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:25:36.768625 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 01 15:25:36.768625 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 01 15:25:36.768625 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 318/642] 10.222.0.102 () {56 vars in 1107 bytes} [Mon Aug 1 15:25:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:25:36.769844 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75756fef-8054-41ed-9a3f-c31ee09342f7 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:36.769844 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75756fef-8054-41ed-9a3f-c31ee09342f7 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:36.770091 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75756fef-8054-41ed-9a3f-c31ee09342f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:36.793538 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-75756fef-8054-41ed-9a3f-c31ee09342f7 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:25:36.794748 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-75756fef-8054-41ed-9a3f-c31ee09342f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:25:36.838126 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f863be69-7e3d-4fed-89c5-0d0eb8bb450e None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:36.866808 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 319/643] 10.222.0.102 () {58 vars in 1028 bytes} [Mon Aug 1 15:25:36 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 15:25:36.867687 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75756fef-8054-41ed-9a3f-c31ee09342f7 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:36.884237 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c11d8b-d4a6-49d7-9c90-7bcb2b158f92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:36.888085 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c11d8b-d4a6-49d7-9c90-7bcb2b158f92 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:36.888562 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c11d8b-d4a6-49d7-9c90-7bcb2b158f92 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:36.889046 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c11d8b-d4a6-49d7-9c90-7bcb2b158f92 None admin] PATH_INFO: `/v3/projects` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:36.890182 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c11d8b-d4a6-49d7-9c90-7bcb2b158f92 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:25:36.890567 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c11d8b-d4a6-49d7-9c90-7bcb2b158f92 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:36.892093 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c11d8b-d4a6-49d7-9c90-7bcb2b158f92 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:36.905080 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 325/644] 10.222.0.102 () {56 vars in 1153 bytes} [Mon Aug 1 15:25:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:36.906045 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c11d8b-d4a6-49d7-9c90-7bcb2b158f92 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:36.939374 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:36.987079 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75756fef-8054-41ed-9a3f-c31ee09342f7 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:36.995621 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:37.017211 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c11d8b-d4a6-49d7-9c90-7bcb2b158f92 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:37.025224 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fe768a-46db-4032-b979-021024214d53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:37.025866 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fe768a-46db-4032-b979-021024214d53 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:37.026143 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fe768a-46db-4032-b979-021024214d53 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:37.026412 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fe768a-46db-4032-b979-021024214d53 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:37.033831 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fe768a-46db-4032-b979-021024214d53 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:37.035263 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fe768a-46db-4032-b979-021024214d53 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:37.046843 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-03fe768a-46db-4032-b979-021024214d53 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 01 15:25:37.046843 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:25:37.046843 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:25:37.046843 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:25:37.046843 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:25:37.046843 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:25:37.046843 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:25:37.046843 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:25:37.046843 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:25:37.046843 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:25:37.046843 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:25:37.046843 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:25:37.046843 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 15:25:37.046843 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 15:25:37.046843 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 15:25:37.046843 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 15:25:37.047807 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:25:37.047807 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:25:37.047807 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 15:25:37.047807 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 15:25:37.047807 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 15:25:37.047807 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 15:25:37.047807 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:25:37.047807 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:25:37.047807 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:25:37.047807 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:25:37.047807 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:25:37.047807 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 01 15:25:37.047807 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:25:37.047807 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:25:37.047807 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:25:37.047807 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:25:37.047807 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:25:37.047807 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:25:37.049600 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:25:37.049600 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:25:37.049600 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 15:25:37.049600 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 15:25:37.049600 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 15:25:37.049600 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 15:25:37.049600 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 15:25:37.049600 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 15:25:37.049600 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 01 15:25:37.049600 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 01 15:25:37.049600 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 320/645] 10.222.0.102 () {56 vars in 1098 bytes} [Mon Aug 1 15:25:36 2022] GET /identity/v3/users/nova => generated 82 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:25:37.049600 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fe768a-46db-4032-b979-021024214d53 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:37.059656 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0388b777-16d3-43e2-ac5f-4e70e1a4248a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:37.060275 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0388b777-16d3-43e2-ac5f-4e70e1a4248a None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:37.060555 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0388b777-16d3-43e2-ac5f-4e70e1a4248a None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:37.060826 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0388b777-16d3-43e2-ac5f-4e70e1a4248a None admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:37.061569 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0388b777-16d3-43e2-ac5f-4e70e1a4248a None admin] RBAC: Adding query filter params (name=service) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:25:37.061872 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0388b777-16d3-43e2-ac5f-4e70e1a4248a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:37.063242 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0388b777-16d3-43e2-ac5f-4e70e1a4248a None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:37.072550 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 326/646] 10.222.0.102 () {56 vars in 1108 bytes} [Mon Aug 1 15:25:36 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:37.073608 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0388b777-16d3-43e2-ac5f-4e70e1a4248a None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:37.162903 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fe768a-46db-4032-b979-021024214d53 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:37.181251 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:37.189317 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0388b777-16d3-43e2-ac5f-4e70e1a4248a None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:37.197716 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7381a567-5789-4c62-ad30-d8c5bf3d9851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:37.198363 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7381a567-5789-4c62-ad30-d8c5bf3d9851 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:37.198646 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7381a567-5789-4c62-ad30-d8c5bf3d9851 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:37.198917 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7381a567-5789-4c62-ad30-d8c5bf3d9851 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:37.209411 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7381a567-5789-4c62-ad30-d8c5bf3d9851 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:25:37.214788 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-7381a567-5789-4c62-ad30-d8c5bf3d9851 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 01 15:25:37.214788 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:25:37.214788 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:25:37.214788 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:25:37.214788 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:25:37.214788 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:25:37.214788 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:25:37.214788 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:25:37.214788 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:25:37.214788 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:25:37.214788 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:25:37.214788 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:25:37.214788 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:25:37.214788 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:25:37.214788 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:25:37.214788 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:25:37.215712 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:25:37.215712 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:25:37.215712 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:25:37.215712 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:25:37.215712 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:25:37.215712 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:25:37.215712 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:25:37.215712 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:25:37.215712 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:25:37.215712 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:25:37.215712 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:25:37.215712 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 01 15:25:37.215712 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:25:37.215712 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:25:37.215712 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:25:37.215712 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:25:37.216536 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:25:37.216536 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:25:37.216536 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:25:37.216536 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:25:37.216536 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:25:37.216536 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:25:37.216536 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:25:37.216536 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:25:37.216536 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:25:37.216536 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:25:37.216536 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 01 15:25:37.216536 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 01 15:25:37.216536 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 321/647] 10.222.0.102 () {56 vars in 1107 bytes} [Mon Aug 1 15:25:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:25:37.217295 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7381a567-5789-4c62-ad30-d8c5bf3d9851 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:37.234047 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24ff5c3-c46f-44f5-851f-652fb961a6c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:37.234718 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24ff5c3-c46f-44f5-851f-652fb961a6c2 None admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:37.234997 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24ff5c3-c46f-44f5-851f-652fb961a6c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:37.235271 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24ff5c3-c46f-44f5-851f-652fb961a6c2 None admin] PATH_INFO: `/v3/projects/2eb32fbe631843d8be84d41f8ba88d6e/users/90673f47354f4403aa0e12e3658441c8/roles/3087c03acf8d44d9ae512385924c5d0d` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:37.250732 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24ff5c3-c46f-44f5-851f-652fb961a6c2 None admin] RBAC: Authorizing `identity:create_grant(project_id=2eb32fbe631843d8be84d41f8ba88d6e, user_id=90673f47354f4403aa0e12e3658441c8, role_id=3087c03acf8d44d9ae512385924c5d0d)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:37.251961 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:37.252171 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24ff5c3-c46f-44f5-851f-652fb961a6c2 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:37.308873 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 327/648] 10.222.0.102 () {58 vars in 1444 bytes} [Mon Aug 1 15:25:37 2022] PUT /identity/v3/projects/2eb32fbe631843d8be84d41f8ba88d6e/users/90673f47354f4403aa0e12e3658441c8/roles/3087c03acf8d44d9ae512385924c5d0d => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:25:37.310139 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24ff5c3-c46f-44f5-851f-652fb961a6c2 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:37.338527 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7381a567-5789-4c62-ad30-d8c5bf3d9851 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:37.380964 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12364b28-d787-4146-a9fa-a70a8ff94097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:37.381889 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12364b28-d787-4146-a9fa-a70a8ff94097 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:37.382303 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12364b28-d787-4146-a9fa-a70a8ff94097 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:37.383247 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12364b28-d787-4146-a9fa-a70a8ff94097 None admin] PATH_INFO: `/v3/users` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:37.384206 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12364b28-d787-4146-a9fa-a70a8ff94097 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:25:37.384620 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12364b28-d787-4146-a9fa-a70a8ff94097 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:37.386343 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12364b28-d787-4146-a9fa-a70a8ff94097 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:37.411406 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 322/649] 10.222.0.102 () {56 vars in 1138 bytes} [Mon Aug 1 15:25:37 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 370 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:37.411406 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12364b28-d787-4146-a9fa-a70a8ff94097 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:37.465429 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24ff5c3-c46f-44f5-851f-652fb961a6c2 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:37.511385 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6a8dfe-507b-4469-8318-e8d18909ded0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:37.512029 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6a8dfe-507b-4469-8318-e8d18909ded0 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:37.512310 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6a8dfe-507b-4469-8318-e8d18909ded0 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:37.512582 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6a8dfe-507b-4469-8318-e8d18909ded0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:37.519687 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:37.527705 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6a8dfe-507b-4469-8318-e8d18909ded0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:37.529196 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6a8dfe-507b-4469-8318-e8d18909ded0 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:37.533141 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:37.542694 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12364b28-d787-4146-a9fa-a70a8ff94097 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:37.549759 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-ca6a8dfe-507b-4469-8318-e8d18909ded0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:25:37.549759 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:25:37.549759 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:25:37.549759 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:25:37.549759 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:25:37.549759 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:25:37.549759 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:25:37.549759 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:25:37.549759 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:25:37.549759 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:25:37.549759 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:25:37.549759 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:25:37.549759 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:25:37.549759 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:25:37.549759 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:25:37.550698 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:25:37.550698 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:25:37.550698 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:25:37.550698 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:25:37.550698 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:25:37.550698 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:25:37.550698 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:25:37.550698 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:25:37.550698 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 01 15:25:37.550698 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:25:37.550698 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:25:37.550698 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:25:37.550698 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:25:37.550698 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:25:37.550698 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:25:37.550698 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:25:37.550698 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:25:37.552001 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:25:37.552001 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:25:37.552001 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:25:37.552001 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 01 15:25:37.552001 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 328/650] 10.222.0.102 () {56 vars in 1113 bytes} [Mon Aug 1 15:25:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:25:37.552275 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6a8dfe-507b-4469-8318-e8d18909ded0 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:37.584413 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d947c322-4fc0-41dc-b074-903a6380180b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:37.585380 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d947c322-4fc0-41dc-b074-903a6380180b None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:37.585833 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d947c322-4fc0-41dc-b074-903a6380180b None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:37.586278 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d947c322-4fc0-41dc-b074-903a6380180b None admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:37.587024 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d947c322-4fc0-41dc-b074-903a6380180b None admin] RBAC: Adding query filter params (name=service) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:25:37.587337 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d947c322-4fc0-41dc-b074-903a6380180b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:37.588924 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d947c322-4fc0-41dc-b074-903a6380180b None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:37.599997 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 323/651] 10.222.0.102 () {56 vars in 1108 bytes} [Mon Aug 1 15:25:37 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:37.605104 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d947c322-4fc0-41dc-b074-903a6380180b None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:37.664583 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6a8dfe-507b-4469-8318-e8d18909ded0 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:37.701892 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ed77fc-5f59-4cec-9e17-7905c1d5dd76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:37.702514 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ed77fc-5f59-4cec-9e17-7905c1d5dd76 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:37.702854 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ed77fc-5f59-4cec-9e17-7905c1d5dd76 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:37.703132 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ed77fc-5f59-4cec-9e17-7905c1d5dd76 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:37.725791 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d947c322-4fc0-41dc-b074-903a6380180b None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:37.765569 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f50eef-36ac-4831-b83f-be14bb85b144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:37.766201 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f50eef-36ac-4831-b83f-be14bb85b144 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:37.766486 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f50eef-36ac-4831-b83f-be14bb85b144 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:37.766763 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f50eef-36ac-4831-b83f-be14bb85b144 None admin] PATH_INFO: `/v3/domains` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:37.767573 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f50eef-36ac-4831-b83f-be14bb85b144 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:25:37.767905 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f50eef-36ac-4831-b83f-be14bb85b144 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:37.769389 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f50eef-36ac-4831-b83f-be14bb85b144 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:37.771298 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:37.778556 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ed77fc-5f59-4cec-9e17-7905c1d5dd76 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:37.780092 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ed77fc-5f59-4cec-9e17-7905c1d5dd76 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:37.784800 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 324/652] 10.222.0.102 () {56 vars in 1114 bytes} [Mon Aug 1 15:25:37 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:37.785231 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f50eef-36ac-4831-b83f-be14bb85b144 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:37.794632 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:37.901620 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f50eef-36ac-4831-b83f-be14bb85b144 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:37.919342 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 329/653] 10.222.0.102 () {58 vars in 1287 bytes} [Mon Aug 1 15:25:37 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 15:25:37.921355 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ed77fc-5f59-4cec-9e17-7905c1d5dd76 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:37.940535 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a87f2d4-e59b-4023-aef4-16c7e708ddc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:37.941614 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a87f2d4-e59b-4023-aef4-16c7e708ddc7 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:37.941614 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a87f2d4-e59b-4023-aef4-16c7e708ddc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:37.942076 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a87f2d4-e59b-4023-aef4-16c7e708ddc7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:37.953539 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a87f2d4-e59b-4023-aef4-16c7e708ddc7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:37.955152 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a87f2d4-e59b-4023-aef4-16c7e708ddc7 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:37.971064 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-5a87f2d4-e59b-4023-aef4-16c7e708ddc7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:25:37.971064 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:25:37.971064 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:25:37.971064 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:25:37.971064 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:25:37.971064 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:25:37.971064 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:25:37.971064 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:25:37.971064 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:25:37.971064 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:25:37.971064 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:25:37.971064 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:25:37.971064 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:25:37.971064 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:25:37.971064 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:25:37.972233 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:25:37.972233 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:25:37.972233 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:25:37.972233 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:25:37.972233 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:25:37.972233 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:25:37.972233 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:25:37.972233 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:25:37.972233 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 01 15:25:37.972233 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:25:37.972233 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:25:37.972233 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:25:37.972233 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:25:37.972233 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:25:37.972233 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:25:37.972233 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:25:37.972233 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:25:37.973405 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:25:37.973405 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:25:37.973405 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:25:37.973405 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 01 15:25:37.979752 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 325/654] 10.222.0.102 () {56 vars in 1113 bytes} [Mon Aug 1 15:25:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:25:37.979752 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a87f2d4-e59b-4023-aef4-16c7e708ddc7 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:38.044005 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:38.052421 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:38.058386 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ed77fc-5f59-4cec-9e17-7905c1d5dd76 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:38.094757 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa579a3b-451e-4922-a263-1e34454688d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:38.095581 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa579a3b-451e-4922-a263-1e34454688d2 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:38.095940 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa579a3b-451e-4922-a263-1e34454688d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:38.096383 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa579a3b-451e-4922-a263-1e34454688d2 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:38.103258 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a87f2d4-e59b-4023-aef4-16c7e708ddc7 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:38.104528 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa579a3b-451e-4922-a263-1e34454688d2 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:38.106087 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa579a3b-451e-4922-a263-1e34454688d2 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:38.119014 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-fa579a3b-451e-4922-a263-1e34454688d2 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 01 15:25:38.119014 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:25:38.119014 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:25:38.119014 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:25:38.119014 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:25:38.119014 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:25:38.119014 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:25:38.119014 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:25:38.119014 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:25:38.119014 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:25:38.119014 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:25:38.119014 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:25:38.119014 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 15:25:38.119014 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 15:25:38.119014 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 15:25:38.119014 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 15:25:38.120069 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:25:38.120069 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:25:38.120069 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 15:25:38.120069 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 15:25:38.120069 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 15:25:38.120069 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 15:25:38.120069 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:25:38.120069 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:25:38.120069 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:25:38.120069 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:25:38.120069 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:25:38.120069 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 01 15:25:38.120069 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:25:38.120069 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:25:38.120069 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:25:38.120069 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:25:38.120069 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:25:38.120069 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:25:38.121070 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:25:38.121070 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:25:38.121070 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 15:25:38.121070 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 15:25:38.121070 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 15:25:38.121070 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 15:25:38.121070 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 15:25:38.121070 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 15:25:38.121070 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 01 15:25:38.121070 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 01 15:25:38.121070 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 330/655] 10.222.0.102 () {56 vars in 1107 bytes} [Mon Aug 1 15:25:37 2022] GET /identity/v3/users/neutron => generated 85 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:25:38.121697 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa579a3b-451e-4922-a263-1e34454688d2 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:38.150576 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cacac7-6dea-404d-8cfe-4132c0646876 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:38.151769 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cacac7-6dea-404d-8cfe-4132c0646876 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:38.152204 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cacac7-6dea-404d-8cfe-4132c0646876 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:38.152784 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cacac7-6dea-404d-8cfe-4132c0646876 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:38.167996 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cacac7-6dea-404d-8cfe-4132c0646876 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:38.170481 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cacac7-6dea-404d-8cfe-4132c0646876 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:38.188293 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-97cacac7-6dea-404d-8cfe-4132c0646876 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:25:38.188293 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:25:38.188293 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:25:38.188293 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:25:38.188293 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:25:38.188293 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:25:38.188293 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:25:38.188293 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:25:38.188293 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:25:38.188293 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:25:38.188293 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:25:38.188293 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:25:38.188293 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:25:38.188293 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:25:38.188293 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:25:38.189438 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:25:38.189438 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:25:38.189438 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:25:38.189438 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:25:38.189438 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:25:38.189438 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:25:38.189438 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:25:38.189438 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:25:38.189438 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 01 15:25:38.189438 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:25:38.189438 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:25:38.189438 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:25:38.189438 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:25:38.189438 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:25:38.189438 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:25:38.189438 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:25:38.189438 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:25:38.190522 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:25:38.190522 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:25:38.190522 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:25:38.190522 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 01 15:25:38.196565 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 326/656] 10.222.0.102 () {56 vars in 1113 bytes} [Mon Aug 1 15:25:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:25:38.197632 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cacac7-6dea-404d-8cfe-4132c0646876 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:38.241303 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa579a3b-451e-4922-a263-1e34454688d2 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:38.288430 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81e9555-9af1-44e8-8e91-4d3d4387d620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:38.289613 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81e9555-9af1-44e8-8e91-4d3d4387d620 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:38.289891 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81e9555-9af1-44e8-8e91-4d3d4387d620 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:38.290162 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81e9555-9af1-44e8-8e91-4d3d4387d620 None admin] PATH_INFO: `/v3/domains` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:38.290854 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81e9555-9af1-44e8-8e91-4d3d4387d620 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:25:38.291162 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81e9555-9af1-44e8-8e91-4d3d4387d620 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:38.292535 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81e9555-9af1-44e8-8e91-4d3d4387d620 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:38.308040 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cacac7-6dea-404d-8cfe-4132c0646876 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:38.317299 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 331/657] 10.222.0.102 () {56 vars in 1114 bytes} [Mon Aug 1 15:25:38 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:38.317799 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81e9555-9af1-44e8-8e91-4d3d4387d620 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:38.323156 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:38.337246 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:38.355254 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b80289-9d58-41f8-a6c5-6203271ac3d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:38.356306 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b80289-9d58-41f8-a6c5-6203271ac3d8 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:38.356795 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b80289-9d58-41f8-a6c5-6203271ac3d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:38.357294 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b80289-9d58-41f8-a6c5-6203271ac3d8 None admin] PATH_INFO: `/v3/users` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:38.358298 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b80289-9d58-41f8-a6c5-6203271ac3d8 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:25:38.358891 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b80289-9d58-41f8-a6c5-6203271ac3d8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:38.361417 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b80289-9d58-41f8-a6c5-6203271ac3d8 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:38.386941 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 327/658] 10.222.0.102 () {56 vars in 1144 bytes} [Mon Aug 1 15:25:38 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 376 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:38.388264 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b80289-9d58-41f8-a6c5-6203271ac3d8 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:38.437849 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81e9555-9af1-44e8-8e91-4d3d4387d620 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:38.483533 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc5bfee-26bb-40f1-b922-a3ee84e1460d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:38.484155 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc5bfee-26bb-40f1-b922-a3ee84e1460d None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:38.484588 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc5bfee-26bb-40f1-b922-a3ee84e1460d None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:38.484882 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc5bfee-26bb-40f1-b922-a3ee84e1460d None admin] PATH_INFO: `/v3/domains` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:38.485995 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc5bfee-26bb-40f1-b922-a3ee84e1460d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:25:38.486277 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc5bfee-26bb-40f1-b922-a3ee84e1460d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:38.488095 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc5bfee-26bb-40f1-b922-a3ee84e1460d None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:38.503796 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 332/659] 10.222.0.102 () {56 vars in 1114 bytes} [Mon Aug 1 15:25:38 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:38.503962 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b80289-9d58-41f8-a6c5-6203271ac3d8 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:38.504665 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc5bfee-26bb-40f1-b922-a3ee84e1460d None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:38.545622 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611c454b-49d0-4968-b689-cb760e8f7080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:38.546586 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611c454b-49d0-4968-b689-cb760e8f7080 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:38.547132 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611c454b-49d0-4968-b689-cb760e8f7080 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:38.547474 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611c454b-49d0-4968-b689-cb760e8f7080 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:38.556551 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611c454b-49d0-4968-b689-cb760e8f7080 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:38.558504 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611c454b-49d0-4968-b689-cb760e8f7080 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:38.573951 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-611c454b-49d0-4968-b689-cb760e8f7080 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 01 15:25:38.573951 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:25:38.573951 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:25:38.573951 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:25:38.573951 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:25:38.573951 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:25:38.573951 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:25:38.573951 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:25:38.573951 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:25:38.573951 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:25:38.573951 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:25:38.573951 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:25:38.573951 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 15:25:38.573951 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 15:25:38.573951 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 15:25:38.573951 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 15:25:38.574924 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:25:38.574924 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:25:38.574924 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 15:25:38.574924 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 15:25:38.574924 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 15:25:38.574924 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 15:25:38.574924 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:25:38.574924 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:25:38.574924 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:25:38.574924 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:25:38.574924 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:25:38.574924 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 01 15:25:38.574924 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:25:38.574924 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:25:38.574924 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:25:38.574924 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:25:38.574924 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:25:38.574924 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:25:38.575869 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:25:38.575869 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:25:38.575869 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 15:25:38.575869 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 15:25:38.575869 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 15:25:38.575869 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 15:25:38.575869 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 15:25:38.575869 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 15:25:38.575869 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 01 15:25:38.575869 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 01 15:25:38.576689 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 328/660] 10.222.0.102 () {56 vars in 1104 bytes} [Mon Aug 1 15:25:38 2022] GET /identity/v3/users/cinder => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:25:38.577260 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611c454b-49d0-4968-b689-cb760e8f7080 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:38.600525 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:38.611979 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:38.629337 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc5bfee-26bb-40f1-b922-a3ee84e1460d None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:38.666321 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d4512f-c465-442d-b8ac-3af9590d5e1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:38.667221 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d4512f-c465-442d-b8ac-3af9590d5e1a None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:38.667652 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d4512f-c465-442d-b8ac-3af9590d5e1a None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:38.668074 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d4512f-c465-442d-b8ac-3af9590d5e1a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:38.692118 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611c454b-49d0-4968-b689-cb760e8f7080 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:38.729602 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c825ec30-7387-41da-aee5-672802f3e378 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:38.730457 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c825ec30-7387-41da-aee5-672802f3e378 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:38.730739 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c825ec30-7387-41da-aee5-672802f3e378 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:38.731014 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c825ec30-7387-41da-aee5-672802f3e378 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:38.738835 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c825ec30-7387-41da-aee5-672802f3e378 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:38.740279 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c825ec30-7387-41da-aee5-672802f3e378 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:38.740720 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d4512f-c465-442d-b8ac-3af9590d5e1a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:38.742742 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d4512f-c465-442d-b8ac-3af9590d5e1a None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:38.755203 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-c825ec30-7387-41da-aee5-672802f3e378 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 15:25:38.755203 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:25:38.755203 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:25:38.755203 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:25:38.755203 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:25:38.755203 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:25:38.755203 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:25:38.755203 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:25:38.755203 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:25:38.755203 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:25:38.755203 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:25:38.755203 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:25:38.755203 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 15:25:38.755203 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 15:25:38.755203 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 15:25:38.756360 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 15:25:38.756360 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:25:38.756360 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:25:38.756360 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:25:38.756360 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:25:38.756360 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:25:38.756360 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:25:38.756360 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:25:38.756360 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 01 15:25:38.756360 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:25:38.756360 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:25:38.756360 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:25:38.756360 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:25:38.756360 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:25:38.756360 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:25:38.756360 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:25:38.756360 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:25:38.757300 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 15:25:38.757300 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 15:25:38.757300 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 15:25:38.757300 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 15:25:38.757300 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 15:25:38.757300 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 15:25:38.757300 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 15:25:38.757300 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 01 15:25:38.757300 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 329/661] 10.222.0.102 () {56 vars in 1116 bytes} [Mon Aug 1 15:25:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:25:38.757300 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c825ec30-7387-41da-aee5-672802f3e378 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:38.827417 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:38.852082 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 333/662] 10.222.0.102 () {58 vars in 1287 bytes} [Mon Aug 1 15:25:38 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 15:25:38.853689 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e719dd2-2d92-4332-a633-fc0f700e20dc None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:38.853974 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e719dd2-2d92-4332-a633-fc0f700e20dc None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:38.854250 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e719dd2-2d92-4332-a633-fc0f700e20dc None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:38.859578 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 334/663] 10.222.0.102 () {54 vars in 931 bytes} [Mon Aug 1 15:25:38 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 15:25:38.859578 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e719dd2-2d92-4332-a633-fc0f700e20dc None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:38.859821 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:38.873016 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c825ec30-7387-41da-aee5-672802f3e378 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:38.915577 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0de6d1a-733d-4cc3-a3da-ed3bf76a9b64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:38.916357 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0de6d1a-733d-4cc3-a3da-ed3bf76a9b64 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:38.916642 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0de6d1a-733d-4cc3-a3da-ed3bf76a9b64 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:38.916951 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0de6d1a-733d-4cc3-a3da-ed3bf76a9b64 None admin] PATH_INFO: `/v3/users` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:38.917794 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0de6d1a-733d-4cc3-a3da-ed3bf76a9b64 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:25:38.918104 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0de6d1a-733d-4cc3-a3da-ed3bf76a9b64 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:38.919618 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0de6d1a-733d-4cc3-a3da-ed3bf76a9b64 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:38.938170 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 330/664] 10.222.0.102 () {56 vars in 1142 bytes} [Mon Aug 1 15:25:38 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 374 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:38.938992 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0de6d1a-733d-4cc3-a3da-ed3bf76a9b64 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:38.981465 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e719dd2-2d92-4332-a633-fc0f700e20dc None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:39.017294 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ce2b9d-99b2-4d29-8147-4e6354c0e8d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:39.017827 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ce2b9d-99b2-4d29-8147-4e6354c0e8d6 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:39.018292 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ce2b9d-99b2-4d29-8147-4e6354c0e8d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:39.018779 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ce2b9d-99b2-4d29-8147-4e6354c0e8d6 None admin] PATH_INFO: `/v3/projects` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:39.020128 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ce2b9d-99b2-4d29-8147-4e6354c0e8d6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:25:39.020703 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ce2b9d-99b2-4d29-8147-4e6354c0e8d6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:39.023443 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ce2b9d-99b2-4d29-8147-4e6354c0e8d6 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:39.041198 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 335/665] 10.222.0.102 () {56 vars in 1153 bytes} [Mon Aug 1 15:25:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:39.041198 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465c8fa7-1fcf-41dd-9f94-3958b10cab0b None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:39.041198 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465c8fa7-1fcf-41dd-9f94-3958b10cab0b None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:39.041198 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465c8fa7-1fcf-41dd-9f94-3958b10cab0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:39.055506 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0de6d1a-733d-4cc3-a3da-ed3bf76a9b64 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:39.056899 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-465c8fa7-1fcf-41dd-9f94-3958b10cab0b None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:25:39.058080 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-465c8fa7-1fcf-41dd-9f94-3958b10cab0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:25:39.088912 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:39.095733 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0ddbdd-0872-496a-b1ec-c6dd368af18b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:39.096894 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0ddbdd-0872-496a-b1ec-c6dd368af18b None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:39.096894 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0ddbdd-0872-496a-b1ec-c6dd368af18b None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:39.097109 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0ddbdd-0872-496a-b1ec-c6dd368af18b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:39.109044 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0ddbdd-0872-496a-b1ec-c6dd368af18b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:39.114072 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0ddbdd-0872-496a-b1ec-c6dd368af18b None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:39.118547 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:39.126922 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-be0ddbdd-0872-496a-b1ec-c6dd368af18b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:25:39.126922 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:25:39.126922 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:25:39.126922 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:25:39.126922 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:25:39.126922 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:25:39.126922 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:25:39.126922 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:25:39.126922 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:25:39.126922 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:25:39.126922 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:25:39.126922 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:25:39.126922 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:25:39.126922 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:25:39.126922 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:25:39.127861 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:25:39.127861 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:25:39.127861 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:25:39.127861 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:25:39.127861 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:25:39.127861 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:25:39.127861 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:25:39.127861 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:25:39.127861 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 01 15:25:39.127861 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:25:39.127861 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:25:39.127861 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:25:39.127861 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:25:39.127861 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:25:39.127861 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:25:39.127861 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:25:39.127861 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:25:39.128752 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:25:39.128752 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:25:39.128752 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:25:39.128752 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 01 15:25:39.128752 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 331/666] 10.222.0.102 () {56 vars in 1113 bytes} [Mon Aug 1 15:25:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:25:39.129701 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0ddbdd-0872-496a-b1ec-c6dd368af18b None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:39.145102 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 336/667] 10.222.0.102 () {58 vars in 1028 bytes} [Mon Aug 1 15:25:39 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 15:25:39.145102 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465c8fa7-1fcf-41dd-9f94-3958b10cab0b None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:39.241254 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0ddbdd-0872-496a-b1ec-c6dd368af18b None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:39.258633 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465c8fa7-1fcf-41dd-9f94-3958b10cab0b None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:39.278512 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6ee8a4-69c5-4830-8bc1-5aaf904b9a70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:39.279455 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6ee8a4-69c5-4830-8bc1-5aaf904b9a70 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:39.279739 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6ee8a4-69c5-4830-8bc1-5aaf904b9a70 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:39.280015 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6ee8a4-69c5-4830-8bc1-5aaf904b9a70 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:39.293570 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96a2185-f776-44bb-81da-3ec714179192 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:39.294213 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96a2185-f776-44bb-81da-3ec714179192 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:39.294497 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96a2185-f776-44bb-81da-3ec714179192 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:39.294790 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96a2185-f776-44bb-81da-3ec714179192 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:39.295589 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96a2185-f776-44bb-81da-3ec714179192 None admin] RBAC: Adding query filter params (role.id=3087c03acf8d44d9ae512385924c5d0d, scope.project.id=2eb32fbe631843d8be84d41f8ba88d6e, user.id=77b43f1ee8cc4be3907a494abe90c1cc) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:25:39.295871 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96a2185-f776-44bb-81da-3ec714179192 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:39.297356 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96a2185-f776-44bb-81da-3ec714179192 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:39.305205 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 337/668] 10.222.0.102 () {56 vars in 1379 bytes} [Mon Aug 1 15:25:39 2022] GET /identity/v3/role_assignments?user.id=77b43f1ee8cc4be3907a494abe90c1cc&scope.project.id=2eb32fbe631843d8be84d41f8ba88d6e&role.id=3087c03acf8d44d9ae512385924c5d0d => generated 610 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:39.306754 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96a2185-f776-44bb-81da-3ec714179192 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:39.351394 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:39.371210 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:39.378076 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6ee8a4-69c5-4830-8bc1-5aaf904b9a70 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:39.380444 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6ee8a4-69c5-4830-8bc1-5aaf904b9a70 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:39.439649 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96a2185-f776-44bb-81da-3ec714179192 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:39.482552 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e225535-fc55-4da6-b8cb-00566a67d911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:39.483172 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e225535-fc55-4da6-b8cb-00566a67d911 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:39.483450 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e225535-fc55-4da6-b8cb-00566a67d911 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:39.484363 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e225535-fc55-4da6-b8cb-00566a67d911 None admin] PATH_INFO: `/v3/domains` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:39.484551 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e225535-fc55-4da6-b8cb-00566a67d911 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:25:39.484833 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e225535-fc55-4da6-b8cb-00566a67d911 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:39.486391 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e225535-fc55-4da6-b8cb-00566a67d911 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:39.500341 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 338/669] 10.222.0.102 () {56 vars in 1114 bytes} [Mon Aug 1 15:25:39 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:39.501371 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e225535-fc55-4da6-b8cb-00566a67d911 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:39.511928 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 332/670] 10.222.0.102 () {58 vars in 1287 bytes} [Mon Aug 1 15:25:39 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 15:25:39.513246 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020e68d5-27e1-4e27-a4a2-34388661f397 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:39.513533 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020e68d5-27e1-4e27-a4a2-34388661f397 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:39.513806 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020e68d5-27e1-4e27-a4a2-34388661f397 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:39.515181 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 333/671] 10.222.0.102 () {54 vars in 931 bytes} [Mon Aug 1 15:25:39 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 15:25:39.517635 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020e68d5-27e1-4e27-a4a2-34388661f397 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:39.619099 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:39.624939 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:39.629757 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020e68d5-27e1-4e27-a4a2-34388661f397 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:39.632596 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e225535-fc55-4da6-b8cb-00566a67d911 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:39.666297 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc59923-7393-4735-840f-3a8e30c7ced9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:39.666998 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc59923-7393-4735-840f-3a8e30c7ced9 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:39.667281 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc59923-7393-4735-840f-3a8e30c7ced9 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:39.667565 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc59923-7393-4735-840f-3a8e30c7ced9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:39.672063 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2129459c-e5bc-448e-aab2-c5647c212429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:39.672980 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2129459c-e5bc-448e-aab2-c5647c212429 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:39.673754 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2129459c-e5bc-448e-aab2-c5647c212429 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:39.674238 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2129459c-e5bc-448e-aab2-c5647c212429 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:39.674346 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc59923-7393-4735-840f-3a8e30c7ced9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:39.675801 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc59923-7393-4735-840f-3a8e30c7ced9 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:39.687142 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-6dc59923-7393-4735-840f-3a8e30c7ced9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 15:25:39.687142 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:25:39.687142 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:25:39.687142 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:25:39.687142 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:25:39.687142 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:25:39.687142 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:25:39.687142 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:25:39.687142 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:25:39.687142 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:25:39.687142 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:25:39.687142 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:25:39.687142 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 15:25:39.687142 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 15:25:39.687142 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 15:25:39.688087 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 15:25:39.688087 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:25:39.688087 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:25:39.688087 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:25:39.688087 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:25:39.688087 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:25:39.688087 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:25:39.688087 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:25:39.688087 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 01 15:25:39.688087 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:25:39.688087 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:25:39.688087 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:25:39.688087 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:25:39.688087 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:25:39.688087 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:25:39.688087 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:25:39.688087 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:25:39.689031 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 15:25:39.689031 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 15:25:39.689031 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 15:25:39.689031 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 15:25:39.689031 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 15:25:39.689031 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 15:25:39.689031 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 15:25:39.689031 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 01 15:25:39.689031 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 334/672] 10.222.0.102 () {56 vars in 1116 bytes} [Mon Aug 1 15:25:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:25:39.690129 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc59923-7393-4735-840f-3a8e30c7ced9 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:39.690383 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2129459c-e5bc-448e-aab2-c5647c212429 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:39.691793 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2129459c-e5bc-448e-aab2-c5647c212429 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:39.709538 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-2129459c-e5bc-448e-aab2-c5647c212429 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:25:39.709538 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:25:39.709538 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:25:39.709538 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:25:39.709538 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:25:39.709538 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:25:39.709538 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:25:39.709538 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:25:39.709538 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:25:39.709538 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:25:39.709538 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:25:39.709538 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:25:39.709538 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:25:39.709538 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:25:39.709538 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:25:39.710486 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:25:39.710486 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:25:39.710486 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:25:39.710486 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:25:39.710486 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:25:39.710486 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:25:39.710486 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:25:39.710486 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:25:39.710486 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 01 15:25:39.710486 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:25:39.710486 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:25:39.710486 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:25:39.710486 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:25:39.710486 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:25:39.710486 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:25:39.710486 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:25:39.710486 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:25:39.712044 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:25:39.712044 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:25:39.712044 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:25:39.712044 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 01 15:25:39.712044 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 339/673] 10.222.0.102 () {56 vars in 1113 bytes} [Mon Aug 1 15:25:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:25:39.713000 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ae8e68-5d85-48df-b471-43fc8ed697fb None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:39.713283 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ae8e68-5d85-48df-b471-43fc8ed697fb None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:39.713556 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ae8e68-5d85-48df-b471-43fc8ed697fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:39.736625 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-89ae8e68-5d85-48df-b471-43fc8ed697fb None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:25:39.737918 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-89ae8e68-5d85-48df-b471-43fc8ed697fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:25:39.804359 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc59923-7393-4735-840f-3a8e30c7ced9 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:39.812893 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 340/674] 10.222.0.102 () {58 vars in 1028 bytes} [Mon Aug 1 15:25:39 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 15:25:39.812893 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ae8e68-5d85-48df-b471-43fc8ed697fb None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:39.851324 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aace7415-0b61-4200-8f06-a68a82d94102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:39.851961 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aace7415-0b61-4200-8f06-a68a82d94102 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:39.852239 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aace7415-0b61-4200-8f06-a68a82d94102 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:39.852506 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aace7415-0b61-4200-8f06-a68a82d94102 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:39.863110 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aace7415-0b61-4200-8f06-a68a82d94102 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:39.864560 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aace7415-0b61-4200-8f06-a68a82d94102 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:39.884969 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-aace7415-0b61-4200-8f06-a68a82d94102 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:25:39.884969 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:25:39.884969 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:25:39.884969 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:25:39.884969 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:25:39.884969 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:25:39.884969 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:25:39.884969 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:25:39.884969 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:25:39.884969 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:25:39.884969 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:25:39.884969 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:25:39.884969 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:25:39.884969 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:25:39.884969 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:25:39.885917 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:25:39.885917 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:25:39.885917 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:25:39.885917 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:25:39.885917 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:25:39.885917 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:25:39.885917 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:25:39.885917 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:25:39.885917 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 01 15:25:39.885917 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:25:39.885917 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:25:39.885917 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:25:39.885917 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:25:39.885917 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:25:39.885917 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:25:39.885917 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:25:39.885917 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:25:39.886834 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:25:39.886834 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:25:39.886834 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:25:39.886834 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 01 15:25:39.886834 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 335/675] 10.222.0.102 () {56 vars in 1113 bytes} [Mon Aug 1 15:25:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:25:39.886834 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aace7415-0b61-4200-8f06-a68a82d94102 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:39.901322 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:39.911792 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:39.942013 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ae8e68-5d85-48df-b471-43fc8ed697fb None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:39.980602 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e011ca36-2407-4728-9c05-cc7e34d1c656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:39.981245 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e011ca36-2407-4728-9c05-cc7e34d1c656 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:39.981524 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e011ca36-2407-4728-9c05-cc7e34d1c656 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:39.982056 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e011ca36-2407-4728-9c05-cc7e34d1c656 None admin] PATH_INFO: `/v3/projects` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:39.982520 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e011ca36-2407-4728-9c05-cc7e34d1c656 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:25:39.982826 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e011ca36-2407-4728-9c05-cc7e34d1c656 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:39.984257 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e011ca36-2407-4728-9c05-cc7e34d1c656 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:39.994356 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aace7415-0b61-4200-8f06-a68a82d94102 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:39.997286 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 341/676] 10.222.0.102 () {56 vars in 1153 bytes} [Mon Aug 1 15:25:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:39.997707 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e011ca36-2407-4728-9c05-cc7e34d1c656 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:40.036816 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f82dbd-8e91-479f-b538-731518f9e14f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:40.037473 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f82dbd-8e91-479f-b538-731518f9e14f None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:40.037749 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f82dbd-8e91-479f-b538-731518f9e14f None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:40.038026 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f82dbd-8e91-479f-b538-731518f9e14f None admin] PATH_INFO: `/v3/domains` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:40.038719 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f82dbd-8e91-479f-b538-731518f9e14f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:25:40.039012 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f82dbd-8e91-479f-b538-731518f9e14f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:40.040461 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f82dbd-8e91-479f-b538-731518f9e14f None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:40.057854 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 336/677] 10.222.0.102 () {56 vars in 1114 bytes} [Mon Aug 1 15:25:39 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:40.058872 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f82dbd-8e91-479f-b538-731518f9e14f None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:40.112548 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e011ca36-2407-4728-9c05-cc7e34d1c656 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:40.134384 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:40.145119 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:40.150016 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c8a410-5570-48ab-a739-416b10c0266e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:40.150651 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c8a410-5570-48ab-a739-416b10c0266e None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:40.150927 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c8a410-5570-48ab-a739-416b10c0266e None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:40.151319 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c8a410-5570-48ab-a739-416b10c0266e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:40.162203 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c8a410-5570-48ab-a739-416b10c0266e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:25:40.167119 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-02c8a410-5570-48ab-a739-416b10c0266e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 01 15:25:40.167119 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:25:40.167119 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:25:40.167119 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:25:40.167119 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:25:40.167119 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:25:40.167119 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:25:40.167119 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:25:40.167119 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:25:40.167119 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:25:40.167119 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:25:40.167119 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:25:40.167119 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:25:40.167119 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:25:40.167119 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:25:40.167119 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:25:40.168266 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:25:40.168266 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:25:40.168266 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:25:40.168266 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:25:40.168266 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:25:40.168266 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:25:40.168266 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:25:40.168266 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:25:40.168266 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:25:40.168266 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:25:40.168266 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:25:40.168266 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 01 15:25:40.168266 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:25:40.168266 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:25:40.168266 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:25:40.168266 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:25:40.169157 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:25:40.169157 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:25:40.169157 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:25:40.169157 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:25:40.169157 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:25:40.169157 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:25:40.169157 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:25:40.169157 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:25:40.169157 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:25:40.169157 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:25:40.169157 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 01 15:25:40.169157 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 01 15:25:40.169794 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f82dbd-8e91-479f-b538-731518f9e14f None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:40.169869 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 342/678] 10.222.0.102 () {56 vars in 1107 bytes} [Mon Aug 1 15:25:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:25:40.169869 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c8a410-5570-48ab-a739-416b10c0266e None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:40.212531 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4d41a1-ce32-4358-8557-c2031f806734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:40.213203 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4d41a1-ce32-4358-8557-c2031f806734 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:40.213485 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4d41a1-ce32-4358-8557-c2031f806734 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:40.213757 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4d41a1-ce32-4358-8557-c2031f806734 None admin] PATH_INFO: `/v3/domains` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:40.214452 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4d41a1-ce32-4358-8557-c2031f806734 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:25:40.214757 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4d41a1-ce32-4358-8557-c2031f806734 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:40.216151 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4d41a1-ce32-4358-8557-c2031f806734 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:40.228077 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 337/679] 10.222.0.102 () {56 vars in 1114 bytes} [Mon Aug 1 15:25:40 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:40.228761 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4d41a1-ce32-4358-8557-c2031f806734 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:40.281039 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c8a410-5570-48ab-a739-416b10c0266e None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:40.318178 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4e58d0-9027-4ed7-b883-61c5a7c687cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:40.318796 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4e58d0-9027-4ed7-b883-61c5a7c687cf None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:40.319073 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4e58d0-9027-4ed7-b883-61c5a7c687cf None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:40.319702 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4e58d0-9027-4ed7-b883-61c5a7c687cf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:40.320788 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4e58d0-9027-4ed7-b883-61c5a7c687cf None admin] RBAC: Adding query filter params (role.id=3087c03acf8d44d9ae512385924c5d0d, scope.project.id=2eb32fbe631843d8be84d41f8ba88d6e, user.id=a856a413100443939fe9b10daa868518) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:25:40.321126 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4e58d0-9027-4ed7-b883-61c5a7c687cf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:40.322597 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4e58d0-9027-4ed7-b883-61c5a7c687cf None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:40.340885 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 343/680] 10.222.0.102 () {56 vars in 1379 bytes} [Mon Aug 1 15:25:40 2022] GET /identity/v3/role_assignments?user.id=a856a413100443939fe9b10daa868518&scope.project.id=2eb32fbe631843d8be84d41f8ba88d6e&role.id=3087c03acf8d44d9ae512385924c5d0d => generated 610 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:40.340885 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4e58d0-9027-4ed7-b883-61c5a7c687cf None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:40.344165 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4d41a1-ce32-4358-8557-c2031f806734 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:40.385158 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:40.392770 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66feafd6-ec9b-4e9d-9635-77bfebc53468 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:40.394102 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66feafd6-ec9b-4e9d-9635-77bfebc53468 None admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:40.394457 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66feafd6-ec9b-4e9d-9635-77bfebc53468 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:40.394949 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66feafd6-ec9b-4e9d-9635-77bfebc53468 None admin] PATH_INFO: `/v3/users` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:40.396133 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66feafd6-ec9b-4e9d-9635-77bfebc53468 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:40.397728 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66feafd6-ec9b-4e9d-9635-77bfebc53468 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:40.425282 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:40.453758 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4e58d0-9027-4ed7-b883-61c5a7c687cf None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:40.481117 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 338/681] 10.222.0.102 () {60 vars in 1137 bytes} [Mon Aug 1 15:25:40 2022] POST /identity/v3/users => generated 255 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:25:40.482279 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66feafd6-ec9b-4e9d-9635-77bfebc53468 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:40.516000 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a29de49-43b6-4630-bab0-8559eb39d3a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:40.517211 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a29de49-43b6-4630-bab0-8559eb39d3a3 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:40.517685 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a29de49-43b6-4630-bab0-8559eb39d3a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:40.520758 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a29de49-43b6-4630-bab0-8559eb39d3a3 None admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:40.520758 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a29de49-43b6-4630-bab0-8559eb39d3a3 None admin] RBAC: Adding query filter params (name=service) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:25:40.520758 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a29de49-43b6-4630-bab0-8559eb39d3a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:40.524229 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a29de49-43b6-4630-bab0-8559eb39d3a3 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:40.540022 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 344/682] 10.222.0.102 () {56 vars in 1108 bytes} [Mon Aug 1 15:25:40 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:40.541571 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a29de49-43b6-4630-bab0-8559eb39d3a3 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:40.635955 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66feafd6-ec9b-4e9d-9635-77bfebc53468 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:40.680063 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877a3df8-d4bf-4d09-8bb0-c70fd4064c5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:40.681201 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877a3df8-d4bf-4d09-8bb0-c70fd4064c5b None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:40.681691 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877a3df8-d4bf-4d09-8bb0-c70fd4064c5b None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:40.682181 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877a3df8-d4bf-4d09-8bb0-c70fd4064c5b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:40.691003 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877a3df8-d4bf-4d09-8bb0-c70fd4064c5b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:40.692500 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877a3df8-d4bf-4d09-8bb0-c70fd4064c5b None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:40.694352 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a29de49-43b6-4630-bab0-8559eb39d3a3 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:40.706402 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-877a3df8-d4bf-4d09-8bb0-c70fd4064c5b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 15:25:40.706402 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:25:40.706402 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:25:40.706402 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:25:40.706402 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:25:40.706402 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:25:40.706402 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:25:40.706402 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:25:40.706402 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:25:40.706402 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:25:40.706402 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:25:40.706402 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:25:40.706402 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 15:25:40.706402 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 15:25:40.706402 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 15:25:40.707435 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 15:25:40.707435 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:25:40.707435 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:25:40.707435 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:25:40.707435 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:25:40.707435 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:25:40.707435 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:25:40.707435 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:25:40.707435 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 01 15:25:40.707435 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:25:40.707435 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:25:40.707435 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:25:40.707435 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:25:40.707435 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:25:40.707435 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:25:40.707435 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:25:40.707435 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:25:40.708834 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 15:25:40.708834 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 15:25:40.708834 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 15:25:40.708834 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 15:25:40.708834 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 15:25:40.708834 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 15:25:40.708834 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 15:25:40.708834 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 01 15:25:40.708834 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 339/683] 10.222.0.102 () {56 vars in 1116 bytes} [Mon Aug 1 15:25:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:25:40.716332 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877a3df8-d4bf-4d09-8bb0-c70fd4064c5b None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:40.721564 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:40.747110 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21565a5-d65c-4e5f-9aa4-99e3b1ed38cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:40.748632 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21565a5-d65c-4e5f-9aa4-99e3b1ed38cc None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:40.749188 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21565a5-d65c-4e5f-9aa4-99e3b1ed38cc None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:40.749924 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21565a5-d65c-4e5f-9aa4-99e3b1ed38cc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:40.765493 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21565a5-d65c-4e5f-9aa4-99e3b1ed38cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:40.767392 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21565a5-d65c-4e5f-9aa4-99e3b1ed38cc None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:40.779173 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:40.788684 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-c21565a5-d65c-4e5f-9aa4-99e3b1ed38cc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:25:40.788684 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:25:40.788684 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:25:40.788684 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:25:40.788684 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:25:40.788684 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:25:40.788684 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:25:40.788684 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:25:40.788684 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:25:40.788684 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:25:40.788684 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:25:40.788684 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:25:40.788684 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:25:40.788684 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:25:40.788684 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:25:40.791616 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:25:40.791616 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:25:40.791616 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:25:40.791616 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:25:40.791616 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:25:40.791616 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:25:40.791616 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:25:40.791616 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:25:40.791616 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 01 15:25:40.791616 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:25:40.791616 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:25:40.791616 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:25:40.791616 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:25:40.791616 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:25:40.791616 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:25:40.791616 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:25:40.791616 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:25:40.792528 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:25:40.792528 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:25:40.792528 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:25:40.792528 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 01 15:25:40.796104 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 345/684] 10.222.0.102 () {56 vars in 1113 bytes} [Mon Aug 1 15:25:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:25:40.797455 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21565a5-d65c-4e5f-9aa4-99e3b1ed38cc None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:40.853680 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877a3df8-d4bf-4d09-8bb0-c70fd4064c5b None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:40.915165 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f99ab25-31d3-4a34-b7ca-a4201f1b3368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:40.916341 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f99ab25-31d3-4a34-b7ca-a4201f1b3368 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:40.916809 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f99ab25-31d3-4a34-b7ca-a4201f1b3368 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:40.917273 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f99ab25-31d3-4a34-b7ca-a4201f1b3368 None admin] PATH_INFO: `/v3/projects` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:40.918039 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f99ab25-31d3-4a34-b7ca-a4201f1b3368 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:25:40.918407 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f99ab25-31d3-4a34-b7ca-a4201f1b3368 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:40.920216 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f99ab25-31d3-4a34-b7ca-a4201f1b3368 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:40.936053 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21565a5-d65c-4e5f-9aa4-99e3b1ed38cc None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:40.975220 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1d1037-c0a8-47bf-81d4-6c558d44cff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:40.975861 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1d1037-c0a8-47bf-81d4-6c558d44cff4 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:40.976136 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1d1037-c0a8-47bf-81d4-6c558d44cff4 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:40.976996 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1d1037-c0a8-47bf-81d4-6c558d44cff4 None admin] PATH_INFO: `/v3/domains` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:40.977716 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1d1037-c0a8-47bf-81d4-6c558d44cff4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:25:40.978019 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1d1037-c0a8-47bf-81d4-6c558d44cff4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:40.979437 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1d1037-c0a8-47bf-81d4-6c558d44cff4 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:40.993861 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 346/685] 10.222.0.102 () {56 vars in 1114 bytes} [Mon Aug 1 15:25:40 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:40.999524 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1d1037-c0a8-47bf-81d4-6c558d44cff4 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:41.037672 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:41.068466 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 340/686] 10.222.0.102 () {56 vars in 1153 bytes} [Mon Aug 1 15:25:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 355 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:41.076712 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f99ab25-31d3-4a34-b7ca-a4201f1b3368 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:41.120749 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1d1037-c0a8-47bf-81d4-6c558d44cff4 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:41.203660 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f99ab25-31d3-4a34-b7ca-a4201f1b3368 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:41.212719 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:41.218976 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6697dddc-d964-4db0-865a-98d26d9f6f04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:41.219632 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6697dddc-d964-4db0-865a-98d26d9f6f04 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:41.219909 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6697dddc-d964-4db0-865a-98d26d9f6f04 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:41.220180 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6697dddc-d964-4db0-865a-98d26d9f6f04 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:41.238009 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6697dddc-d964-4db0-865a-98d26d9f6f04 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:41.239588 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6697dddc-d964-4db0-865a-98d26d9f6f04 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:41.245726 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343561ec-cad8-4cde-a930-111dd8faf0de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:41.246491 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343561ec-cad8-4cde-a930-111dd8faf0de None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:41.246773 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343561ec-cad8-4cde-a930-111dd8faf0de None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:41.247048 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343561ec-cad8-4cde-a930-111dd8faf0de None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:41.251069 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343561ec-cad8-4cde-a930-111dd8faf0de None admin] RBAC: Adding query filter params (role.id=3087c03acf8d44d9ae512385924c5d0d, scope.project.id=2eb32fbe631843d8be84d41f8ba88d6e, user.id=ff810b37183c4729859c1b05edff1703) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:25:41.251584 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343561ec-cad8-4cde-a930-111dd8faf0de None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:41.254613 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343561ec-cad8-4cde-a930-111dd8faf0de None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:41.263060 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-6697dddc-d964-4db0-865a-98d26d9f6f04 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 01 15:25:41.263060 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:25:41.263060 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:25:41.263060 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:25:41.263060 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:25:41.263060 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:25:41.263060 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:25:41.263060 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:25:41.263060 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:25:41.263060 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:25:41.263060 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:25:41.263060 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:25:41.263060 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 15:25:41.263060 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 15:25:41.263060 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 15:25:41.263060 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 15:25:41.265248 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:25:41.265248 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:25:41.265248 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 15:25:41.265248 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 15:25:41.265248 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 15:25:41.265248 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 15:25:41.265248 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:25:41.265248 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:25:41.265248 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:25:41.265248 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:25:41.265248 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:25:41.265248 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 01 15:25:41.265248 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:25:41.265248 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:25:41.265248 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:25:41.265248 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:25:41.265248 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:25:41.265248 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:25:41.267500 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:25:41.267500 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:25:41.267500 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 15:25:41.267500 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 15:25:41.267500 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 15:25:41.267500 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 15:25:41.267500 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 15:25:41.267500 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 15:25:41.267500 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 01 15:25:41.267500 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 01 15:25:41.273112 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 347/687] 10.222.0.102 () {56 vars in 1101 bytes} [Mon Aug 1 15:25:40 2022] GET /identity/v3/users/swift => generated 83 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:25:41.276567 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6697dddc-d964-4db0-865a-98d26d9f6f04 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:41.277824 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 341/688] 10.222.0.102 () {56 vars in 1379 bytes} [Mon Aug 1 15:25:41 2022] GET /identity/v3/role_assignments?user.id=ff810b37183c4729859c1b05edff1703&scope.project.id=2eb32fbe631843d8be84d41f8ba88d6e&role.id=3087c03acf8d44d9ae512385924c5d0d => generated 610 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:41.401539 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:41.411994 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6697dddc-d964-4db0-865a-98d26d9f6f04 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:41.462041 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c547b2bf-79aa-4d06-b943-c7b805c1fd3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:41.462593 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c547b2bf-79aa-4d06-b943-c7b805c1fd3e None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:41.462876 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c547b2bf-79aa-4d06-b943-c7b805c1fd3e None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:41.463219 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c547b2bf-79aa-4d06-b943-c7b805c1fd3e None admin] PATH_INFO: `/v3/users` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:41.464153 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c547b2bf-79aa-4d06-b943-c7b805c1fd3e None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:25:41.464493 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c547b2bf-79aa-4d06-b943-c7b805c1fd3e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:41.465948 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c547b2bf-79aa-4d06-b943-c7b805c1fd3e None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:41.485573 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 348/689] 10.222.0.102 () {56 vars in 1140 bytes} [Mon Aug 1 15:25:41 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 372 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:41.491025 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343561ec-cad8-4cde-a930-111dd8faf0de None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:41.586503 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3f55f9-91b1-4596-97e4-9a3103cc9f97 None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:41.586952 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3f55f9-91b1-4596-97e4-9a3103cc9f97 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:41.587329 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3f55f9-91b1-4596-97e4-9a3103cc9f97 None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:41.590147 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 349/690] 10.222.0.102 () {54 vars in 931 bytes} [Mon Aug 1 15:25:41 2022] GET /identity => generated 271 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 01 15:25:41.598300 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9748719-f146-476e-9605-12be2fbfa24e None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:41.598729 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9748719-f146-476e-9605-12be2fbfa24e None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:41.599103 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9748719-f146-476e-9605-12be2fbfa24e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:41.609879 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343561ec-cad8-4cde-a930-111dd8faf0de None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:41.623430 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-b9748719-f146-476e-9605-12be2fbfa24e None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:25:41.624920 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-b9748719-f146-476e-9605-12be2fbfa24e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:25:41.654449 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2289a8b1-8cf8-4ff5-a7b7-acb9515e6b18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:41.655458 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2289a8b1-8cf8-4ff5-a7b7-acb9515e6b18 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:41.655945 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2289a8b1-8cf8-4ff5-a7b7-acb9515e6b18 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:41.656499 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2289a8b1-8cf8-4ff5-a7b7-acb9515e6b18 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:41.700315 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:41.730448 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 350/691] 10.222.0.102 () {58 vars in 1028 bytes} [Mon Aug 1 15:25:41 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 01 15:25:41.737748 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2289a8b1-8cf8-4ff5-a7b7-acb9515e6b18 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:41.739637 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2289a8b1-8cf8-4ff5-a7b7-acb9515e6b18 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:41.769166 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9748719-f146-476e-9605-12be2fbfa24e None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:41.911363 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:41.915034 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 342/692] 10.222.0.102 () {58 vars in 1287 bytes} [Mon Aug 1 15:25:41 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 15:25:41.920464 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2289a8b1-8cf8-4ff5-a7b7-acb9515e6b18 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:41.962445 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9748719-f146-476e-9605-12be2fbfa24e None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:42.042756 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00d125c-a0a7-4a3b-9d78-bccc78772bad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:42.043389 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00d125c-a0a7-4a3b-9d78-bccc78772bad None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:42.043626 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00d125c-a0a7-4a3b-9d78-bccc78772bad None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:42.043850 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00d125c-a0a7-4a3b-9d78-bccc78772bad None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:42.067911 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00d125c-a0a7-4a3b-9d78-bccc78772bad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:25:42.069199 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:42.077320 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-c00d125c-a0a7-4a3b-9d78-bccc78772bad None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 15:25:42.077320 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:25:42.077320 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:25:42.077320 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:25:42.077320 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:25:42.077320 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:25:42.077320 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:25:42.077320 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:25:42.077320 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:25:42.077320 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:25:42.077320 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:25:42.077320 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:25:42.077320 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:25:42.077320 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:25:42.077320 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:25:42.077320 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:25:42.078299 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:25:42.078299 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:25:42.078299 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:25:42.078299 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:25:42.078299 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:25:42.078299 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:25:42.078299 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:25:42.078299 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:25:42.078299 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:25:42.078299 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:25:42.078299 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:25:42.078299 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 01 15:25:42.078299 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:25:42.078299 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:25:42.078299 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:25:42.078299 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:25:42.079152 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:25:42.079152 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:25:42.079152 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:25:42.079152 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:25:42.079152 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:25:42.079152 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:25:42.079152 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:25:42.079152 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:25:42.079152 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:25:42.079152 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:25:42.079152 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 15:25:42.079152 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 01 15:25:42.079152 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 351/693] 10.222.0.102 () {56 vars in 1101 bytes} [Mon Aug 1 15:25:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 15:25:42.084291 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00d125c-a0a7-4a3b-9d78-bccc78772bad None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:42.106785 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2289a8b1-8cf8-4ff5-a7b7-acb9515e6b18 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:42.149138 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cc657a-1c71-4cd4-8e8e-3f656b6c69fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:42.149804 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cc657a-1c71-4cd4-8e8e-3f656b6c69fb None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:42.150090 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cc657a-1c71-4cd4-8e8e-3f656b6c69fb None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:42.150365 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cc657a-1c71-4cd4-8e8e-3f656b6c69fb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:42.162537 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cc657a-1c71-4cd4-8e8e-3f656b6c69fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:42.164522 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cc657a-1c71-4cd4-8e8e-3f656b6c69fb None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:42.181908 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-d1cc657a-1c71-4cd4-8e8e-3f656b6c69fb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:25:42.181908 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:25:42.181908 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:25:42.181908 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:25:42.181908 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:25:42.181908 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:25:42.181908 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:25:42.181908 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:25:42.181908 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:25:42.181908 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:25:42.181908 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:25:42.181908 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:25:42.181908 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:25:42.181908 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:25:42.181908 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:25:42.182840 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:25:42.182840 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:25:42.182840 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:25:42.182840 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:25:42.182840 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:25:42.182840 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:25:42.182840 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:25:42.182840 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:25:42.182840 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 01 15:25:42.182840 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:25:42.182840 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:25:42.182840 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:25:42.182840 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:25:42.182840 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:25:42.182840 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:25:42.182840 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:25:42.182840 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:25:42.183747 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:25:42.183747 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:25:42.183747 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:25:42.183747 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 01 15:25:42.187806 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 343/694] 10.222.0.102 () {56 vars in 1113 bytes} [Mon Aug 1 15:25:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:25:42.189029 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cc657a-1c71-4cd4-8e8e-3f656b6c69fb None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:42.302515 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cc657a-1c71-4cd4-8e8e-3f656b6c69fb None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:42.316609 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00d125c-a0a7-4a3b-9d78-bccc78772bad None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:42.333339 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:42.341410 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435ea60d-5ca6-435d-9ae0-3ed7b84c015f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:42.342309 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435ea60d-5ca6-435d-9ae0-3ed7b84c015f None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:42.342591 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435ea60d-5ca6-435d-9ae0-3ed7b84c015f None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:42.342860 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435ea60d-5ca6-435d-9ae0-3ed7b84c015f None admin] PATH_INFO: `/v3/domains` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:42.343559 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435ea60d-5ca6-435d-9ae0-3ed7b84c015f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:25:42.343862 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435ea60d-5ca6-435d-9ae0-3ed7b84c015f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:42.345294 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435ea60d-5ca6-435d-9ae0-3ed7b84c015f None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:42.364400 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 344/695] 10.222.0.102 () {56 vars in 1114 bytes} [Mon Aug 1 15:25:42 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:25:42.365727 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435ea60d-5ca6-435d-9ae0-3ed7b84c015f None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:42.409657 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4284911-dc1f-40a4-9e65-41ad7a406ac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:42.410294 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4284911-dc1f-40a4-9e65-41ad7a406ac2 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:42.410576 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4284911-dc1f-40a4-9e65-41ad7a406ac2 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:42.410850 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4284911-dc1f-40a4-9e65-41ad7a406ac2 None admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:42.411600 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4284911-dc1f-40a4-9e65-41ad7a406ac2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:25:42.411972 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4284911-dc1f-40a4-9e65-41ad7a406ac2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:42.413484 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4284911-dc1f-40a4-9e65-41ad7a406ac2 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:42.425183 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:42.433021 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 352/696] 10.222.0.102 () {56 vars in 1104 bytes} [Mon Aug 1 15:25:42 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 349 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:25:42.438103 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4284911-dc1f-40a4-9e65-41ad7a406ac2 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:42.494896 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435ea60d-5ca6-435d-9ae0-3ed7b84c015f None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:42.581039 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4284911-dc1f-40a4-9e65-41ad7a406ac2 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:42.594887 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f2e57d-393e-4065-b156-f69066298688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:42.595856 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f2e57d-393e-4065-b156-f69066298688 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:42.596359 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f2e57d-393e-4065-b156-f69066298688 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:42.596840 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f2e57d-393e-4065-b156-f69066298688 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:42.618227 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f2e57d-393e-4065-b156-f69066298688 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:42.620827 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f2e57d-393e-4065-b156-f69066298688 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:42.624248 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e734730f-c8d9-44cb-9180-792e33f201e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:42.624920 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e734730f-c8d9-44cb-9180-792e33f201e2 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:42.625258 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e734730f-c8d9-44cb-9180-792e33f201e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:42.625530 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e734730f-c8d9-44cb-9180-792e33f201e2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:42.644026 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-76f2e57d-393e-4065-b156-f69066298688 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 15:25:42.644026 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:25:42.644026 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:25:42.644026 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:25:42.644026 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:25:42.644026 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:25:42.644026 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:25:42.644026 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:25:42.644026 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:25:42.644026 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:25:42.644026 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:25:42.644026 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:25:42.644026 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 15:25:42.644026 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 15:25:42.644026 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 15:25:42.645010 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 15:25:42.645010 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:25:42.645010 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:25:42.645010 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:25:42.645010 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:25:42.645010 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:25:42.645010 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:25:42.645010 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:25:42.645010 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 01 15:25:42.645010 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:25:42.645010 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:25:42.645010 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:25:42.645010 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:25:42.645010 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:25:42.645010 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:25:42.645010 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:25:42.645010 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:25:42.645950 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 15:25:42.645950 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 15:25:42.645950 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 15:25:42.645950 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 15:25:42.645950 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 15:25:42.645950 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 15:25:42.645950 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 15:25:42.645950 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 01 15:25:42.650602 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e734730f-c8d9-44cb-9180-792e33f201e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:42.652130 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e734730f-c8d9-44cb-9180-792e33f201e2 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:42.652593 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 345/697] 10.222.0.102 () {56 vars in 1116 bytes} [Mon Aug 1 15:25:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:25:42.658056 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f2e57d-393e-4065-b156-f69066298688 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:42.692205 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-e734730f-c8d9-44cb-9180-792e33f201e2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:25:42.692205 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:25:42.692205 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:25:42.692205 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:25:42.692205 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:25:42.692205 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:25:42.692205 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:25:42.692205 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:25:42.692205 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:25:42.692205 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:25:42.692205 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:25:42.692205 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:25:42.692205 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:25:42.692205 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:25:42.692205 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:25:42.693272 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:25:42.693272 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:25:42.693272 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:25:42.693272 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:25:42.693272 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:25:42.693272 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:25:42.693272 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:25:42.693272 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:25:42.693272 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 01 15:25:42.693272 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:25:42.693272 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:25:42.693272 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:25:42.693272 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:25:42.693272 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:25:42.693272 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:25:42.693272 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:25:42.693272 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:25:42.694196 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:25:42.694196 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:25:42.694196 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:25:42.694196 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 01 15:25:42.694196 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 353/698] 10.222.0.102 () {56 vars in 1113 bytes} [Mon Aug 1 15:25:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 15:25:42.699524 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e734730f-c8d9-44cb-9180-792e33f201e2 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:42.734052 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:42.783919 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:42.853671 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f2e57d-393e-4065-b156-f69066298688 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:42.862499 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e734730f-c8d9-44cb-9180-792e33f201e2 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:42.911089 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71556d04-5976-4099-8175-9b4b469d7166 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:42.911715 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71556d04-5976-4099-8175-9b4b469d7166 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:42.911993 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71556d04-5976-4099-8175-9b4b469d7166 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:42.912264 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71556d04-5976-4099-8175-9b4b469d7166 None admin] PATH_INFO: `/v3/domains` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:42.912993 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71556d04-5976-4099-8175-9b4b469d7166 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:25:42.913297 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71556d04-5976-4099-8175-9b4b469d7166 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:42.914706 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71556d04-5976-4099-8175-9b4b469d7166 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:42.920477 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0281a8e4-1411-4605-a92b-b4e27816bf54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:42.921768 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0281a8e4-1411-4605-a92b-b4e27816bf54 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:42.922279 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0281a8e4-1411-4605-a92b-b4e27816bf54 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:42.922621 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0281a8e4-1411-4605-a92b-b4e27816bf54 None admin] PATH_INFO: `/v3/projects` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:42.923551 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0281a8e4-1411-4605-a92b-b4e27816bf54 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:25:42.923947 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0281a8e4-1411-4605-a92b-b4e27816bf54 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:42.925524 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0281a8e4-1411-4605-a92b-b4e27816bf54 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:42.928584 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 354/699] 10.222.0.102 () {56 vars in 1114 bytes} [Mon Aug 1 15:25:42 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:25:42.930138 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb549b79-c439-47de-be1a-0082c9ed4a39 None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:42.930603 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb549b79-c439-47de-be1a-0082c9ed4a39 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:42.931048 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb549b79-c439-47de-be1a-0082c9ed4a39 None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:42.932697 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 355/700] 10.222.0.102 () {54 vars in 931 bytes} [Mon Aug 1 15:25:42 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 15:25:42.933739 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb549b79-c439-47de-be1a-0082c9ed4a39 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:42.943171 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 346/701] 10.222.0.102 () {56 vars in 1153 bytes} [Mon Aug 1 15:25:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:42.944371 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a48fa9-e440-4ca4-b382-7e773999fe0d None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:42.944733 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a48fa9-e440-4ca4-b382-7e773999fe0d None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:42.945646 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a48fa9-e440-4ca4-b382-7e773999fe0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:42.969546 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-68a48fa9-e440-4ca4-b382-7e773999fe0d None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:25:42.971372 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-68a48fa9-e440-4ca4-b382-7e773999fe0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:25:43.065779 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb549b79-c439-47de-be1a-0082c9ed4a39 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:43.079041 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 347/702] 10.222.0.102 () {58 vars in 1028 bytes} [Mon Aug 1 15:25:42 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 15:25:43.080592 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a48fa9-e440-4ca4-b382-7e773999fe0d None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:43.081494 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:43.106875 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887bcf1c-b90c-4982-91dd-333a089ea2ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:43.107494 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887bcf1c-b90c-4982-91dd-333a089ea2ae None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:43.107772 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887bcf1c-b90c-4982-91dd-333a089ea2ae None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:43.108042 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887bcf1c-b90c-4982-91dd-333a089ea2ae None admin] PATH_INFO: `/v3/users/nova` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:43.118450 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887bcf1c-b90c-4982-91dd-333a089ea2ae None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:43.121476 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887bcf1c-b90c-4982-91dd-333a089ea2ae None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:43.126321 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:43.145079 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-887bcf1c-b90c-4982-91dd-333a089ea2ae None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 01 15:25:43.145079 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:25:43.145079 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:25:43.145079 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:25:43.145079 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:25:43.145079 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:25:43.145079 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:25:43.145079 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:25:43.145079 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:25:43.145079 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:25:43.145079 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:25:43.145079 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:25:43.145079 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 15:25:43.145079 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 15:25:43.145079 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 15:25:43.145079 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 15:25:43.146296 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:25:43.146296 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:25:43.146296 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 15:25:43.146296 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 15:25:43.146296 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 15:25:43.146296 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 15:25:43.146296 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:25:43.146296 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:25:43.146296 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:25:43.146296 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:25:43.146296 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:25:43.146296 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 01 15:25:43.146296 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:25:43.146296 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:25:43.146296 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:25:43.146296 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:25:43.146296 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:25:43.146296 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:25:43.147577 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:25:43.147577 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:25:43.147577 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 15:25:43.147577 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 15:25:43.147577 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 15:25:43.147577 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 15:25:43.147577 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 15:25:43.147577 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 15:25:43.147577 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 01 15:25:43.147577 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 01 15:25:43.150115 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 356/703] 10.222.0.102 () {56 vars in 1098 bytes} [Mon Aug 1 15:25:42 2022] GET /identity/v3/users/nova => generated 82 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 15:25:43.151220 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887bcf1c-b90c-4982-91dd-333a089ea2ae None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:43.212943 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a48fa9-e440-4ca4-b382-7e773999fe0d None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:43.248629 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae52ca9-19e9-4313-a335-8bb0f16d2ad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:43.249503 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae52ca9-19e9-4313-a335-8bb0f16d2ad1 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:43.249892 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae52ca9-19e9-4313-a335-8bb0f16d2ad1 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:43.250159 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae52ca9-19e9-4313-a335-8bb0f16d2ad1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:43.250937 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae52ca9-19e9-4313-a335-8bb0f16d2ad1 None admin] RBAC: Adding query filter params (role.id=3087c03acf8d44d9ae512385924c5d0d, scope.project.id=2eb32fbe631843d8be84d41f8ba88d6e, user.id=90673f47354f4403aa0e12e3658441c8) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:25:43.251238 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae52ca9-19e9-4313-a335-8bb0f16d2ad1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:43.252641 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae52ca9-19e9-4313-a335-8bb0f16d2ad1 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:43.260009 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 348/704] 10.222.0.102 () {56 vars in 1379 bytes} [Mon Aug 1 15:25:43 2022] GET /identity/v3/role_assignments?user.id=90673f47354f4403aa0e12e3658441c8&scope.project.id=2eb32fbe631843d8be84d41f8ba88d6e&role.id=3087c03acf8d44d9ae512385924c5d0d => generated 610 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:43.260892 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae52ca9-19e9-4313-a335-8bb0f16d2ad1 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:43.278373 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887bcf1c-b90c-4982-91dd-333a089ea2ae None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:43.335927 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578b4862-95d2-4cbc-806d-bd325e86c451 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:43.337245 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578b4862-95d2-4cbc-806d-bd325e86c451 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:43.337680 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578b4862-95d2-4cbc-806d-bd325e86c451 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:43.338395 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578b4862-95d2-4cbc-806d-bd325e86c451 None admin] PATH_INFO: `/v3/services/network` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:43.339749 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578b4862-95d2-4cbc-806d-bd325e86c451 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:43.341972 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578b4862-95d2-4cbc-806d-bd325e86c451 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:43.359203 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-578b4862-95d2-4cbc-806d-bd325e86c451 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 01 15:25:43.359203 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:25:43.359203 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 01 15:25:43.359203 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 01 15:25:43.359203 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 01 15:25:43.359203 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 01 15:25:43.359203 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 01 15:25:43.359203 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 15:25:43.359203 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 01 15:25:43.359203 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 01 15:25:43.359203 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 15:25:43.359203 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 01 15:25:43.359203 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:25:43.359203 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:25:43.359203 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:25:43.359203 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:25:43.359203 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:25:43.360505 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:25:43.360505 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:25:43.360505 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:25:43.360505 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:25:43.360505 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:25:43.360505 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:25:43.360505 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 01 15:25:43.360505 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 01 15:25:43.360505 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 01 15:25:43.360505 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 01 15:25:43.360505 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:25:43.360505 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:25:43.360505 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:25:43.360505 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:25:43.360505 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:25:43.360505 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:25:43.361567 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:25:43.361567 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 01 15:25:43.361567 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:25:43.361567 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:25:43.361567 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:25:43.361567 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:25:43.361567 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:25:43.361567 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:25:43.361567 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:25:43.361567 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:25:43.361567 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 01 15:25:43.361567 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 15:25:43.361567 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 01 15:25:43.361567 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 01 15:25:43.364910 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 357/705] 10.222.0.102 () {56 vars in 1116 bytes} [Mon Aug 1 15:25:43 2022] GET /identity/v3/services/network => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:25:43.367725 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016181f0-ce17-4068-8d7d-449d8bd0e7c3 None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:43.368213 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016181f0-ce17-4068-8d7d-449d8bd0e7c3 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:43.369192 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016181f0-ce17-4068-8d7d-449d8bd0e7c3 None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:43.372080 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 358/706] 10.222.0.102 () {54 vars in 931 bytes} [Mon Aug 1 15:25:43 2022] GET /identity => generated 271 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 15:25:43.373719 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016181f0-ce17-4068-8d7d-449d8bd0e7c3 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:43.388073 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:43.395062 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae52ca9-19e9-4313-a335-8bb0f16d2ad1 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:43.431844 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:43.439269 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d12c0b-7168-445a-9df4-da01c5342579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:43.439905 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d12c0b-7168-445a-9df4-da01c5342579 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:43.440560 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d12c0b-7168-445a-9df4-da01c5342579 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:43.440839 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d12c0b-7168-445a-9df4-da01c5342579 None admin] PATH_INFO: `/v3/users` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:43.441990 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d12c0b-7168-445a-9df4-da01c5342579 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:25:43.442301 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d12c0b-7168-445a-9df4-da01c5342579 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:43.444880 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d12c0b-7168-445a-9df4-da01c5342579 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:43.470812 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 349/707] 10.222.0.102 () {56 vars in 1138 bytes} [Mon Aug 1 15:25:43 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 370 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:43.472300 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6403d8-3a8b-42f7-b403-a5bcac789cec None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:43.473112 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6403d8-3a8b-42f7-b403-a5bcac789cec None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:43.473399 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6403d8-3a8b-42f7-b403-a5bcac789cec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:43.495326 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-5c6403d8-3a8b-42f7-b403-a5bcac789cec None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:25:43.496578 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-5c6403d8-3a8b-42f7-b403-a5bcac789cec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:25:43.514483 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016181f0-ce17-4068-8d7d-449d8bd0e7c3 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:43.569076 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dfa5e7-9ac6-44d5-afd7-2a7144f37540 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:43.569756 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dfa5e7-9ac6-44d5-afd7-2a7144f37540 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:43.570071 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dfa5e7-9ac6-44d5-afd7-2a7144f37540 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:43.570445 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dfa5e7-9ac6-44d5-afd7-2a7144f37540 None admin] PATH_INFO: `/v3/services` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:43.571184 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dfa5e7-9ac6-44d5-afd7-2a7144f37540 None admin] RBAC: Adding query filter params (name=network) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:25:43.571535 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dfa5e7-9ac6-44d5-afd7-2a7144f37540 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:43.574124 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dfa5e7-9ac6-44d5-afd7-2a7144f37540 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:43.579551 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 359/708] 10.222.0.102 () {56 vars in 1117 bytes} [Mon Aug 1 15:25:43 2022] GET /identity/v3/services?name=network => generated 125 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:43.579841 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 350/709] 10.222.0.102 () {58 vars in 1028 bytes} [Mon Aug 1 15:25:43 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 15:25:43.580450 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dfa5e7-9ac6-44d5-afd7-2a7144f37540 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:43.587675 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6403d8-3a8b-42f7-b403-a5bcac789cec None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:43.706442 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:43.708197 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:43.709943 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dfa5e7-9ac6-44d5-afd7-2a7144f37540 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:43.725047 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6403d8-3a8b-42f7-b403-a5bcac789cec None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:43.749631 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bfc06e-9a47-4ff5-8a63-7e7b5e961735 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:43.750733 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bfc06e-9a47-4ff5-8a63-7e7b5e961735 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:43.751134 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bfc06e-9a47-4ff5-8a63-7e7b5e961735 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:43.751599 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bfc06e-9a47-4ff5-8a63-7e7b5e961735 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:43.763816 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c8209d-3cfd-4e9f-934d-7d0bed39cb18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:43.764987 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c8209d-3cfd-4e9f-934d-7d0bed39cb18 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:43.765473 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c8209d-3cfd-4e9f-934d-7d0bed39cb18 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:43.765973 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c8209d-3cfd-4e9f-934d-7d0bed39cb18 None admin] PATH_INFO: `/v3/services` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:43.766892 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c8209d-3cfd-4e9f-934d-7d0bed39cb18 None admin] RBAC: Adding query filter params (type=network) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:25:43.767495 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c8209d-3cfd-4e9f-934d-7d0bed39cb18 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:43.769246 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c8209d-3cfd-4e9f-934d-7d0bed39cb18 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:43.781197 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 351/710] 10.222.0.102 () {56 vars in 1117 bytes} [Mon Aug 1 15:25:43 2022] GET /identity/v3/services?type=network => generated 125 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:25:43.782664 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c8209d-3cfd-4e9f-934d-7d0bed39cb18 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:43.824927 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bfc06e-9a47-4ff5-8a63-7e7b5e961735 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:43.827243 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bfc06e-9a47-4ff5-8a63-7e7b5e961735 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:43.933967 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:43.938375 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 360/711] 10.222.0.102 () {58 vars in 1287 bytes} [Mon Aug 1 15:25:43 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 15:25:43.940008 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7505ceda-40c7-452d-88ca-c8cd892aea61 None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:43.942815 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7505ceda-40c7-452d-88ca-c8cd892aea61 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:43.943212 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7505ceda-40c7-452d-88ca-c8cd892aea61 None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:43.948055 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 361/712] 10.222.0.102 () {54 vars in 931 bytes} [Mon Aug 1 15:25:43 2022] GET /identity => generated 271 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 15:25:43.948754 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7505ceda-40c7-452d-88ca-c8cd892aea61 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:43.957996 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c8209d-3cfd-4e9f-934d-7d0bed39cb18 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:43.996839 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a083d571-8ec5-4731-a78f-5f39abb347ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:43.997806 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a083d571-8ec5-4731-a78f-5f39abb347ab None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:43.998257 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a083d571-8ec5-4731-a78f-5f39abb347ab None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:43.998677 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a083d571-8ec5-4731-a78f-5f39abb347ab None admin] PATH_INFO: `/v3/roles/service` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:44.011367 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a083d571-8ec5-4731-a78f-5f39abb347ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:25:44.017917 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-a083d571-8ec5-4731-a78f-5f39abb347ab None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 01 15:25:44.017917 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:25:44.017917 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:25:44.017917 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:25:44.017917 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:25:44.017917 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:25:44.017917 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:25:44.017917 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:25:44.017917 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:25:44.017917 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:25:44.017917 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:25:44.017917 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:25:44.017917 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:25:44.017917 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:25:44.017917 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:25:44.017917 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:25:44.019093 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:25:44.019093 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:25:44.019093 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:25:44.019093 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:25:44.019093 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:25:44.019093 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:25:44.019093 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:25:44.019093 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:25:44.019093 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:25:44.019093 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:25:44.019093 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:25:44.019093 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 01 15:25:44.019093 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:25:44.019093 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:25:44.019093 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:25:44.019093 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:25:44.019934 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:25:44.019934 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:25:44.019934 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:25:44.019934 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:25:44.019934 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:25:44.019934 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:25:44.019934 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:25:44.019934 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:25:44.019934 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:25:44.019934 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:25:44.019934 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 01 15:25:44.019934 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 01 15:25:44.022490 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 352/713] 10.222.0.102 () {56 vars in 1107 bytes} [Mon Aug 1 15:25:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:25:44.028163 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aca4356-b445-4b08-abfc-f634f22c9d01 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:44.028163 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aca4356-b445-4b08-abfc-f634f22c9d01 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:44.028163 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aca4356-b445-4b08-abfc-f634f22c9d01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:44.048187 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-2aca4356-b445-4b08-abfc-f634f22c9d01 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:25:44.049463 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-2aca4356-b445-4b08-abfc-f634f22c9d01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:25:44.052017 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:44.067686 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7505ceda-40c7-452d-88ca-c8cd892aea61 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:44.116419 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60387236-cb00-4f2e-a83a-21d53e29571a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:44.117627 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60387236-cb00-4f2e-a83a-21d53e29571a None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:44.118517 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60387236-cb00-4f2e-a83a-21d53e29571a None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:44.119086 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60387236-cb00-4f2e-a83a-21d53e29571a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:44.133955 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60387236-cb00-4f2e-a83a-21d53e29571a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:44.136444 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60387236-cb00-4f2e-a83a-21d53e29571a None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:44.139035 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 353/714] 10.222.0.102 () {58 vars in 1028 bytes} [Mon Aug 1 15:25:44 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 15:25:44.140039 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aca4356-b445-4b08-abfc-f634f22c9d01 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:44.157348 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-60387236-cb00-4f2e-a83a-21d53e29571a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:25:44.157348 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:25:44.157348 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:25:44.157348 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:25:44.157348 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:25:44.157348 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:25:44.157348 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:25:44.157348 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:25:44.157348 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:25:44.157348 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:25:44.157348 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:25:44.157348 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:25:44.157348 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:25:44.157348 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:25:44.157348 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:25:44.158544 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:25:44.158544 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:25:44.158544 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:25:44.158544 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:25:44.158544 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:25:44.158544 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:25:44.158544 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:25:44.158544 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:25:44.158544 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 01 15:25:44.158544 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:25:44.158544 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:25:44.158544 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:25:44.158544 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:25:44.158544 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:25:44.158544 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:25:44.158544 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:25:44.158544 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:25:44.159639 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:25:44.159639 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:25:44.159639 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:25:44.159639 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 01 15:25:44.161988 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 362/715] 10.222.0.102 () {56 vars in 1113 bytes} [Mon Aug 1 15:25:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:25:44.168958 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60387236-cb00-4f2e-a83a-21d53e29571a None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:44.227932 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:44.279848 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aca4356-b445-4b08-abfc-f634f22c9d01 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:44.286856 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60387236-cb00-4f2e-a83a-21d53e29571a None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:44.314696 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969f3018-0335-417c-a8a9-661616884507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:44.315533 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969f3018-0335-417c-a8a9-661616884507 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:44.315839 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969f3018-0335-417c-a8a9-661616884507 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:44.316203 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969f3018-0335-417c-a8a9-661616884507 None admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:44.317053 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969f3018-0335-417c-a8a9-661616884507 None admin] RBAC: Adding query filter params (name=service) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:25:44.317448 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969f3018-0335-417c-a8a9-661616884507 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:44.318994 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969f3018-0335-417c-a8a9-661616884507 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:44.327221 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:44.336796 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 354/716] 10.222.0.102 () {56 vars in 1108 bytes} [Mon Aug 1 15:25:44 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:44.336796 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969f3018-0335-417c-a8a9-661616884507 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:44.337440 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7888bf70-fefd-48fb-8939-eeed07fbc2d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:44.338105 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7888bf70-fefd-48fb-8939-eeed07fbc2d4 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:44.338386 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7888bf70-fefd-48fb-8939-eeed07fbc2d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:44.338655 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7888bf70-fefd-48fb-8939-eeed07fbc2d4 None admin] PATH_INFO: `/v3/domains` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:44.339348 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7888bf70-fefd-48fb-8939-eeed07fbc2d4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:25:44.339668 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7888bf70-fefd-48fb-8939-eeed07fbc2d4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:44.341073 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7888bf70-fefd-48fb-8939-eeed07fbc2d4 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:44.358571 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 363/717] 10.222.0.102 () {56 vars in 1114 bytes} [Mon Aug 1 15:25:44 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:25:44.359949 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7888bf70-fefd-48fb-8939-eeed07fbc2d4 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:44.472638 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969f3018-0335-417c-a8a9-661616884507 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:44.488092 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7888bf70-fefd-48fb-8939-eeed07fbc2d4 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:44.506833 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:44.508232 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee78d83a-70b2-4eaf-bfd4-b26599ee78d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:44.509044 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee78d83a-70b2-4eaf-bfd4-b26599ee78d3 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:44.509432 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee78d83a-70b2-4eaf-bfd4-b26599ee78d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:44.509771 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee78d83a-70b2-4eaf-bfd4-b26599ee78d3 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:44.510469 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee78d83a-70b2-4eaf-bfd4-b26599ee78d3 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:44.511904 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee78d83a-70b2-4eaf-bfd4-b26599ee78d3 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:44.526564 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-ee78d83a-70b2-4eaf-bfd4-b26599ee78d3 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 01 15:25:44.526564 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:25:44.526564 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 01 15:25:44.526564 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 01 15:25:44.526564 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 01 15:25:44.526564 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 01 15:25:44.526564 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 01 15:25:44.526564 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 15:25:44.526564 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 01 15:25:44.526564 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 01 15:25:44.526564 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 15:25:44.526564 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 01 15:25:44.526564 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:25:44.526564 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:25:44.526564 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:25:44.526564 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:25:44.527575 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:25:44.527575 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:25:44.527575 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:25:44.527575 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:25:44.527575 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:25:44.527575 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:25:44.527575 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:25:44.527575 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 01 15:25:44.527575 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 01 15:25:44.527575 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 01 15:25:44.527575 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 01 15:25:44.527575 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:25:44.527575 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:25:44.527575 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:25:44.527575 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:25:44.527575 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:25:44.528427 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:25:44.528427 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:25:44.528427 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 01 15:25:44.528427 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:25:44.528427 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:25:44.528427 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:25:44.528427 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:25:44.528427 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:25:44.528427 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:25:44.528427 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:25:44.528427 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:25:44.528427 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 01 15:25:44.528427 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 15:25:44.528427 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 01 15:25:44.528427 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 01 15:25:44.533157 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 355/718] 10.222.0.102 () {56 vars in 1134 bytes} [Mon Aug 1 15:25:44 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:25:44.533873 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee78d83a-70b2-4eaf-bfd4-b26599ee78d3 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:44.539409 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6cf219-85a8-4c8e-978f-a91b809eec90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:44.540391 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6cf219-85a8-4c8e-978f-a91b809eec90 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:44.540923 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6cf219-85a8-4c8e-978f-a91b809eec90 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:44.541392 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6cf219-85a8-4c8e-978f-a91b809eec90 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:44.558051 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6cf219-85a8-4c8e-978f-a91b809eec90 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:44.560505 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6cf219-85a8-4c8e-978f-a91b809eec90 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:44.584712 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-8f6cf219-85a8-4c8e-978f-a91b809eec90 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:25:44.584712 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:25:44.584712 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:25:44.584712 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:25:44.584712 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:25:44.584712 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:25:44.584712 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:25:44.584712 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:25:44.584712 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:25:44.584712 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:25:44.584712 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:25:44.584712 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:25:44.584712 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:25:44.584712 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:25:44.584712 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:25:44.586266 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:25:44.586266 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:25:44.586266 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:25:44.586266 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:25:44.586266 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:25:44.586266 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:25:44.586266 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:25:44.586266 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:25:44.586266 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 01 15:25:44.586266 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:25:44.586266 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:25:44.586266 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:25:44.586266 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:25:44.586266 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:25:44.586266 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:25:44.586266 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:25:44.586266 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:25:44.587173 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:25:44.587173 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:25:44.587173 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:25:44.587173 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 01 15:25:44.594364 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 364/719] 10.222.0.102 () {56 vars in 1113 bytes} [Mon Aug 1 15:25:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:25:44.594364 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6cf219-85a8-4c8e-978f-a91b809eec90 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:44.616650 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:44.662562 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee78d83a-70b2-4eaf-bfd4-b26599ee78d3 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:44.700203 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66edbe7-c194-4065-9e26-ac5b7ae8541e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:44.700865 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66edbe7-c194-4065-9e26-ac5b7ae8541e None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:44.701165 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66edbe7-c194-4065-9e26-ac5b7ae8541e None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:44.701789 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66edbe7-c194-4065-9e26-ac5b7ae8541e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:44.709207 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66edbe7-c194-4065-9e26-ac5b7ae8541e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:44.710743 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66edbe7-c194-4065-9e26-ac5b7ae8541e None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:44.721980 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6cf219-85a8-4c8e-978f-a91b809eec90 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:44.723314 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-b66edbe7-c194-4065-9e26-ac5b7ae8541e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 15:25:44.723314 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:25:44.723314 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:25:44.723314 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:25:44.723314 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:25:44.723314 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:25:44.723314 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:25:44.723314 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:25:44.723314 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:25:44.723314 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:25:44.723314 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:25:44.723314 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:25:44.723314 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 15:25:44.723314 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 15:25:44.723314 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 15:25:44.724225 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 15:25:44.724225 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:25:44.724225 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:25:44.724225 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:25:44.724225 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:25:44.724225 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:25:44.724225 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:25:44.724225 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:25:44.724225 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 01 15:25:44.724225 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:25:44.724225 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:25:44.724225 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:25:44.724225 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:25:44.724225 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:25:44.724225 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:25:44.724225 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:25:44.724225 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:25:44.725193 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 15:25:44.725193 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 15:25:44.725193 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 15:25:44.725193 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 15:25:44.725193 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 15:25:44.725193 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 15:25:44.725193 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 15:25:44.725193 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 01 15:25:44.729410 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 356/720] 10.222.0.102 () {56 vars in 1116 bytes} [Mon Aug 1 15:25:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:25:44.730296 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66edbe7-c194-4065-9e26-ac5b7ae8541e None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:44.769328 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699e3172-9788-42b5-a731-402cb092e66d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:44.770270 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699e3172-9788-42b5-a731-402cb092e66d None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:44.770749 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699e3172-9788-42b5-a731-402cb092e66d None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:44.771263 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699e3172-9788-42b5-a731-402cb092e66d None admin] PATH_INFO: `/v3/services` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:44.772558 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699e3172-9788-42b5-a731-402cb092e66d None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:25:44.773641 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699e3172-9788-42b5-a731-402cb092e66d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:44.775596 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699e3172-9788-42b5-a731-402cb092e66d None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:44.781714 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 365/721] 10.222.0.102 () {56 vars in 1129 bytes} [Mon Aug 1 15:25:44 2022] GET /identity/v3/services?name=block-storage => generated 131 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:44.782710 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699e3172-9788-42b5-a731-402cb092e66d None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:44.819065 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:44.842697 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66edbe7-c194-4065-9e26-ac5b7ae8541e None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:44.870559 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:44.881625 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd628c05-5507-4209-900b-0ef06e1344b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:44.882588 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd628c05-5507-4209-900b-0ef06e1344b8 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:44.883076 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd628c05-5507-4209-900b-0ef06e1344b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:44.883573 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd628c05-5507-4209-900b-0ef06e1344b8 None admin] PATH_INFO: `/v3/domains` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:44.884997 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd628c05-5507-4209-900b-0ef06e1344b8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:25:44.885507 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd628c05-5507-4209-900b-0ef06e1344b8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:44.887109 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd628c05-5507-4209-900b-0ef06e1344b8 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:44.908417 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 357/722] 10.222.0.102 () {56 vars in 1114 bytes} [Mon Aug 1 15:25:44 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:44.909624 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd628c05-5507-4209-900b-0ef06e1344b8 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:44.917123 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699e3172-9788-42b5-a731-402cb092e66d None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:44.964336 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb59573-ece8-4b09-b989-b1490bdb90ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:44.965465 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb59573-ece8-4b09-b989-b1490bdb90ce None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:44.965749 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb59573-ece8-4b09-b989-b1490bdb90ce None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:44.966022 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb59573-ece8-4b09-b989-b1490bdb90ce None admin] PATH_INFO: `/v3/projects` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:44.967039 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb59573-ece8-4b09-b989-b1490bdb90ce None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:25:44.967352 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb59573-ece8-4b09-b989-b1490bdb90ce None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:44.969079 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb59573-ece8-4b09-b989-b1490bdb90ce None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:44.983074 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 366/723] 10.222.0.102 () {56 vars in 1153 bytes} [Mon Aug 1 15:25:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:44.984249 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb59573-ece8-4b09-b989-b1490bdb90ce None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:45.040814 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd628c05-5507-4209-900b-0ef06e1344b8 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:45.089340 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0892f44-a5b8-46fa-8e37-fbb21491888e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:45.089977 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0892f44-a5b8-46fa-8e37-fbb21491888e None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:45.090259 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0892f44-a5b8-46fa-8e37-fbb21491888e None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:45.090528 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0892f44-a5b8-46fa-8e37-fbb21491888e None admin] PATH_INFO: `/v3/services` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:45.091211 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0892f44-a5b8-46fa-8e37-fbb21491888e None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:25:45.091512 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0892f44-a5b8-46fa-8e37-fbb21491888e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:45.092922 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0892f44-a5b8-46fa-8e37-fbb21491888e None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:45.093863 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:45.106875 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 358/724] 10.222.0.102 () {56 vars in 1129 bytes} [Mon Aug 1 15:25:44 2022] GET /identity/v3/services?type=block-storage => generated 131 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:45.107434 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb59573-ece8-4b09-b989-b1490bdb90ce None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:45.107864 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0892f44-a5b8-46fa-8e37-fbb21491888e None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:45.146451 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3a0fe0-bf2d-417d-aac6-e7b5fb243c76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:45.147563 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3a0fe0-bf2d-417d-aac6-e7b5fb243c76 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:45.148666 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3a0fe0-bf2d-417d-aac6-e7b5fb243c76 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:45.149162 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3a0fe0-bf2d-417d-aac6-e7b5fb243c76 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:45.158757 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3a0fe0-bf2d-417d-aac6-e7b5fb243c76 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:45.160779 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3a0fe0-bf2d-417d-aac6-e7b5fb243c76 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:45.174196 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-6e3a0fe0-bf2d-417d-aac6-e7b5fb243c76 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 01 15:25:45.174196 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:25:45.174196 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:25:45.174196 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:25:45.174196 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:25:45.174196 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:25:45.174196 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:25:45.174196 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:25:45.174196 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:25:45.174196 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:25:45.174196 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:25:45.174196 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:25:45.174196 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 15:25:45.174196 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 15:25:45.174196 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 15:25:45.174196 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 15:25:45.175260 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:25:45.175260 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:25:45.175260 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 15:25:45.175260 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 15:25:45.175260 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 15:25:45.175260 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 15:25:45.175260 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:25:45.175260 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:25:45.175260 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:25:45.175260 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:25:45.175260 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:25:45.175260 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 01 15:25:45.175260 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:25:45.175260 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:25:45.175260 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:25:45.175260 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:25:45.175260 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:25:45.175260 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:25:45.176194 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:25:45.176194 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:25:45.176194 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 15:25:45.176194 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 15:25:45.176194 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 15:25:45.176194 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 15:25:45.176194 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 15:25:45.176194 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 15:25:45.176194 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 01 15:25:45.176194 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 01 15:25:45.179097 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 367/725] 10.222.0.102 () {56 vars in 1122 bytes} [Mon Aug 1 15:25:44 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:25:45.185098 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3a0fe0-bf2d-417d-aac6-e7b5fb243c76 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:45.205930 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:45.296161 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3a0fe0-bf2d-417d-aac6-e7b5fb243c76 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:45.299811 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0892f44-a5b8-46fa-8e37-fbb21491888e None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:45.333891 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c9156d-fd0e-4455-9a3b-84352eafaf2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:45.334893 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c9156d-fd0e-4455-9a3b-84352eafaf2e None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:45.335435 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c9156d-fd0e-4455-9a3b-84352eafaf2e None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:45.336555 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c9156d-fd0e-4455-9a3b-84352eafaf2e None admin] PATH_INFO: `/v3/users` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:45.337640 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c9156d-fd0e-4455-9a3b-84352eafaf2e None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:25:45.338146 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c9156d-fd0e-4455-9a3b-84352eafaf2e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:45.339818 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c9156d-fd0e-4455-9a3b-84352eafaf2e None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:45.365157 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 368/726] 10.222.0.102 () {56 vars in 1154 bytes} [Mon Aug 1 15:25:45 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 386 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:25:45.367859 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c9156d-fd0e-4455-9a3b-84352eafaf2e None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:45.370543 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07dfa10-779d-4310-8981-da09f76b6354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:45.371186 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07dfa10-779d-4310-8981-da09f76b6354 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:45.371815 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07dfa10-779d-4310-8981-da09f76b6354 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:45.371994 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07dfa10-779d-4310-8981-da09f76b6354 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:45.372766 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07dfa10-779d-4310-8981-da09f76b6354 None admin] RBAC: Adding query filter params (role.id=de1374f966c04c27b579515b54334fd2, scope.project.id=2eb32fbe631843d8be84d41f8ba88d6e, user.id=77b43f1ee8cc4be3907a494abe90c1cc) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:25:45.373140 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07dfa10-779d-4310-8981-da09f76b6354 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:45.374670 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07dfa10-779d-4310-8981-da09f76b6354 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:45.386544 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:45.388552 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 359/727] 10.222.0.102 () {56 vars in 1379 bytes} [Mon Aug 1 15:25:45 2022] GET /identity/v3/role_assignments?user.id=77b43f1ee8cc4be3907a494abe90c1cc&scope.project.id=2eb32fbe631843d8be84d41f8ba88d6e&role.id=de1374f966c04c27b579515b54334fd2 => generated 260 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:45.488633 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c9156d-fd0e-4455-9a3b-84352eafaf2e None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:45.528777 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a40caea-dbd6-4512-a492-84a77590c458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:45.529838 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a40caea-dbd6-4512-a492-84a77590c458 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:45.530383 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a40caea-dbd6-4512-a492-84a77590c458 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:45.530858 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a40caea-dbd6-4512-a492-84a77590c458 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:45.535843 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fedd60b-be6b-477c-a9fd-a714efeab175 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:45.535843 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fedd60b-be6b-477c-a9fd-a714efeab175 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:45.536110 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fedd60b-be6b-477c-a9fd-a714efeab175 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:45.537665 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 360/728] 10.222.0.102 () {54 vars in 931 bytes} [Mon Aug 1 15:25:45 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 01 15:25:45.544753 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7ae52a-19a1-414d-a895-6002cfee545a None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:45.545094 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7ae52a-19a1-414d-a895-6002cfee545a None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:45.545354 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7ae52a-19a1-414d-a895-6002cfee545a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:45.565994 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-ae7ae52a-19a1-414d-a895-6002cfee545a None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:25:45.567058 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-ae7ae52a-19a1-414d-a895-6002cfee545a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:25:45.611085 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a40caea-dbd6-4512-a492-84a77590c458 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:45.612551 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a40caea-dbd6-4512-a492-84a77590c458 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:45.623154 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:45.656717 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 361/729] 10.222.0.102 () {58 vars in 1028 bytes} [Mon Aug 1 15:25:45 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 01 15:25:45.693648 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7ae52a-19a1-414d-a895-6002cfee545a None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:45.782492 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:45.806376 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 369/730] 10.222.0.102 () {58 vars in 1287 bytes} [Mon Aug 1 15:25:45 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 15:25:45.813682 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a40caea-dbd6-4512-a492-84a77590c458 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:45.869652 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7ae52a-19a1-414d-a895-6002cfee545a None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:45.935142 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f391ef-50e1-4e5a-beec-18b772e011d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:45.940786 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f391ef-50e1-4e5a-beec-18b772e011d3 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:45.941113 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f391ef-50e1-4e5a-beec-18b772e011d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:45.941388 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f391ef-50e1-4e5a-beec-18b772e011d3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:45.958047 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f391ef-50e1-4e5a-beec-18b772e011d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:25:45.963329 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-c2f391ef-50e1-4e5a-beec-18b772e011d3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 15:25:45.963329 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:25:45.963329 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:25:45.963329 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:25:45.963329 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:25:45.963329 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:25:45.963329 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:25:45.963329 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:25:45.963329 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:25:45.963329 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:25:45.963329 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:25:45.963329 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:25:45.963329 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:25:45.963329 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:25:45.963329 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:25:45.963329 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:25:45.964259 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:25:45.964259 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:25:45.964259 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:25:45.964259 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:25:45.964259 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:25:45.964259 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:25:45.964259 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:25:45.964259 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:25:45.964259 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:25:45.964259 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:25:45.964259 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:25:45.964259 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 01 15:25:45.964259 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:25:45.964259 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:25:45.964259 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:25:45.964259 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:25:45.965143 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:25:45.965143 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:25:45.965143 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:25:45.965143 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:25:45.965143 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:25:45.965143 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:25:45.965143 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:25:45.965143 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:25:45.965143 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:25:45.965143 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:25:45.965143 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 15:25:45.965143 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 01 15:25:45.968012 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 362/731] 10.222.0.102 () {56 vars in 1101 bytes} [Mon Aug 1 15:25:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:25:45.971056 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7826d390-a2dd-42d4-af52-6c90fbf1724e None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:45.971389 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7826d390-a2dd-42d4-af52-6c90fbf1724e None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:45.971744 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7826d390-a2dd-42d4-af52-6c90fbf1724e None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:45.973797 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 363/732] 10.222.0.102 () {54 vars in 931 bytes} [Mon Aug 1 15:25:45 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 15:25:45.974768 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7826d390-a2dd-42d4-af52-6c90fbf1724e None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:45.985663 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a40caea-dbd6-4512-a492-84a77590c458 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:45.996938 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:46.025211 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c4cb5e-0670-496c-8c98-2256f6500c66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:46.026296 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c4cb5e-0670-496c-8c98-2256f6500c66 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:46.026921 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c4cb5e-0670-496c-8c98-2256f6500c66 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:46.027422 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c4cb5e-0670-496c-8c98-2256f6500c66 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:46.039645 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c4cb5e-0670-496c-8c98-2256f6500c66 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:46.041554 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c4cb5e-0670-496c-8c98-2256f6500c66 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:46.058059 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-a2c4cb5e-0670-496c-8c98-2256f6500c66 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:25:46.058059 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:25:46.058059 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:25:46.058059 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:25:46.058059 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:25:46.058059 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:25:46.058059 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:25:46.058059 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:25:46.058059 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:25:46.058059 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:25:46.058059 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:25:46.058059 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:25:46.058059 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:25:46.058059 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:25:46.058059 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:25:46.059082 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:25:46.059082 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:25:46.059082 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:25:46.059082 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:25:46.059082 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:25:46.059082 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:25:46.059082 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:25:46.059082 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:25:46.059082 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 01 15:25:46.059082 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:25:46.059082 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:25:46.059082 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:25:46.059082 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:25:46.059082 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:25:46.059082 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:25:46.059082 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:25:46.059082 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:25:46.059970 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:25:46.059970 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:25:46.059970 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:25:46.059970 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 01 15:25:46.062455 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 370/733] 10.222.0.102 () {56 vars in 1113 bytes} [Mon Aug 1 15:25:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 15:25:46.068574 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278e8e53-c7ca-4fed-9a8b-153dce3ecbac None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:46.069108 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278e8e53-c7ca-4fed-9a8b-153dce3ecbac None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:46.069651 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278e8e53-c7ca-4fed-9a8b-153dce3ecbac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:46.086925 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7826d390-a2dd-42d4-af52-6c90fbf1724e None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:46.088491 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:46.094020 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-278e8e53-c7ca-4fed-9a8b-153dce3ecbac None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:25:46.095745 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-278e8e53-c7ca-4fed-9a8b-153dce3ecbac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:25:46.124098 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106dc5d5-07e2-482a-9e56-206168db3c8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:46.125362 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106dc5d5-07e2-482a-9e56-206168db3c8a None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:46.126062 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106dc5d5-07e2-482a-9e56-206168db3c8a None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:46.126887 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106dc5d5-07e2-482a-9e56-206168db3c8a None admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:46.128189 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106dc5d5-07e2-482a-9e56-206168db3c8a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:25:46.128938 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106dc5d5-07e2-482a-9e56-206168db3c8a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:46.131124 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106dc5d5-07e2-482a-9e56-206168db3c8a None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:46.142813 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 364/734] 10.222.0.102 () {56 vars in 1104 bytes} [Mon Aug 1 15:25:45 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:46.144246 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106dc5d5-07e2-482a-9e56-206168db3c8a None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:46.176944 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 371/735] 10.222.0.102 () {58 vars in 1028 bytes} [Mon Aug 1 15:25:46 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 15:25:46.178183 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278e8e53-c7ca-4fed-9a8b-153dce3ecbac None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:46.276457 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106dc5d5-07e2-482a-9e56-206168db3c8a None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:46.297231 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278e8e53-c7ca-4fed-9a8b-153dce3ecbac None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:46.309309 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:46.312324 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194316fa-4fcc-4bcb-926f-47be45fc5772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:46.313036 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194316fa-4fcc-4bcb-926f-47be45fc5772 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:46.313321 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194316fa-4fcc-4bcb-926f-47be45fc5772 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:46.313591 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194316fa-4fcc-4bcb-926f-47be45fc5772 None admin] PATH_INFO: `/v3/domains` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:46.314289 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194316fa-4fcc-4bcb-926f-47be45fc5772 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:25:46.314592 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194316fa-4fcc-4bcb-926f-47be45fc5772 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:46.316209 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194316fa-4fcc-4bcb-926f-47be45fc5772 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:46.333108 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 365/736] 10.222.0.102 () {56 vars in 1114 bytes} [Mon Aug 1 15:25:46 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:46.333108 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194316fa-4fcc-4bcb-926f-47be45fc5772 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:46.347587 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fc76c6-5189-4409-a2a1-9b903af36647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:46.348231 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fc76c6-5189-4409-a2a1-9b903af36647 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:46.348509 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fc76c6-5189-4409-a2a1-9b903af36647 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:46.348783 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fc76c6-5189-4409-a2a1-9b903af36647 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:46.360873 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fc76c6-5189-4409-a2a1-9b903af36647 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:46.362456 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fc76c6-5189-4409-a2a1-9b903af36647 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:46.363137 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:46.380353 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-f7fc76c6-5189-4409-a2a1-9b903af36647 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:25:46.380353 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:25:46.380353 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:25:46.380353 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:25:46.380353 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:25:46.380353 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:25:46.380353 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:25:46.380353 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:25:46.380353 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:25:46.380353 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:25:46.380353 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:25:46.380353 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:25:46.380353 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:25:46.380353 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:25:46.380353 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:25:46.381456 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:25:46.381456 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:25:46.381456 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:25:46.381456 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:25:46.381456 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:25:46.381456 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:25:46.381456 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:25:46.381456 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:25:46.381456 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 01 15:25:46.381456 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:25:46.381456 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:25:46.381456 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:25:46.381456 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:25:46.381456 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:25:46.381456 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:25:46.381456 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:25:46.381456 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:25:46.382346 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:25:46.382346 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:25:46.382346 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:25:46.382346 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 01 15:25:46.384591 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 372/737] 10.222.0.102 () {56 vars in 1113 bytes} [Mon Aug 1 15:25:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:25:46.385615 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fc76c6-5189-4409-a2a1-9b903af36647 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:46.462060 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194316fa-4fcc-4bcb-926f-47be45fc5772 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:46.500459 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fc76c6-5189-4409-a2a1-9b903af36647 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:46.508049 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f404d3f9-c627-4d60-b15c-ace8b53bd21c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:46.508677 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f404d3f9-c627-4d60-b15c-ace8b53bd21c None admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:46.508987 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f404d3f9-c627-4d60-b15c-ace8b53bd21c None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:46.509260 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f404d3f9-c627-4d60-b15c-ace8b53bd21c None admin] PATH_INFO: `/v3/services` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:46.510449 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f404d3f9-c627-4d60-b15c-ace8b53bd21c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:46.511837 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f404d3f9-c627-4d60-b15c-ace8b53bd21c None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:46.540634 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90712f54-25a9-4ff5-904a-39d926844895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:46.541687 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90712f54-25a9-4ff5-904a-39d926844895 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:46.542224 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90712f54-25a9-4ff5-904a-39d926844895 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:46.542700 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90712f54-25a9-4ff5-904a-39d926844895 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:46.550086 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90712f54-25a9-4ff5-904a-39d926844895 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:46.551766 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90712f54-25a9-4ff5-904a-39d926844895 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:46.555034 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:46.564566 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-90712f54-25a9-4ff5-904a-39d926844895 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 15:25:46.564566 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:25:46.564566 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:25:46.564566 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:25:46.564566 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:25:46.564566 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:25:46.564566 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:25:46.564566 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:25:46.564566 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:25:46.564566 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:25:46.564566 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:25:46.564566 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:25:46.564566 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 15:25:46.564566 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 15:25:46.564566 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 15:25:46.565537 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 15:25:46.565537 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:25:46.565537 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:25:46.565537 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:25:46.565537 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:25:46.565537 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:25:46.565537 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:25:46.565537 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:25:46.565537 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 01 15:25:46.565537 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:25:46.565537 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:25:46.565537 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:25:46.565537 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:25:46.565537 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:25:46.565537 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:25:46.565537 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:25:46.565537 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:25:46.566468 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 15:25:46.566468 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 15:25:46.566468 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 15:25:46.566468 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 15:25:46.566468 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 15:25:46.566468 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 15:25:46.566468 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 15:25:46.566468 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 01 15:25:46.566468 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 373/738] 10.222.0.102 () {56 vars in 1116 bytes} [Mon Aug 1 15:25:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:25:46.566951 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90712f54-25a9-4ff5-904a-39d926844895 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:46.628926 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 366/739] 10.222.0.102 () {60 vars in 1146 bytes} [Mon Aug 1 15:25:46 2022] POST /identity/v3/services => generated 241 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:25:46.628926 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f404d3f9-c627-4d60-b15c-ace8b53bd21c None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:46.701868 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90712f54-25a9-4ff5-904a-39d926844895 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:46.762108 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7e3c09-3e6c-4983-a83a-79e5b7d90cf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:46.763153 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7e3c09-3e6c-4983-a83a-79e5b7d90cf3 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:46.763863 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7e3c09-3e6c-4983-a83a-79e5b7d90cf3 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:46.764547 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7e3c09-3e6c-4983-a83a-79e5b7d90cf3 None admin] PATH_INFO: `/v3/domains` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:46.765743 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7e3c09-3e6c-4983-a83a-79e5b7d90cf3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:25:46.766332 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7e3c09-3e6c-4983-a83a-79e5b7d90cf3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:46.768689 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7e3c09-3e6c-4983-a83a-79e5b7d90cf3 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:46.781057 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:46.785276 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 374/740] 10.222.0.102 () {56 vars in 1114 bytes} [Mon Aug 1 15:25:46 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:46.799836 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7e3c09-3e6c-4983-a83a-79e5b7d90cf3 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:46.802786 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f404d3f9-c627-4d60-b15c-ace8b53bd21c None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:46.840607 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d924aa1-f61c-4dbe-a311-18ddabb62ebf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:46.841304 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d924aa1-f61c-4dbe-a311-18ddabb62ebf None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:46.841589 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d924aa1-f61c-4dbe-a311-18ddabb62ebf None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:46.841864 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d924aa1-f61c-4dbe-a311-18ddabb62ebf None admin] PATH_INFO: `/v3/projects` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:46.842631 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d924aa1-f61c-4dbe-a311-18ddabb62ebf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:25:46.842939 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d924aa1-f61c-4dbe-a311-18ddabb62ebf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:46.844389 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d924aa1-f61c-4dbe-a311-18ddabb62ebf None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:46.860049 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 367/741] 10.222.0.102 () {56 vars in 1153 bytes} [Mon Aug 1 15:25:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:46.865865 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d924aa1-f61c-4dbe-a311-18ddabb62ebf None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:46.889511 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:46.952015 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7e3c09-3e6c-4983-a83a-79e5b7d90cf3 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:46.996458 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d924aa1-f61c-4dbe-a311-18ddabb62ebf None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:46.997843 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331e5841-0405-4ba8-a01a-f6d6abddaf28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:46.999771 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331e5841-0405-4ba8-a01a-f6d6abddaf28 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:47.000272 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331e5841-0405-4ba8-a01a-f6d6abddaf28 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:47.000743 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331e5841-0405-4ba8-a01a-f6d6abddaf28 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:47.011300 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331e5841-0405-4ba8-a01a-f6d6abddaf28 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:47.013806 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331e5841-0405-4ba8-a01a-f6d6abddaf28 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:47.029964 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-331e5841-0405-4ba8-a01a-f6d6abddaf28 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 01 15:25:47.029964 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:25:47.029964 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:25:47.029964 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:25:47.029964 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:25:47.029964 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:25:47.029964 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:25:47.029964 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:25:47.029964 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:25:47.029964 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:25:47.029964 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:25:47.029964 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:25:47.029964 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 15:25:47.029964 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 15:25:47.029964 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 15:25:47.029964 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 15:25:47.030947 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:25:47.030947 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:25:47.030947 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 15:25:47.030947 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 15:25:47.030947 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 15:25:47.030947 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 15:25:47.030947 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:25:47.030947 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:25:47.030947 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:25:47.030947 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:25:47.030947 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:25:47.030947 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 01 15:25:47.030947 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:25:47.030947 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:25:47.030947 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:25:47.030947 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:25:47.030947 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:25:47.030947 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:25:47.031891 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:25:47.031891 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:25:47.031891 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 15:25:47.031891 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 15:25:47.031891 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 15:25:47.031891 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 15:25:47.031891 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 15:25:47.031891 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 15:25:47.031891 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 01 15:25:47.031891 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 01 15:25:47.034425 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 375/742] 10.222.0.102 () {56 vars in 1101 bytes} [Mon Aug 1 15:25:46 2022] GET /identity/v3/users/swift => generated 83 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:25:47.039528 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612d7123-dd6f-46af-b81d-f9f154e6885e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:47.040075 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612d7123-dd6f-46af-b81d-f9f154e6885e None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:47.040456 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612d7123-dd6f-46af-b81d-f9f154e6885e None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:47.040832 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612d7123-dd6f-46af-b81d-f9f154e6885e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:47.041109 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331e5841-0405-4ba8-a01a-f6d6abddaf28 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:47.041871 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612d7123-dd6f-46af-b81d-f9f154e6885e None admin] RBAC: Adding query filter params (role.id=3087c03acf8d44d9ae512385924c5d0d, scope.project.id=2eb32fbe631843d8be84d41f8ba88d6e, user.id=ae8514df55144c9086ed98ba44efbbd4) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:25:47.042338 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612d7123-dd6f-46af-b81d-f9f154e6885e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:47.043984 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612d7123-dd6f-46af-b81d-f9f154e6885e None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:47.057319 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 368/743] 10.222.0.102 () {56 vars in 1379 bytes} [Mon Aug 1 15:25:46 2022] GET /identity/v3/role_assignments?user.id=ae8514df55144c9086ed98ba44efbbd4&scope.project.id=2eb32fbe631843d8be84d41f8ba88d6e&role.id=3087c03acf8d44d9ae512385924c5d0d => generated 260 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:47.162899 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331e5841-0405-4ba8-a01a-f6d6abddaf28 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:47.182918 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:47.203590 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b943ff86-ef28-4315-abb7-b024461f12d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:47.204685 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b943ff86-ef28-4315-abb7-b024461f12d3 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:47.205142 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b943ff86-ef28-4315-abb7-b024461f12d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:47.205704 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b943ff86-ef28-4315-abb7-b024461f12d3 None admin] PATH_INFO: `/v3/users` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:47.206659 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b943ff86-ef28-4315-abb7-b024461f12d3 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:25:47.207129 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b943ff86-ef28-4315-abb7-b024461f12d3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:47.208754 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b943ff86-ef28-4315-abb7-b024461f12d3 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:47.229556 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 376/744] 10.222.0.102 () {56 vars in 1140 bytes} [Mon Aug 1 15:25:47 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 372 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:47.237032 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612d7123-dd6f-46af-b81d-f9f154e6885e None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:47.254926 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:47.359573 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612d7123-dd6f-46af-b81d-f9f154e6885e None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:47.402355 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf011f5-5aed-44c1-a7e3-c7e24ad20bd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:47.402985 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf011f5-5aed-44c1-a7e3-c7e24ad20bd6 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:47.403270 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf011f5-5aed-44c1-a7e3-c7e24ad20bd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:47.403546 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf011f5-5aed-44c1-a7e3-c7e24ad20bd6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:47.473947 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf011f5-5aed-44c1-a7e3-c7e24ad20bd6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:47.475340 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf011f5-5aed-44c1-a7e3-c7e24ad20bd6 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:47.487268 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:47.598918 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 369/745] 10.222.0.102 () {58 vars in 1287 bytes} [Mon Aug 1 15:25:47 2022] GET /identity/v3/auth/tokens => generated 899 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 15:25:47.605375 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b943ff86-ef28-4315-abb7-b024461f12d3 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:47.633024 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a038d5-f604-456e-af76-8ae59113ebad None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:47.633024 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a038d5-f604-456e-af76-8ae59113ebad None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:47.633024 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a038d5-f604-456e-af76-8ae59113ebad None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:47.633024 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 370/746] 10.222.0.102 () {54 vars in 931 bytes} [Mon Aug 1 15:25:47 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 15:25:47.636012 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2417ac0-ecb9-4a2f-892b-da6bd929fe94 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:47.636289 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2417ac0-ecb9-4a2f-892b-da6bd929fe94 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:47.636556 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2417ac0-ecb9-4a2f-892b-da6bd929fe94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:47.660799 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-a2417ac0-ecb9-4a2f-892b-da6bd929fe94 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:25:47.663088 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-a2417ac0-ecb9-4a2f-892b-da6bd929fe94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:25:47.752325 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 371/747] 10.222.0.102 () {58 vars in 1028 bytes} [Mon Aug 1 15:25:47 2022] POST /identity/v3/auth/tokens => generated 899 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 01 15:25:47.779489 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b943ff86-ef28-4315-abb7-b024461f12d3 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:47.789637 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2417ac0-ecb9-4a2f-892b-da6bd929fe94 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:47.826164 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f836b411-75c2-467d-90d2-a3fc43bd5078 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:47.827074 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f836b411-75c2-467d-90d2-a3fc43bd5078 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:47.827354 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f836b411-75c2-467d-90d2-a3fc43bd5078 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:47.827630 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f836b411-75c2-467d-90d2-a3fc43bd5078 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:47.854259 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f836b411-75c2-467d-90d2-a3fc43bd5078 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:47.857860 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f836b411-75c2-467d-90d2-a3fc43bd5078 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:47.876246 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:47.888342 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-f836b411-75c2-467d-90d2-a3fc43bd5078 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:25:47.888342 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:25:47.888342 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:25:47.888342 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:25:47.888342 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:25:47.888342 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:25:47.888342 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:25:47.888342 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:25:47.888342 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:25:47.888342 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:25:47.888342 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:25:47.888342 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:25:47.888342 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:25:47.888342 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:25:47.888342 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:25:47.889347 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:25:47.889347 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:25:47.889347 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:25:47.889347 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:25:47.889347 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:25:47.889347 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:25:47.889347 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:25:47.889347 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:25:47.889347 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 01 15:25:47.889347 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:25:47.889347 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:25:47.889347 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:25:47.889347 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:25:47.889347 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:25:47.889347 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:25:47.889347 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:25:47.889347 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:25:47.890262 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:25:47.890262 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:25:47.890262 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:25:47.890262 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 01 15:25:47.890262 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 377/748] 10.222.0.102 () {56 vars in 1113 bytes} [Mon Aug 1 15:25:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:25:47.899290 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f836b411-75c2-467d-90d2-a3fc43bd5078 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:47.960201 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:47.991279 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2417ac0-ecb9-4a2f-892b-da6bd929fe94 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:48.034203 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710f1fbc-dafb-4dda-bc2a-6966f08ad3a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:48.035124 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710f1fbc-dafb-4dda-bc2a-6966f08ad3a9 None admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:48.035405 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710f1fbc-dafb-4dda-bc2a-6966f08ad3a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:48.035939 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710f1fbc-dafb-4dda-bc2a-6966f08ad3a9 None admin] PATH_INFO: `/v3/services` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:48.036633 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710f1fbc-dafb-4dda-bc2a-6966f08ad3a9 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:48.038505 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710f1fbc-dafb-4dda-bc2a-6966f08ad3a9 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:48.053883 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f836b411-75c2-467d-90d2-a3fc43bd5078 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:48.090473 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40157e0-9e2f-4531-83cd-602fecc06a9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:48.091089 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40157e0-9e2f-4531-83cd-602fecc06a9f None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:48.091368 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40157e0-9e2f-4531-83cd-602fecc06a9f None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:48.091642 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40157e0-9e2f-4531-83cd-602fecc06a9f None admin] PATH_INFO: `/v3/domains` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:48.092327 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40157e0-9e2f-4531-83cd-602fecc06a9f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:25:48.092629 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40157e0-9e2f-4531-83cd-602fecc06a9f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:48.094041 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40157e0-9e2f-4531-83cd-602fecc06a9f None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:48.110380 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 378/749] 10.222.0.102 () {56 vars in 1114 bytes} [Mon Aug 1 15:25:47 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:48.111693 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4f2dec-7cce-4183-b27c-a658bb0dc112 None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:48.111982 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4f2dec-7cce-4183-b27c-a658bb0dc112 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:48.112319 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4f2dec-7cce-4183-b27c-a658bb0dc112 None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:48.113901 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 379/751] 10.222.0.102 () {54 vars in 931 bytes} [Mon Aug 1 15:25:48 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 15:25:48.121004 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4f2dec-7cce-4183-b27c-a658bb0dc112 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:48.121506 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 372/751] 10.222.0.102 () {60 vars in 1146 bytes} [Mon Aug 1 15:25:47 2022] POST /identity/v3/services => generated 252 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 15:25:48.141761 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe57d2a-9d9e-4ee7-a689-067705599d86 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:48.142099 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe57d2a-9d9e-4ee7-a689-067705599d86 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:48.142762 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe57d2a-9d9e-4ee7-a689-067705599d86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:48.186706 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-bbe57d2a-9d9e-4ee7-a689-067705599d86 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:25:48.187992 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-bbe57d2a-9d9e-4ee7-a689-067705599d86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:25:48.290807 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:48.316768 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 373/752] 10.222.0.102 () {58 vars in 1028 bytes} [Mon Aug 1 15:25:48 2022] POST /identity/v3/auth/tokens => generated 1003 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 01 15:25:48.325573 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4f2dec-7cce-4183-b27c-a658bb0dc112 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:48.361118 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe57d2a-9d9e-4ee7-a689-067705599d86 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:48.396204 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc37d02d-2903-4cc0-94fe-468f31d3e67c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:48.397168 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc37d02d-2903-4cc0-94fe-468f31d3e67c None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:48.397456 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc37d02d-2903-4cc0-94fe-468f31d3e67c None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:48.397792 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc37d02d-2903-4cc0-94fe-468f31d3e67c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:48.398318 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:48.407396 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc37d02d-2903-4cc0-94fe-468f31d3e67c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:48.409778 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc37d02d-2903-4cc0-94fe-468f31d3e67c None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:48.425352 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-bc37d02d-2903-4cc0-94fe-468f31d3e67c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 15:25:48.425352 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:25:48.425352 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:25:48.425352 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:25:48.425352 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:25:48.425352 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:25:48.425352 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:25:48.425352 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:25:48.425352 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:25:48.425352 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:25:48.425352 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:25:48.425352 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:25:48.425352 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 15:25:48.425352 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 15:25:48.425352 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 15:25:48.426308 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 15:25:48.426308 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:25:48.426308 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:25:48.426308 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:25:48.426308 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:25:48.426308 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:25:48.426308 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:25:48.426308 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:25:48.426308 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 01 15:25:48.426308 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:25:48.426308 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:25:48.426308 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:25:48.426308 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:25:48.426308 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:25:48.426308 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:25:48.426308 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:25:48.426308 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:25:48.427199 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 15:25:48.427199 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 15:25:48.427199 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 15:25:48.427199 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 15:25:48.427199 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 15:25:48.427199 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 15:25:48.427199 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 15:25:48.427199 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 01 15:25:48.430330 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 380/753] 10.222.0.102 () {56 vars in 1116 bytes} [Mon Aug 1 15:25:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 15:25:48.434135 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc37d02d-2903-4cc0-94fe-468f31d3e67c None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:48.491115 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe57d2a-9d9e-4ee7-a689-067705599d86 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:48.543620 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6062392c-a614-4622-ad80-0415f58284cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:48.544305 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6062392c-a614-4622-ad80-0415f58284cc None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:48.544662 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6062392c-a614-4622-ad80-0415f58284cc None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:48.545023 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6062392c-a614-4622-ad80-0415f58284cc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:48.559661 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6062392c-a614-4622-ad80-0415f58284cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:25:48.565613 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-6062392c-a614-4622-ad80-0415f58284cc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 15:25:48.565613 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:25:48.565613 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:25:48.565613 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:25:48.565613 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:25:48.565613 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:25:48.565613 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:25:48.565613 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:25:48.565613 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:25:48.565613 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:25:48.565613 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:25:48.565613 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:25:48.565613 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:25:48.565613 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:25:48.565613 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:25:48.565613 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:25:48.566745 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:25:48.566745 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:25:48.566745 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:25:48.566745 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:25:48.566745 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:25:48.566745 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:25:48.566745 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:25:48.566745 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:25:48.566745 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:25:48.566745 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:25:48.566745 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:25:48.566745 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 01 15:25:48.566745 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:25:48.566745 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:25:48.566745 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:25:48.566745 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:25:48.567743 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:25:48.567743 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:25:48.567743 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:25:48.567743 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:25:48.567743 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:25:48.567743 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:25:48.567743 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:25:48.567743 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:25:48.567743 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:25:48.567743 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:25:48.567743 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 15:25:48.567743 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 01 15:25:48.568509 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 374/754] 10.222.0.102 () {56 vars in 1101 bytes} [Mon Aug 1 15:25:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 15:25:48.574800 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6062392c-a614-4622-ad80-0415f58284cc None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:48.604825 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc37d02d-2903-4cc0-94fe-468f31d3e67c None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:48.679931 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f27024-9953-4f34-a3f5-39479835df20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:48.680556 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f27024-9953-4f34-a3f5-39479835df20 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:48.680837 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f27024-9953-4f34-a3f5-39479835df20 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:48.681129 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f27024-9953-4f34-a3f5-39479835df20 None admin] PATH_INFO: `/v3/projects` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:48.684957 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f27024-9953-4f34-a3f5-39479835df20 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:25:48.685276 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f27024-9953-4f34-a3f5-39479835df20 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:48.686742 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f27024-9953-4f34-a3f5-39479835df20 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:48.709821 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 381/755] 10.222.0.102 () {56 vars in 1153 bytes} [Mon Aug 1 15:25:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:25:48.716546 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f27024-9953-4f34-a3f5-39479835df20 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:48.718620 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:48.732015 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:48.737701 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6062392c-a614-4622-ad80-0415f58284cc None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:48.833694 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10078c59-575d-49f5-9ed7-396b76f2c124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:48.834708 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10078c59-575d-49f5-9ed7-396b76f2c124 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:48.835192 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10078c59-575d-49f5-9ed7-396b76f2c124 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:48.836226 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10078c59-575d-49f5-9ed7-396b76f2c124 None admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:48.837192 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10078c59-575d-49f5-9ed7-396b76f2c124 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:25:48.837697 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10078c59-575d-49f5-9ed7-396b76f2c124 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:48.839301 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10078c59-575d-49f5-9ed7-396b76f2c124 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:48.858824 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f27024-9953-4f34-a3f5-39479835df20 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:48.861062 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 375/756] 10.222.0.102 () {56 vars in 1104 bytes} [Mon Aug 1 15:25:48 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:48.879657 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10078c59-575d-49f5-9ed7-396b76f2c124 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:48.908959 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e8f35b-52ac-44bb-99b9-18837980d2ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:48.908959 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e8f35b-52ac-44bb-99b9-18837980d2ab None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:48.908959 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e8f35b-52ac-44bb-99b9-18837980d2ab None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:48.908959 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e8f35b-52ac-44bb-99b9-18837980d2ab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:48.909378 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e8f35b-52ac-44bb-99b9-18837980d2ab None admin] RBAC: Adding query filter params (role.id=de1374f966c04c27b579515b54334fd2, scope.project.id=2eb32fbe631843d8be84d41f8ba88d6e, user.id=90673f47354f4403aa0e12e3658441c8) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:25:48.909378 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e8f35b-52ac-44bb-99b9-18837980d2ab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:48.909378 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e8f35b-52ac-44bb-99b9-18837980d2ab None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:48.915857 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 382/757] 10.222.0.102 () {56 vars in 1379 bytes} [Mon Aug 1 15:25:48 2022] GET /identity/v3/role_assignments?user.id=90673f47354f4403aa0e12e3658441c8&scope.project.id=2eb32fbe631843d8be84d41f8ba88d6e&role.id=de1374f966c04c27b579515b54334fd2 => generated 260 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:25:49.067024 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10078c59-575d-49f5-9ed7-396b76f2c124 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:49.114049 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37606406-2a56-4975-b27a-5ccc67770a8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:49.114624 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37606406-2a56-4975-b27a-5ccc67770a8d None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:49.114907 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37606406-2a56-4975-b27a-5ccc67770a8d None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:49.115183 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37606406-2a56-4975-b27a-5ccc67770a8d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:49.126888 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37606406-2a56-4975-b27a-5ccc67770a8d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:49.128343 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37606406-2a56-4975-b27a-5ccc67770a8d None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:49.135494 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:49.143652 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-37606406-2a56-4975-b27a-5ccc67770a8d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:25:49.143652 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:25:49.143652 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:25:49.143652 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:25:49.143652 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:25:49.143652 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:25:49.143652 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:25:49.143652 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:25:49.143652 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:25:49.143652 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:25:49.143652 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:25:49.143652 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:25:49.143652 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:25:49.143652 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:25:49.143652 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:25:49.144538 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:25:49.144538 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:25:49.144538 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:25:49.144538 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:25:49.144538 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:25:49.144538 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:25:49.144538 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:25:49.144538 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:25:49.144538 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 01 15:25:49.144538 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:25:49.144538 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:25:49.144538 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:25:49.144538 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:25:49.144538 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:25:49.144538 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:25:49.144538 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:25:49.144538 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:25:49.145585 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:25:49.145585 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:25:49.145585 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:25:49.145585 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 01 15:25:49.149076 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 376/758] 10.222.0.102 () {56 vars in 1113 bytes} [Mon Aug 1 15:25:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:25:49.153510 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e8f35b-52ac-44bb-99b9-18837980d2ab None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:49.228133 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:49.262977 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e8f35b-52ac-44bb-99b9-18837980d2ab None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:49.312018 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bf3704-4f89-417a-9591-229a1e30ca35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:49.312643 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bf3704-4f89-417a-9591-229a1e30ca35 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:49.312943 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bf3704-4f89-417a-9591-229a1e30ca35 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:49.313215 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bf3704-4f89-417a-9591-229a1e30ca35 None admin] PATH_INFO: `/v3/domains` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:49.314078 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bf3704-4f89-417a-9591-229a1e30ca35 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:25:49.314524 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bf3704-4f89-417a-9591-229a1e30ca35 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:49.316181 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bf3704-4f89-417a-9591-229a1e30ca35 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:49.336234 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 383/759] 10.222.0.102 () {56 vars in 1114 bytes} [Mon Aug 1 15:25:49 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:49.340824 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37606406-2a56-4975-b27a-5ccc67770a8d None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:49.354453 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2c8d0f-4c92-48fe-b302-805d1c67383d None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:49.354771 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2c8d0f-4c92-48fe-b302-805d1c67383d None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:49.355002 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2c8d0f-4c92-48fe-b302-805d1c67383d None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:49.356594 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 384/760] 10.222.0.102 () {54 vars in 931 bytes} [Mon Aug 1 15:25:49 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 15:25:49.361835 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd8131b-f870-4490-81b7-894d3461b025 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:49.362173 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd8131b-f870-4490-81b7-894d3461b025 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:49.362473 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd8131b-f870-4490-81b7-894d3461b025 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:49.397396 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-4bd8131b-f870-4490-81b7-894d3461b025 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:25:49.398547 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-4bd8131b-f870-4490-81b7-894d3461b025 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:25:49.488311 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 385/761] 10.222.0.102 () {58 vars in 1028 bytes} [Mon Aug 1 15:25:49 2022] POST /identity/v3/auth/tokens => generated 1003 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 01 15:25:49.489625 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae669c3-bfef-4c1b-8698-e7aa53bc0760 None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:49.489915 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae669c3-bfef-4c1b-8698-e7aa53bc0760 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:49.490192 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae669c3-bfef-4c1b-8698-e7aa53bc0760 None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:49.496096 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 386/762] 10.222.0.102 () {54 vars in 931 bytes} [Mon Aug 1 15:25:49 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 15:25:49.496255 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37606406-2a56-4975-b27a-5ccc67770a8d None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:49.497329 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca418ac0-81c1-437e-91d2-be35d757f56b None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:49.497617 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca418ac0-81c1-437e-91d2-be35d757f56b None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:49.497899 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca418ac0-81c1-437e-91d2-be35d757f56b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:49.534409 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a6721f-1ec6-433b-a924-c71a7c649169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:49.534760 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-ca418ac0-81c1-437e-91d2-be35d757f56b None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:25:49.535107 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a6721f-1ec6-433b-a924-c71a7c649169 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:49.535384 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a6721f-1ec6-433b-a924-c71a7c649169 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:49.535623 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-ca418ac0-81c1-437e-91d2-be35d757f56b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:25:49.535792 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a6721f-1ec6-433b-a924-c71a7c649169 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:49.546582 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a6721f-1ec6-433b-a924-c71a7c649169 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:49.548742 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a6721f-1ec6-433b-a924-c71a7c649169 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:49.565823 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-a6a6721f-1ec6-433b-a924-c71a7c649169 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 01 15:25:49.565823 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:25:49.565823 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:25:49.565823 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:25:49.565823 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:25:49.565823 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:25:49.565823 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:25:49.565823 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:25:49.565823 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:25:49.565823 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:25:49.565823 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:25:49.565823 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:25:49.565823 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 15:25:49.565823 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 15:25:49.565823 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 15:25:49.565823 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 15:25:49.567813 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:25:49.567813 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:25:49.567813 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 15:25:49.567813 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 15:25:49.567813 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 15:25:49.567813 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 15:25:49.567813 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:25:49.567813 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:25:49.567813 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:25:49.567813 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:25:49.567813 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:25:49.567813 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 01 15:25:49.567813 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:25:49.567813 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:25:49.567813 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:25:49.567813 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:25:49.567813 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:25:49.567813 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:25:49.569429 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:25:49.569429 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:25:49.569429 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 15:25:49.569429 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 15:25:49.569429 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 15:25:49.569429 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 15:25:49.569429 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 15:25:49.569429 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 15:25:49.569429 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 01 15:25:49.569429 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 01 15:25:49.569429 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 377/763] 10.222.0.102 () {56 vars in 1098 bytes} [Mon Aug 1 15:25:49 2022] GET /identity/v3/users/nova => generated 82 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:25:49.569429 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a6721f-1ec6-433b-a924-c71a7c649169 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:49.603233 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:49.629175 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 387/764] 10.222.0.102 () {58 vars in 1028 bytes} [Mon Aug 1 15:25:49 2022] POST /identity/v3/auth/tokens => generated 1003 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 01 15:25:49.630317 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca418ac0-81c1-437e-91d2-be35d757f56b None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:49.649809 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:49.706413 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a6721f-1ec6-433b-a924-c71a7c649169 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:49.754710 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64ae967-b0dc-40ca-9889-c2fe551da10e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:49.755652 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64ae967-b0dc-40ca-9889-c2fe551da10e None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:49.756075 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64ae967-b0dc-40ca-9889-c2fe551da10e None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:49.756438 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca418ac0-81c1-437e-91d2-be35d757f56b None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:49.756650 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64ae967-b0dc-40ca-9889-c2fe551da10e None admin] PATH_INFO: `/v3/services/network` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:49.757996 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64ae967-b0dc-40ca-9889-c2fe551da10e None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:49.760680 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64ae967-b0dc-40ca-9889-c2fe551da10e None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:49.772979 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-f64ae967-b0dc-40ca-9889-c2fe551da10e None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 01 15:25:49.772979 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:25:49.772979 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 01 15:25:49.772979 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 01 15:25:49.772979 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 01 15:25:49.772979 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 01 15:25:49.772979 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 01 15:25:49.772979 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 15:25:49.772979 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 01 15:25:49.772979 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 01 15:25:49.772979 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 15:25:49.772979 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 01 15:25:49.772979 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:25:49.772979 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:25:49.772979 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:25:49.772979 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:25:49.772979 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:25:49.774769 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:25:49.774769 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:25:49.774769 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:25:49.774769 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:25:49.774769 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:25:49.774769 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:25:49.774769 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 01 15:25:49.774769 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 01 15:25:49.774769 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 01 15:25:49.774769 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 01 15:25:49.774769 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:25:49.774769 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:25:49.774769 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:25:49.774769 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:25:49.774769 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:25:49.774769 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:25:49.775787 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:25:49.775787 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 01 15:25:49.775787 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:25:49.775787 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:25:49.775787 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:25:49.775787 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:25:49.775787 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:25:49.775787 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:25:49.775787 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:25:49.775787 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:25:49.775787 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 01 15:25:49.775787 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 15:25:49.775787 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 01 15:25:49.775787 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 01 15:25:49.778448 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 378/765] 10.222.0.102 () {56 vars in 1116 bytes} [Mon Aug 1 15:25:49 2022] GET /identity/v3/services/network => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:25:49.781098 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64ae967-b0dc-40ca-9889-c2fe551da10e None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:49.811057 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b819142a-d9eb-438b-8057-acc11f902708 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:49.812043 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b819142a-d9eb-438b-8057-acc11f902708 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:49.812409 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b819142a-d9eb-438b-8057-acc11f902708 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:49.812777 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b819142a-d9eb-438b-8057-acc11f902708 None admin] PATH_INFO: `/v3/users` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:49.814016 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b819142a-d9eb-438b-8057-acc11f902708 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:25:49.814463 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b819142a-d9eb-438b-8057-acc11f902708 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:49.816653 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b819142a-d9eb-438b-8057-acc11f902708 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:49.841867 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 388/766] 10.222.0.102 () {56 vars in 1138 bytes} [Mon Aug 1 15:25:49 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 370 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:49.843381 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b819142a-d9eb-438b-8057-acc11f902708 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:49.898377 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64ae967-b0dc-40ca-9889-c2fe551da10e None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:49.909848 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:49.925128 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:49.944680 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a05fa94-d65c-494f-bc03-f5a5dcbda933 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:49.949588 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a05fa94-d65c-494f-bc03-f5a5dcbda933 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:49.949880 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a05fa94-d65c-494f-bc03-f5a5dcbda933 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:49.950401 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a05fa94-d65c-494f-bc03-f5a5dcbda933 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:49.967232 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a05fa94-d65c-494f-bc03-f5a5dcbda933 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:25:49.973997 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b819142a-d9eb-438b-8057-acc11f902708 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:49.974322 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-2a05fa94-d65c-494f-bc03-f5a5dcbda933 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 01 15:25:49.974322 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:25:49.974322 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:25:49.974322 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:25:49.974322 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:25:49.974322 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:25:49.974322 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:25:49.974322 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:25:49.974322 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:25:49.974322 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:25:49.974322 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:25:49.974322 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:25:49.974322 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:25:49.974322 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:25:49.974322 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:25:49.974322 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:25:49.975250 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:25:49.975250 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:25:49.975250 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:25:49.975250 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:25:49.975250 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:25:49.975250 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:25:49.975250 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:25:49.975250 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:25:49.975250 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:25:49.975250 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:25:49.975250 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:25:49.975250 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 01 15:25:49.975250 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:25:49.975250 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:25:49.975250 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:25:49.975250 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:25:49.976176 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:25:49.976176 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:25:49.976176 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:25:49.976176 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:25:49.976176 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:25:49.976176 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:25:49.976176 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:25:49.976176 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:25:49.976176 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:25:49.976176 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:25:49.976176 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 01 15:25:49.976176 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 01 15:25:49.979601 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 379/767] 10.222.0.102 () {56 vars in 1107 bytes} [Mon Aug 1 15:25:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:25:49.980531 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a05fa94-d65c-494f-bc03-f5a5dcbda933 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:50.022452 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9688e67-a5ba-4ff4-99b5-11d20ed87199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:50.023618 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9688e67-a5ba-4ff4-99b5-11d20ed87199 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:50.024049 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9688e67-a5ba-4ff4-99b5-11d20ed87199 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:50.024469 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9688e67-a5ba-4ff4-99b5-11d20ed87199 None admin] PATH_INFO: `/v3/services` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:50.025318 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9688e67-a5ba-4ff4-99b5-11d20ed87199 None admin] RBAC: Adding query filter params (name=network) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:25:50.025766 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9688e67-a5ba-4ff4-99b5-11d20ed87199 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:50.028185 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9688e67-a5ba-4ff4-99b5-11d20ed87199 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:50.038399 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 389/768] 10.222.0.102 () {56 vars in 1117 bytes} [Mon Aug 1 15:25:49 2022] GET /identity/v3/services?name=network => generated 125 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:50.038399 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9688e67-a5ba-4ff4-99b5-11d20ed87199 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:50.104202 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a05fa94-d65c-494f-bc03-f5a5dcbda933 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:50.142032 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee391f9-2235-4f6a-a7fc-f5086d6ab1b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:50.142684 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee391f9-2235-4f6a-a7fc-f5086d6ab1b4 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:50.142967 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee391f9-2235-4f6a-a7fc-f5086d6ab1b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:50.143244 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee391f9-2235-4f6a-a7fc-f5086d6ab1b4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:50.155754 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee391f9-2235-4f6a-a7fc-f5086d6ab1b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:50.157418 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee391f9-2235-4f6a-a7fc-f5086d6ab1b4 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:50.172473 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9688e67-a5ba-4ff4-99b5-11d20ed87199 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:50.173668 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-7ee391f9-2235-4f6a-a7fc-f5086d6ab1b4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:25:50.173668 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:25:50.173668 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:25:50.173668 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:25:50.173668 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:25:50.173668 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:25:50.173668 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:25:50.173668 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:25:50.173668 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:25:50.173668 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:25:50.173668 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:25:50.173668 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:25:50.173668 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:25:50.173668 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:25:50.173668 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:25:50.174551 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:25:50.174551 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:25:50.174551 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:25:50.174551 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:25:50.174551 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:25:50.174551 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:25:50.174551 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:25:50.174551 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:25:50.174551 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 01 15:25:50.174551 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:25:50.174551 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:25:50.174551 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:25:50.174551 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:25:50.174551 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:25:50.174551 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:25:50.174551 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:25:50.174551 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:25:50.175467 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:25:50.175467 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:25:50.175467 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:25:50.175467 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 01 15:25:50.175467 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 380/769] 10.222.0.102 () {56 vars in 1113 bytes} [Mon Aug 1 15:25:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:25:50.176155 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee391f9-2235-4f6a-a7fc-f5086d6ab1b4 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:50.192025 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:50.216705 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:50.222680 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c3edbd-afd0-472d-a4bf-c6bde47b1464 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:50.223924 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c3edbd-afd0-472d-a4bf-c6bde47b1464 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:50.224460 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c3edbd-afd0-472d-a4bf-c6bde47b1464 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:50.224981 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c3edbd-afd0-472d-a4bf-c6bde47b1464 None admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:50.229316 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c3edbd-afd0-472d-a4bf-c6bde47b1464 None admin] RBAC: Adding query filter params (name=service) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:25:50.229316 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c3edbd-afd0-472d-a4bf-c6bde47b1464 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:50.229316 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c3edbd-afd0-472d-a4bf-c6bde47b1464 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:50.240029 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 390/770] 10.222.0.102 () {56 vars in 1108 bytes} [Mon Aug 1 15:25:50 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:50.241376 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c3edbd-afd0-472d-a4bf-c6bde47b1464 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:50.310383 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee391f9-2235-4f6a-a7fc-f5086d6ab1b4 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:50.355880 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bb3268-cb3f-45a0-9767-653fa6aa7c19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:50.356510 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bb3268-cb3f-45a0-9767-653fa6aa7c19 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:50.356778 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bb3268-cb3f-45a0-9767-653fa6aa7c19 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:50.357089 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bb3268-cb3f-45a0-9767-653fa6aa7c19 None admin] PATH_INFO: `/v3/services` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:50.357682 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c3edbd-afd0-472d-a4bf-c6bde47b1464 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:50.358055 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bb3268-cb3f-45a0-9767-653fa6aa7c19 None admin] RBAC: Adding query filter params (type=network) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:25:50.358055 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bb3268-cb3f-45a0-9767-653fa6aa7c19 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:50.359730 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bb3268-cb3f-45a0-9767-653fa6aa7c19 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:50.366776 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 381/771] 10.222.0.102 () {56 vars in 1117 bytes} [Mon Aug 1 15:25:50 2022] GET /identity/v3/services?type=network => generated 352 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:50.368140 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bb3268-cb3f-45a0-9767-653fa6aa7c19 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:50.396389 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0f8711-d9da-4336-94e1-5cbae9caf997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:50.397034 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0f8711-d9da-4336-94e1-5cbae9caf997 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:50.397441 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0f8711-d9da-4336-94e1-5cbae9caf997 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:50.397720 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0f8711-d9da-4336-94e1-5cbae9caf997 None admin] PATH_INFO: `/v3/domains` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:50.399081 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0f8711-d9da-4336-94e1-5cbae9caf997 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:25:50.399387 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0f8711-d9da-4336-94e1-5cbae9caf997 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:50.400894 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0f8711-d9da-4336-94e1-5cbae9caf997 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:50.418810 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 391/772] 10.222.0.102 () {56 vars in 1114 bytes} [Mon Aug 1 15:25:50 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:50.419693 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0f8711-d9da-4336-94e1-5cbae9caf997 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:50.457331 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:50.499113 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:50.504182 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bb3268-cb3f-45a0-9767-653fa6aa7c19 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:50.533216 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0f8711-d9da-4336-94e1-5cbae9caf997 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:50.552965 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b72b87d-8bc5-448d-936a-7fc59c612ba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:50.554020 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b72b87d-8bc5-448d-936a-7fc59c612ba1 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:50.554539 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b72b87d-8bc5-448d-936a-7fc59c612ba1 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:50.555030 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b72b87d-8bc5-448d-936a-7fc59c612ba1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:50.570886 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c13162c-df0c-46ee-a20e-780ae68550d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:50.571348 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b72b87d-8bc5-448d-936a-7fc59c612ba1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:50.571561 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c13162c-df0c-46ee-a20e-780ae68550d0 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:50.571898 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c13162c-df0c-46ee-a20e-780ae68550d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:50.572190 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c13162c-df0c-46ee-a20e-780ae68550d0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:50.573054 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c13162c-df0c-46ee-a20e-780ae68550d0 None admin] RBAC: Adding query filter params (interface=public, service_id=4073fc192dca450fba5373000c74eede, region_id=RegionOne) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:25:50.573369 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c13162c-df0c-46ee-a20e-780ae68550d0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:50.574212 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b72b87d-8bc5-448d-936a-7fc59c612ba1 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:50.574770 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c13162c-df0c-46ee-a20e-780ae68550d0 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:50.583124 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 392/773] 10.222.0.102 () {56 vars in 1256 bytes} [Mon Aug 1 15:25:50 2022] GET /identity/v3/endpoints?service_id=4073fc192dca450fba5373000c74eede&interface=public®ion_id=RegionOne => generated 195 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:50.584056 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c13162c-df0c-46ee-a20e-780ae68550d0 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:50.593336 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-4b72b87d-8bc5-448d-936a-7fc59c612ba1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:25:50.593336 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:25:50.593336 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:25:50.593336 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:25:50.593336 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:25:50.593336 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:25:50.593336 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:25:50.593336 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:25:50.593336 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:25:50.593336 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:25:50.593336 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:25:50.593336 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:25:50.593336 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:25:50.593336 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:25:50.593336 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:25:50.594253 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:25:50.594253 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:25:50.594253 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:25:50.594253 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:25:50.594253 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:25:50.594253 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:25:50.594253 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:25:50.594253 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:25:50.594253 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 01 15:25:50.594253 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:25:50.594253 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:25:50.594253 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:25:50.594253 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:25:50.594253 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:25:50.594253 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:25:50.594253 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:25:50.594253 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:25:50.595205 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:25:50.595205 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:25:50.595205 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:25:50.595205 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 01 15:25:50.599081 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 382/774] 10.222.0.102 () {56 vars in 1113 bytes} [Mon Aug 1 15:25:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:25:50.599942 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b72b87d-8bc5-448d-936a-7fc59c612ba1 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:50.715078 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:50.718938 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c13162c-df0c-46ee-a20e-780ae68550d0 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:50.724834 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b72b87d-8bc5-448d-936a-7fc59c612ba1 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:50.755602 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f88691-7bb5-4533-a4cc-90ac92dd37df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:50.756239 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f88691-7bb5-4533-a4cc-90ac92dd37df None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:50.756518 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f88691-7bb5-4533-a4cc-90ac92dd37df None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:50.756780 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f88691-7bb5-4533-a4cc-90ac92dd37df None admin] PATH_INFO: `/v3/projects/service` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:50.761256 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7041fdee-705e-45e2-ab2f-ad90e428bf8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:50.761885 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7041fdee-705e-45e2-ab2f-ad90e428bf8e None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:50.762168 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7041fdee-705e-45e2-ab2f-ad90e428bf8e None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:50.762447 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7041fdee-705e-45e2-ab2f-ad90e428bf8e None admin] PATH_INFO: `/v3/services` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:50.763101 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7041fdee-705e-45e2-ab2f-ad90e428bf8e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:50.764333 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f88691-7bb5-4533-a4cc-90ac92dd37df None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:50.764504 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7041fdee-705e-45e2-ab2f-ad90e428bf8e None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:50.765801 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f88691-7bb5-4533-a4cc-90ac92dd37df None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:50.776887 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 383/775] 10.222.0.102 () {56 vars in 1092 bytes} [Mon Aug 1 15:25:50 2022] GET /identity/v3/services => generated 776 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:50.776887 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7041fdee-705e-45e2-ab2f-ad90e428bf8e None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:50.784208 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-b0f88691-7bb5-4533-a4cc-90ac92dd37df None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 15:25:50.784208 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:25:50.784208 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:25:50.784208 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:25:50.784208 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:25:50.784208 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:25:50.784208 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:25:50.784208 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:25:50.784208 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:25:50.784208 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:25:50.784208 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:25:50.784208 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:25:50.784208 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 15:25:50.784208 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 15:25:50.784208 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 15:25:50.785233 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 15:25:50.785233 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:25:50.785233 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:25:50.785233 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:25:50.785233 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:25:50.785233 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:25:50.785233 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:25:50.785233 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:25:50.785233 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 01 15:25:50.785233 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:25:50.785233 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:25:50.785233 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:25:50.785233 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:25:50.785233 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:25:50.785233 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:25:50.785233 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:25:50.785233 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:25:50.786135 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 15:25:50.786135 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 15:25:50.786135 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 15:25:50.786135 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 15:25:50.786135 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 15:25:50.786135 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 15:25:50.786135 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 15:25:50.786135 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 01 15:25:50.786135 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 393/776] 10.222.0.102 () {56 vars in 1116 bytes} [Mon Aug 1 15:25:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:25:50.787490 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55e159b-fa00-4e3c-adc3-f72dd5b4fab1 None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:50.787490 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55e159b-fa00-4e3c-adc3-f72dd5b4fab1 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:50.787626 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55e159b-fa00-4e3c-adc3-f72dd5b4fab1 None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:50.793474 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 394/777] 10.222.0.102 () {54 vars in 931 bytes} [Mon Aug 1 15:25:50 2022] GET /identity => generated 271 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 15:25:50.794417 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55e159b-fa00-4e3c-adc3-f72dd5b4fab1 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:50.799562 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:50.920709 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7041fdee-705e-45e2-ab2f-ad90e428bf8e None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:50.934538 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55e159b-fa00-4e3c-adc3-f72dd5b4fab1 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:50.971199 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddb2a55-bc04-4e57-a1ce-a427d3d27472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:50.971880 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddb2a55-bc04-4e57-a1ce-a427d3d27472 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:50.972218 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddb2a55-bc04-4e57-a1ce-a427d3d27472 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:50.972496 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddb2a55-bc04-4e57-a1ce-a427d3d27472 None admin] PATH_INFO: `/v3/domains` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:50.973286 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddb2a55-bc04-4e57-a1ce-a427d3d27472 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:25:50.973596 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddb2a55-bc04-4e57-a1ce-a427d3d27472 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:50.974992 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddb2a55-bc04-4e57-a1ce-a427d3d27472 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:50.984713 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef879a6-1d23-4530-b49c-f8d71d57c935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:50.985644 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef879a6-1d23-4530-b49c-f8d71d57c935 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:50.986578 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef879a6-1d23-4530-b49c-f8d71d57c935 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:50.987017 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef879a6-1d23-4530-b49c-f8d71d57c935 None admin] PATH_INFO: `/v3/projects` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:50.988243 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef879a6-1d23-4530-b49c-f8d71d57c935 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:25:50.988720 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef879a6-1d23-4530-b49c-f8d71d57c935 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:50.994596 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 384/778] 10.222.0.102 () {56 vars in 1114 bytes} [Mon Aug 1 15:25:50 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:50.994596 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a17dd0-2f2a-4e61-ab1f-87313b5cf53a None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:50.994596 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a17dd0-2f2a-4e61-ab1f-87313b5cf53a None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:50.994596 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a17dd0-2f2a-4e61-ab1f-87313b5cf53a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:50.996023 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef879a6-1d23-4530-b49c-f8d71d57c935 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:51.012172 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 395/779] 10.222.0.102 () {56 vars in 1153 bytes} [Mon Aug 1 15:25:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:51.013130 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef879a6-1d23-4530-b49c-f8d71d57c935 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:51.025018 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-68a17dd0-2f2a-4e61-ab1f-87313b5cf53a None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:25:51.026718 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-68a17dd0-2f2a-4e61-ab1f-87313b5cf53a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:25:51.034872 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:51.112262 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 385/780] 10.222.0.102 () {58 vars in 1028 bytes} [Mon Aug 1 15:25:50 2022] POST /identity/v3/auth/tokens => generated 1003 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 15:25:51.113271 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a17dd0-2f2a-4e61-ab1f-87313b5cf53a None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:51.116603 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:51.154665 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef879a6-1d23-4530-b49c-f8d71d57c935 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:51.195965 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5d2b80-c17e-4179-8d3f-09a892791b6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:51.196641 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5d2b80-c17e-4179-8d3f-09a892791b6e None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:51.196947 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5d2b80-c17e-4179-8d3f-09a892791b6e None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:51.197221 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5d2b80-c17e-4179-8d3f-09a892791b6e None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:51.207220 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5d2b80-c17e-4179-8d3f-09a892791b6e None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:51.208681 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5d2b80-c17e-4179-8d3f-09a892791b6e None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:51.222340 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-7d5d2b80-c17e-4179-8d3f-09a892791b6e None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 01 15:25:51.222340 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:25:51.222340 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:25:51.222340 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:25:51.222340 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:25:51.222340 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:25:51.222340 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:25:51.222340 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:25:51.222340 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:25:51.222340 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:25:51.222340 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:25:51.222340 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:25:51.222340 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 15:25:51.222340 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 15:25:51.222340 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 15:25:51.222340 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 15:25:51.223304 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:25:51.223304 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:25:51.223304 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 15:25:51.223304 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 15:25:51.223304 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 15:25:51.223304 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 15:25:51.223304 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:25:51.223304 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:25:51.223304 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:25:51.223304 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:25:51.223304 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:25:51.223304 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 01 15:25:51.223304 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:25:51.223304 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:25:51.223304 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:25:51.223304 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:25:51.223304 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:25:51.223304 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:25:51.224653 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:25:51.224653 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:25:51.224653 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 15:25:51.224653 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 15:25:51.224653 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 15:25:51.224653 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 15:25:51.224653 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 15:25:51.224653 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 15:25:51.224653 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 01 15:25:51.224653 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 01 15:25:51.224653 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 396/781] 10.222.0.102 () {56 vars in 1122 bytes} [Mon Aug 1 15:25:51 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:25:51.224653 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5d2b80-c17e-4179-8d3f-09a892791b6e None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:51.240380 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a17dd0-2f2a-4e61-ab1f-87313b5cf53a None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:51.277900 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52abb4e8-3ec6-45ed-b66a-00190ce3034d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:51.278577 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52abb4e8-3ec6-45ed-b66a-00190ce3034d None admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:51.279142 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52abb4e8-3ec6-45ed-b66a-00190ce3034d None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:51.279142 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52abb4e8-3ec6-45ed-b66a-00190ce3034d None admin] PATH_INFO: `/v3/projects/2eb32fbe631843d8be84d41f8ba88d6e/users/77b43f1ee8cc4be3907a494abe90c1cc/roles/de1374f966c04c27b579515b54334fd2` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:51.281087 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52abb4e8-3ec6-45ed-b66a-00190ce3034d None admin] RBAC: Authorizing `identity:create_grant(project_id=2eb32fbe631843d8be84d41f8ba88d6e, user_id=77b43f1ee8cc4be3907a494abe90c1cc, role_id=de1374f966c04c27b579515b54334fd2)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:51.282523 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52abb4e8-3ec6-45ed-b66a-00190ce3034d None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:51.315040 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:51.336941 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5d2b80-c17e-4179-8d3f-09a892791b6e None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:51.370578 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea165d66-23ae-4fc5-b25d-10ce0fe8140c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:51.371288 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea165d66-23ae-4fc5-b25d-10ce0fe8140c None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:51.371585 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea165d66-23ae-4fc5-b25d-10ce0fe8140c None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:51.371856 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea165d66-23ae-4fc5-b25d-10ce0fe8140c None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:51.372485 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea165d66-23ae-4fc5-b25d-10ce0fe8140c None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:51.373895 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea165d66-23ae-4fc5-b25d-10ce0fe8140c None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:51.382906 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-ea165d66-23ae-4fc5-b25d-10ce0fe8140c None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 01 15:25:51.382906 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:25:51.382906 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 01 15:25:51.382906 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 01 15:25:51.382906 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 01 15:25:51.382906 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 01 15:25:51.382906 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 01 15:25:51.382906 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 15:25:51.382906 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 01 15:25:51.382906 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 01 15:25:51.382906 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 15:25:51.382906 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 01 15:25:51.382906 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:25:51.382906 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:25:51.382906 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:25:51.382906 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:25:51.384021 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:25:51.384021 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:25:51.384021 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:25:51.384021 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:25:51.384021 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:25:51.384021 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:25:51.384021 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:25:51.384021 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 01 15:25:51.384021 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 01 15:25:51.384021 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 01 15:25:51.384021 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 01 15:25:51.384021 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:25:51.384021 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:25:51.384021 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:25:51.384021 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:25:51.384021 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:25:51.385163 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:25:51.385163 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:25:51.385163 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 01 15:25:51.385163 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:25:51.385163 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:25:51.385163 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:25:51.385163 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:25:51.385163 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:25:51.385163 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:25:51.385163 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:25:51.385163 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:25:51.385163 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 01 15:25:51.385163 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 15:25:51.385163 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 01 15:25:51.385163 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 01 15:25:51.385163 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 397/782] 10.222.0.102 () {56 vars in 1134 bytes} [Mon Aug 1 15:25:51 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:25:51.386530 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea165d66-23ae-4fc5-b25d-10ce0fe8140c None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:51.395035 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 386/783] 10.222.0.102 () {58 vars in 1444 bytes} [Mon Aug 1 15:25:51 2022] PUT /identity/v3/projects/2eb32fbe631843d8be84d41f8ba88d6e/users/77b43f1ee8cc4be3907a494abe90c1cc/roles/de1374f966c04c27b579515b54334fd2 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:25:51.396280 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a44dff-92e1-4d43-93b8-24276d6039d6 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:51.396561 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a44dff-92e1-4d43-93b8-24276d6039d6 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:51.396833 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a44dff-92e1-4d43-93b8-24276d6039d6 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:51.402994 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 387/784] 10.222.0.102 () {54 vars in 931 bytes} [Mon Aug 1 15:25:51 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 15:25:51.402994 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a44dff-92e1-4d43-93b8-24276d6039d6 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:51.500315 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:51.533721 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea165d66-23ae-4fc5-b25d-10ce0fe8140c None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:51.546988 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a44dff-92e1-4d43-93b8-24276d6039d6 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:51.590281 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca14be2-212f-4862-938d-00dd5ccb4b0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:51.591397 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca14be2-212f-4862-938d-00dd5ccb4b0e None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:51.591858 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca14be2-212f-4862-938d-00dd5ccb4b0e None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:51.592331 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9762b61-e52f-4d2c-b70b-a18d599ca7a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:51.592480 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca14be2-212f-4862-938d-00dd5ccb4b0e None admin] PATH_INFO: `/v3/users` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:51.593052 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9762b61-e52f-4d2c-b70b-a18d599ca7a4 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:51.593403 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9762b61-e52f-4d2c-b70b-a18d599ca7a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:51.593746 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9762b61-e52f-4d2c-b70b-a18d599ca7a4 None admin] PATH_INFO: `/v3/services` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:51.594106 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca14be2-212f-4862-938d-00dd5ccb4b0e None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:25:51.594556 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9762b61-e52f-4d2c-b70b-a18d599ca7a4 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:25:51.594773 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca14be2-212f-4862-938d-00dd5ccb4b0e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:51.594929 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9762b61-e52f-4d2c-b70b-a18d599ca7a4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:51.596475 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9762b61-e52f-4d2c-b70b-a18d599ca7a4 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:51.596792 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca14be2-212f-4862-938d-00dd5ccb4b0e None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:51.603611 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 388/785] 10.222.0.102 () {56 vars in 1129 bytes} [Mon Aug 1 15:25:51 2022] GET /identity/v3/services?name=block-storage => generated 131 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:51.605045 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4584cf9f-7b16-473f-a9e0-5952e576949c None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:51.605399 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4584cf9f-7b16-473f-a9e0-5952e576949c None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:51.605835 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4584cf9f-7b16-473f-a9e0-5952e576949c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:51.625098 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 398/786] 10.222.0.102 () {56 vars in 1154 bytes} [Mon Aug 1 15:25:51 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 386 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:51.626622 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca14be2-212f-4862-938d-00dd5ccb4b0e None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:51.631496 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-4584cf9f-7b16-473f-a9e0-5952e576949c None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:25:51.632833 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-4584cf9f-7b16-473f-a9e0-5952e576949c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:25:51.649238 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:51.729050 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 389/787] 10.222.0.102 () {58 vars in 1028 bytes} [Mon Aug 1 15:25:51 2022] POST /identity/v3/auth/tokens => generated 1003 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 15:25:51.729050 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4584cf9f-7b16-473f-a9e0-5952e576949c None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:51.766909 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca14be2-212f-4862-938d-00dd5ccb4b0e None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:51.796469 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:51.807284 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfef779-7f69-4346-818c-510167ec207f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:51.808004 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfef779-7f69-4346-818c-510167ec207f None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:51.808311 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfef779-7f69-4346-818c-510167ec207f None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:51.810625 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfef779-7f69-4346-818c-510167ec207f None admin] PATH_INFO: `/v3/services` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:51.810625 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfef779-7f69-4346-818c-510167ec207f None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:25:51.810625 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfef779-7f69-4346-818c-510167ec207f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:51.811963 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfef779-7f69-4346-818c-510167ec207f None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:51.819717 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 399/788] 10.222.0.102 () {56 vars in 1129 bytes} [Mon Aug 1 15:25:51 2022] GET /identity/v3/services?type=block-storage => generated 369 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:51.821761 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfef779-7f69-4346-818c-510167ec207f None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:51.852043 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4584cf9f-7b16-473f-a9e0-5952e576949c None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:51.903648 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b75021-823b-468d-958c-d8d9ab360c96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:51.904301 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b75021-823b-468d-958c-d8d9ab360c96 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:51.904577 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b75021-823b-468d-958c-d8d9ab360c96 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:51.904861 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b75021-823b-468d-958c-d8d9ab360c96 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:51.906691 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:51.916419 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b75021-823b-468d-958c-d8d9ab360c96 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:51.918555 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b75021-823b-468d-958c-d8d9ab360c96 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:51.934817 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-31b75021-823b-468d-958c-d8d9ab360c96 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:25:51.934817 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:25:51.934817 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:25:51.934817 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:25:51.934817 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:25:51.934817 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:25:51.934817 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:25:51.934817 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:25:51.934817 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:25:51.934817 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:25:51.934817 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:25:51.934817 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:25:51.934817 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:25:51.934817 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:25:51.934817 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:25:51.936159 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:25:51.936159 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:25:51.936159 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:25:51.936159 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:25:51.936159 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:25:51.936159 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:25:51.936159 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:25:51.936159 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:25:51.936159 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 01 15:25:51.936159 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:25:51.936159 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:25:51.936159 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:25:51.936159 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:25:51.936159 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:25:51.936159 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:25:51.936159 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:25:51.936159 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:25:51.937371 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:25:51.937371 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:25:51.937371 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:25:51.937371 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 01 15:25:51.938699 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 390/789] 10.222.0.102 () {56 vars in 1113 bytes} [Mon Aug 1 15:25:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:25:51.939633 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b75021-823b-468d-958c-d8d9ab360c96 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:51.960210 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfef779-7f69-4346-818c-510167ec207f None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:52.016780 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db121bb1-94b1-4494-b528-f7e4925c4f88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:52.018046 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db121bb1-94b1-4494-b528-f7e4925c4f88 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:52.018479 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db121bb1-94b1-4494-b528-f7e4925c4f88 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:52.018899 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db121bb1-94b1-4494-b528-f7e4925c4f88 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:52.034911 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db121bb1-94b1-4494-b528-f7e4925c4f88 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:25:52.042748 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-db121bb1-94b1-4494-b528-f7e4925c4f88 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 15:25:52.042748 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:25:52.042748 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:25:52.042748 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:25:52.042748 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:25:52.042748 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:25:52.042748 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:25:52.042748 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:25:52.042748 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:25:52.042748 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:25:52.042748 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:25:52.042748 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:25:52.042748 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:25:52.042748 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:25:52.042748 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:25:52.042748 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:25:52.043890 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:25:52.043890 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:25:52.043890 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:25:52.043890 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:25:52.043890 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:25:52.043890 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:25:52.043890 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:25:52.043890 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:25:52.043890 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:25:52.043890 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:25:52.043890 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:25:52.043890 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 01 15:25:52.043890 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:25:52.043890 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:25:52.043890 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:25:52.043890 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:25:52.044948 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:25:52.044948 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:25:52.044948 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:25:52.044948 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:25:52.044948 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:25:52.044948 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:25:52.044948 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:25:52.044948 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:25:52.044948 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:25:52.044948 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:25:52.044948 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 15:25:52.044948 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 01 15:25:52.047640 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 400/790] 10.222.0.102 () {56 vars in 1101 bytes} [Mon Aug 1 15:25:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:25:52.048598 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db121bb1-94b1-4494-b528-f7e4925c4f88 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:52.067256 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b75021-823b-468d-958c-d8d9ab360c96 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:52.079713 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:52.104912 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402b7f0b-9340-4cfb-a89b-eeb90b8cb5ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:52.105607 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402b7f0b-9340-4cfb-a89b-eeb90b8cb5ef None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:52.105890 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402b7f0b-9340-4cfb-a89b-eeb90b8cb5ef None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:52.106170 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402b7f0b-9340-4cfb-a89b-eeb90b8cb5ef None admin] PATH_INFO: `/v3/endpoints` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:52.106974 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402b7f0b-9340-4cfb-a89b-eeb90b8cb5ef None admin] RBAC: Adding query filter params (interface=public, service_id=4cc61f77d5b04dcea2a0541899197449, region_id=RegionOne) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:25:52.107291 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402b7f0b-9340-4cfb-a89b-eeb90b8cb5ef None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:52.109021 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402b7f0b-9340-4cfb-a89b-eeb90b8cb5ef None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:52.121976 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 391/791] 10.222.0.102 () {56 vars in 1256 bytes} [Mon Aug 1 15:25:51 2022] GET /identity/v3/endpoints?service_id=4cc61f77d5b04dcea2a0541899197449&interface=public®ion_id=RegionOne => generated 195 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:52.121976 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402b7f0b-9340-4cfb-a89b-eeb90b8cb5ef None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:52.190096 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db121bb1-94b1-4494-b528-f7e4925c4f88 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:52.222674 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:52.231432 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402b7f0b-9340-4cfb-a89b-eeb90b8cb5ef None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:52.236900 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1747382-420c-45e1-a1fd-5544844d7f3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:52.237726 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1747382-420c-45e1-a1fd-5544844d7f3f None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:52.238208 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1747382-420c-45e1-a1fd-5544844d7f3f None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:52.238656 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1747382-420c-45e1-a1fd-5544844d7f3f None admin] PATH_INFO: `/v3/domains` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:52.240001 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1747382-420c-45e1-a1fd-5544844d7f3f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:25:52.240493 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1747382-420c-45e1-a1fd-5544844d7f3f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:52.243047 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1747382-420c-45e1-a1fd-5544844d7f3f None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:52.260796 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 401/792] 10.222.0.102 () {56 vars in 1114 bytes} [Mon Aug 1 15:25:52 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:52.262172 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1747382-420c-45e1-a1fd-5544844d7f3f None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:52.269833 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac2ec99-3045-4a85-9e42-239bf6960bc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:52.270502 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac2ec99-3045-4a85-9e42-239bf6960bc9 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:52.270853 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac2ec99-3045-4a85-9e42-239bf6960bc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:52.271199 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac2ec99-3045-4a85-9e42-239bf6960bc9 None admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:52.272149 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac2ec99-3045-4a85-9e42-239bf6960bc9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:25:52.272526 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac2ec99-3045-4a85-9e42-239bf6960bc9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:52.274338 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac2ec99-3045-4a85-9e42-239bf6960bc9 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:52.288001 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 392/793] 10.222.0.102 () {56 vars in 1104 bytes} [Mon Aug 1 15:25:52 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:52.289386 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac2ec99-3045-4a85-9e42-239bf6960bc9 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:52.326690 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:52.393057 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1747382-420c-45e1-a1fd-5544844d7f3f None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:52.397804 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac2ec99-3045-4a85-9e42-239bf6960bc9 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:52.436819 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92abefcd-a5df-484f-b839-677f263611a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:52.437642 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92abefcd-a5df-484f-b839-677f263611a3 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:52.438249 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92abefcd-a5df-484f-b839-677f263611a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:52.438621 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92abefcd-a5df-484f-b839-677f263611a3 None admin] PATH_INFO: `/v3/services` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:52.439378 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92abefcd-a5df-484f-b839-677f263611a3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:52.440864 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92abefcd-a5df-484f-b839-677f263611a3 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:52.442139 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e11c91f-3072-44c6-81f6-9cce929e1449 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:52.443329 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e11c91f-3072-44c6-81f6-9cce929e1449 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:52.443758 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e11c91f-3072-44c6-81f6-9cce929e1449 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:52.444319 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e11c91f-3072-44c6-81f6-9cce929e1449 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:52.452880 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 402/794] 10.222.0.102 () {56 vars in 1092 bytes} [Mon Aug 1 15:25:52 2022] GET /identity/v3/services => generated 776 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:52.452880 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92abefcd-a5df-484f-b839-677f263611a3 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:52.465484 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e11c91f-3072-44c6-81f6-9cce929e1449 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:52.467004 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e11c91f-3072-44c6-81f6-9cce929e1449 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:52.489713 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-5e11c91f-3072-44c6-81f6-9cce929e1449 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 15:25:52.489713 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:25:52.489713 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:25:52.489713 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:25:52.489713 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:25:52.489713 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:25:52.489713 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:25:52.489713 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:25:52.489713 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:25:52.489713 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:25:52.489713 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:25:52.489713 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:25:52.489713 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 15:25:52.489713 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 15:25:52.489713 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 15:25:52.490699 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 15:25:52.490699 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:25:52.490699 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:25:52.490699 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:25:52.490699 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:25:52.490699 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:25:52.490699 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:25:52.490699 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:25:52.490699 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 01 15:25:52.490699 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:25:52.490699 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:25:52.490699 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:25:52.490699 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:25:52.490699 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:25:52.490699 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:25:52.490699 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:25:52.490699 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:25:52.491624 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 15:25:52.491624 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 15:25:52.491624 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 15:25:52.491624 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 15:25:52.491624 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 15:25:52.491624 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 15:25:52.491624 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 15:25:52.491624 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 01 15:25:52.491624 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 393/795] 10.222.0.102 () {56 vars in 1116 bytes} [Mon Aug 1 15:25:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:25:52.497598 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e11c91f-3072-44c6-81f6-9cce929e1449 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:52.561325 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:52.667683 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92abefcd-a5df-484f-b839-677f263611a3 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:52.680956 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:52.688935 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e11c91f-3072-44c6-81f6-9cce929e1449 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:52.707949 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519a8817-86be-43f2-a0b3-323aa07177da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:52.708596 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519a8817-86be-43f2-a0b3-323aa07177da None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:52.708908 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519a8817-86be-43f2-a0b3-323aa07177da None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:52.709177 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519a8817-86be-43f2-a0b3-323aa07177da None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:52.720664 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519a8817-86be-43f2-a0b3-323aa07177da None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:52.722302 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519a8817-86be-43f2-a0b3-323aa07177da None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:52.733792 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ee17b5-5e07-4d6b-8c76-c597f2ca64a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:52.734830 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ee17b5-5e07-4d6b-8c76-c597f2ca64a8 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:52.735325 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ee17b5-5e07-4d6b-8c76-c597f2ca64a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:52.735825 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ee17b5-5e07-4d6b-8c76-c597f2ca64a8 None admin] PATH_INFO: `/v3/projects` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:52.736779 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ee17b5-5e07-4d6b-8c76-c597f2ca64a8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:25:52.737370 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ee17b5-5e07-4d6b-8c76-c597f2ca64a8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:52.739169 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ee17b5-5e07-4d6b-8c76-c597f2ca64a8 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:52.739889 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-519a8817-86be-43f2-a0b3-323aa07177da None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:25:52.739889 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:25:52.739889 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:25:52.739889 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:25:52.739889 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:25:52.739889 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:25:52.739889 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:25:52.739889 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:25:52.739889 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:25:52.739889 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:25:52.739889 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:25:52.739889 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:25:52.739889 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:25:52.739889 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:25:52.739889 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:25:52.740777 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:25:52.740777 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:25:52.740777 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:25:52.740777 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:25:52.740777 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:25:52.740777 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:25:52.740777 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:25:52.740777 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:25:52.740777 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 01 15:25:52.740777 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:25:52.740777 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:25:52.740777 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:25:52.740777 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:25:52.740777 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:25:52.740777 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:25:52.740777 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:25:52.740777 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:25:52.742708 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:25:52.742708 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:25:52.742708 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:25:52.742708 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 01 15:25:52.742708 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 403/796] 10.222.0.102 () {56 vars in 1113 bytes} [Mon Aug 1 15:25:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:25:52.747619 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519a8817-86be-43f2-a0b3-323aa07177da None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:52.760503 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 394/797] 10.222.0.102 () {56 vars in 1153 bytes} [Mon Aug 1 15:25:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:52.763450 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ee17b5-5e07-4d6b-8c76-c597f2ca64a8 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:52.871433 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ee17b5-5e07-4d6b-8c76-c597f2ca64a8 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:52.909217 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668f6c67-4443-4c96-a980-a0d268a9c12b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:52.910229 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668f6c67-4443-4c96-a980-a0d268a9c12b None admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:52.910712 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668f6c67-4443-4c96-a980-a0d268a9c12b None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:52.911204 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668f6c67-4443-4c96-a980-a0d268a9c12b None admin] PATH_INFO: `/v3/projects/2eb32fbe631843d8be84d41f8ba88d6e/users/ae8514df55144c9086ed98ba44efbbd4/roles/3087c03acf8d44d9ae512385924c5d0d` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:52.927519 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:52.928819 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668f6c67-4443-4c96-a980-a0d268a9c12b None admin] RBAC: Authorizing `identity:create_grant(project_id=2eb32fbe631843d8be84d41f8ba88d6e, user_id=ae8514df55144c9086ed98ba44efbbd4, role_id=3087c03acf8d44d9ae512385924c5d0d)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:52.930738 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668f6c67-4443-4c96-a980-a0d268a9c12b None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:52.930866 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519a8817-86be-43f2-a0b3-323aa07177da None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:52.970647 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8475c0a3-769d-46cf-91d0-d8e8a0374394 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:52.971848 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8475c0a3-769d-46cf-91d0-d8e8a0374394 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:52.972382 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8475c0a3-769d-46cf-91d0-d8e8a0374394 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:52.972930 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8475c0a3-769d-46cf-91d0-d8e8a0374394 None admin] PATH_INFO: `/v3/domains` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:52.974048 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8475c0a3-769d-46cf-91d0-d8e8a0374394 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:25:52.974519 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8475c0a3-769d-46cf-91d0-d8e8a0374394 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:52.976053 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8475c0a3-769d-46cf-91d0-d8e8a0374394 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:52.989473 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 404/798] 10.222.0.102 () {56 vars in 1114 bytes} [Mon Aug 1 15:25:52 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:25:52.991060 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4057b088-a896-4d77-9933-55d17d80ac89 None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:52.991474 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4057b088-a896-4d77-9933-55d17d80ac89 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:52.991914 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4057b088-a896-4d77-9933-55d17d80ac89 None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:52.993565 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 405/799] 10.222.0.102 () {54 vars in 931 bytes} [Mon Aug 1 15:25:52 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 15:25:52.995330 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4057b088-a896-4d77-9933-55d17d80ac89 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:53.012379 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 395/800] 10.222.0.102 () {58 vars in 1444 bytes} [Mon Aug 1 15:25:52 2022] PUT /identity/v3/projects/2eb32fbe631843d8be84d41f8ba88d6e/users/ae8514df55144c9086ed98ba44efbbd4/roles/3087c03acf8d44d9ae512385924c5d0d => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:25:53.012379 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0679bd-211d-4165-824e-012c19377bd3 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:53.012379 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0679bd-211d-4165-824e-012c19377bd3 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:53.012379 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0679bd-211d-4165-824e-012c19377bd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:53.034303 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:53.044782 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-7e0679bd-211d-4165-824e-012c19377bd3 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:25:53.046313 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-7e0679bd-211d-4165-824e-012c19377bd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:25:53.154731 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4057b088-a896-4d77-9933-55d17d80ac89 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:53.204893 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 396/801] 10.222.0.102 () {58 vars in 1028 bytes} [Mon Aug 1 15:25:53 2022] POST /identity/v3/auth/tokens => generated 1003 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 15:25:53.217199 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22dd871-d03d-4d26-bfd2-f0bf7cc8e64c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:53.218117 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22dd871-d03d-4d26-bfd2-f0bf7cc8e64c None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:53.218588 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22dd871-d03d-4d26-bfd2-f0bf7cc8e64c None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:53.219004 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22dd871-d03d-4d26-bfd2-f0bf7cc8e64c None admin] PATH_INFO: `/v3/users/swift` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:53.228897 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22dd871-d03d-4d26-bfd2-f0bf7cc8e64c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:53.230561 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22dd871-d03d-4d26-bfd2-f0bf7cc8e64c None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:53.234192 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0679bd-211d-4165-824e-012c19377bd3 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:53.249965 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-d22dd871-d03d-4d26-bfd2-f0bf7cc8e64c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 01 15:25:53.249965 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:25:53.249965 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:25:53.249965 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:25:53.249965 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:25:53.249965 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:25:53.249965 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:25:53.249965 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:25:53.249965 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:25:53.249965 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:25:53.249965 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:25:53.249965 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:25:53.249965 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 15:25:53.249965 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 15:25:53.249965 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 15:25:53.249965 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 15:25:53.251126 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:25:53.251126 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:25:53.251126 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 15:25:53.251126 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 15:25:53.251126 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 15:25:53.251126 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 15:25:53.251126 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:25:53.251126 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:25:53.251126 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:25:53.251126 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:25:53.251126 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:25:53.251126 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 01 15:25:53.251126 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:25:53.251126 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:25:53.251126 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:25:53.251126 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:25:53.251126 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:25:53.251126 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:25:53.252361 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:25:53.252361 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:25:53.252361 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 15:25:53.252361 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 15:25:53.252361 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 15:25:53.252361 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 15:25:53.252361 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 15:25:53.252361 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 15:25:53.252361 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 01 15:25:53.252361 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 01 15:25:53.252361 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 406/802] 10.222.0.102 () {56 vars in 1101 bytes} [Mon Aug 1 15:25:52 2022] GET /identity/v3/users/swift => generated 83 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 15:25:53.259128 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22dd871-d03d-4d26-bfd2-f0bf7cc8e64c None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:53.292763 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:53.366357 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0679bd-211d-4165-824e-012c19377bd3 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:53.403487 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22dd871-d03d-4d26-bfd2-f0bf7cc8e64c None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:53.411317 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3195f3a8-9f07-4549-9df6-3805223919c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:53.413150 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3195f3a8-9f07-4549-9df6-3805223919c0 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:53.413672 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3195f3a8-9f07-4549-9df6-3805223919c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:53.414095 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3195f3a8-9f07-4549-9df6-3805223919c0 None admin] PATH_INFO: `/v3/services/network` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:53.415326 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3195f3a8-9f07-4549-9df6-3805223919c0 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:53.417665 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3195f3a8-9f07-4549-9df6-3805223919c0 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:53.421610 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:53.431659 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-3195f3a8-9f07-4549-9df6-3805223919c0 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 01 15:25:53.431659 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:25:53.431659 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 01 15:25:53.431659 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 01 15:25:53.431659 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 01 15:25:53.431659 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 01 15:25:53.431659 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 01 15:25:53.431659 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 15:25:53.431659 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 01 15:25:53.431659 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 01 15:25:53.431659 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 15:25:53.431659 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 01 15:25:53.431659 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:25:53.431659 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:25:53.431659 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:25:53.431659 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:25:53.431659 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:25:53.438872 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:25:53.438872 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:25:53.438872 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:25:53.438872 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:25:53.438872 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:25:53.438872 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:25:53.438872 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 01 15:25:53.438872 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 01 15:25:53.438872 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 01 15:25:53.438872 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 01 15:25:53.438872 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:25:53.438872 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:25:53.438872 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:25:53.438872 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:25:53.438872 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:25:53.438872 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:25:53.439915 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:25:53.439915 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 01 15:25:53.439915 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:25:53.439915 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:25:53.439915 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:25:53.439915 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:25:53.439915 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:25:53.439915 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:25:53.439915 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:25:53.439915 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:25:53.439915 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 01 15:25:53.439915 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 15:25:53.439915 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 01 15:25:53.439915 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 01 15:25:53.439915 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 397/803] 10.222.0.102 () {56 vars in 1116 bytes} [Mon Aug 1 15:25:53 2022] GET /identity/v3/services/network => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:25:53.442164 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3195f3a8-9f07-4549-9df6-3805223919c0 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:53.453954 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165bbf46-5dd8-4f61-8223-9be935061c78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:53.455033 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165bbf46-5dd8-4f61-8223-9be935061c78 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:53.457286 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165bbf46-5dd8-4f61-8223-9be935061c78 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:53.457708 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165bbf46-5dd8-4f61-8223-9be935061c78 None admin] PATH_INFO: `/v3/users` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:53.458648 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165bbf46-5dd8-4f61-8223-9be935061c78 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:25:53.461339 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165bbf46-5dd8-4f61-8223-9be935061c78 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:53.464233 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165bbf46-5dd8-4f61-8223-9be935061c78 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:53.495535 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 407/804] 10.222.0.102 () {56 vars in 1140 bytes} [Mon Aug 1 15:25:53 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 372 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:53.500979 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165bbf46-5dd8-4f61-8223-9be935061c78 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:53.637858 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3195f3a8-9f07-4549-9df6-3805223919c0 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:53.641539 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:53.670561 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165bbf46-5dd8-4f61-8223-9be935061c78 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:53.691198 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f3e784-1e8b-41e1-a479-7aded85e00ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:53.692104 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f3e784-1e8b-41e1-a479-7aded85e00ad None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:53.692557 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f3e784-1e8b-41e1-a479-7aded85e00ad None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:53.693026 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f3e784-1e8b-41e1-a479-7aded85e00ad None admin] PATH_INFO: `/v3/services` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:53.694531 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f3e784-1e8b-41e1-a479-7aded85e00ad None admin] RBAC: Adding query filter params (name=network) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:25:53.695895 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f3e784-1e8b-41e1-a479-7aded85e00ad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:53.701761 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f3e784-1e8b-41e1-a479-7aded85e00ad None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:53.709263 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dd83b2-a4de-4a69-944b-ef12fb8eb1bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:53.709732 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 398/805] 10.222.0.102 () {56 vars in 1117 bytes} [Mon Aug 1 15:25:53 2022] GET /identity/v3/services?name=network => generated 125 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:53.711296 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fb365e-447a-4682-812d-0954c268aa8d None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:53.711790 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fb365e-447a-4682-812d-0954c268aa8d None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:53.712208 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fb365e-447a-4682-812d-0954c268aa8d None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:53.717687 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dd83b2-a4de-4a69-944b-ef12fb8eb1bc None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:53.717687 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dd83b2-a4de-4a69-944b-ef12fb8eb1bc None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:53.717687 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dd83b2-a4de-4a69-944b-ef12fb8eb1bc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:53.718525 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 399/806] 10.222.0.102 () {54 vars in 931 bytes} [Mon Aug 1 15:25:53 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 15:25:53.719975 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fb365e-447a-4682-812d-0954c268aa8d None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:53.729753 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dd83b2-a4de-4a69-944b-ef12fb8eb1bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:53.731257 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dd83b2-a4de-4a69-944b-ef12fb8eb1bc None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:53.748128 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-e7dd83b2-a4de-4a69-944b-ef12fb8eb1bc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:25:53.748128 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:25:53.748128 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:25:53.748128 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:25:53.748128 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:25:53.748128 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:25:53.748128 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:25:53.748128 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:25:53.748128 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:25:53.748128 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:25:53.748128 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:25:53.748128 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:25:53.748128 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:25:53.748128 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:25:53.748128 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:25:53.749328 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:25:53.749328 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:25:53.749328 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:25:53.749328 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:25:53.749328 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:25:53.749328 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:25:53.749328 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:25:53.749328 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:25:53.749328 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 01 15:25:53.749328 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:25:53.749328 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:25:53.749328 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:25:53.749328 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:25:53.749328 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:25:53.749328 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:25:53.749328 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:25:53.749328 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:25:53.750291 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:25:53.750291 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:25:53.750291 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:25:53.750291 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 01 15:25:53.750291 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 408/807] 10.222.0.102 () {56 vars in 1113 bytes} [Mon Aug 1 15:25:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:25:53.750818 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e3ae39-0297-4f40-b2a5-6ca6653af25a None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:53.751106 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e3ae39-0297-4f40-b2a5-6ca6653af25a None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:53.751380 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e3ae39-0297-4f40-b2a5-6ca6653af25a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:53.772439 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-f5e3ae39-0297-4f40-b2a5-6ca6653af25a None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:25:53.774152 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-f5e3ae39-0297-4f40-b2a5-6ca6653af25a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:25:53.798518 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:53.844832 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fb365e-447a-4682-812d-0954c268aa8d None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:53.869804 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 409/808] 10.222.0.102 () {58 vars in 1028 bytes} [Mon Aug 1 15:25:53 2022] POST /identity/v3/auth/tokens => generated 1003 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 15:25:53.870886 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e3ae39-0297-4f40-b2a5-6ca6653af25a None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:53.896374 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fd644b-a6e6-4c34-8473-01bf7c0b09bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:53.897283 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fd644b-a6e6-4c34-8473-01bf7c0b09bc None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:53.898788 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fd644b-a6e6-4c34-8473-01bf7c0b09bc None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:53.898901 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fd644b-a6e6-4c34-8473-01bf7c0b09bc None admin] PATH_INFO: `/v3/services` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:53.899618 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fd644b-a6e6-4c34-8473-01bf7c0b09bc None admin] RBAC: Adding query filter params (type=network) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:25:53.899930 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fd644b-a6e6-4c34-8473-01bf7c0b09bc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:53.901353 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fd644b-a6e6-4c34-8473-01bf7c0b09bc None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:53.908895 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 400/809] 10.222.0.102 () {56 vars in 1117 bytes} [Mon Aug 1 15:25:53 2022] GET /identity/v3/services?type=network => generated 352 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:53.908895 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fd644b-a6e6-4c34-8473-01bf7c0b09bc None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:53.966123 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:54.016273 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e3ae39-0297-4f40-b2a5-6ca6653af25a None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:54.045739 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fd644b-a6e6-4c34-8473-01bf7c0b09bc None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:54.062903 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0519a02-1171-4940-8c4e-c956deac511e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:54.063843 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0519a02-1171-4940-8c4e-c956deac511e None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:54.064426 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0519a02-1171-4940-8c4e-c956deac511e None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:54.064918 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0519a02-1171-4940-8c4e-c956deac511e None admin] PATH_INFO: `/v3/domains` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:54.065896 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0519a02-1171-4940-8c4e-c956deac511e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:25:54.066491 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0519a02-1171-4940-8c4e-c956deac511e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:54.068225 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0519a02-1171-4940-8c4e-c956deac511e None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:54.074592 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:54.082706 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 410/810] 10.222.0.102 () {56 vars in 1114 bytes} [Mon Aug 1 15:25:53 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:54.083266 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dde9be6-8b5a-40a7-8724-924a74120f77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:54.090092 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dde9be6-8b5a-40a7-8724-924a74120f77 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:54.090217 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0519a02-1171-4940-8c4e-c956deac511e None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:54.090310 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dde9be6-8b5a-40a7-8724-924a74120f77 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:54.090310 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dde9be6-8b5a-40a7-8724-924a74120f77 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:54.096351 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dde9be6-8b5a-40a7-8724-924a74120f77 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:25:54.102378 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-7dde9be6-8b5a-40a7-8724-924a74120f77 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 15:25:54.102378 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:25:54.102378 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:25:54.102378 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:25:54.102378 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:25:54.102378 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:25:54.102378 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:25:54.102378 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:25:54.102378 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:25:54.102378 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:25:54.102378 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:25:54.102378 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:25:54.102378 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:25:54.102378 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:25:54.102378 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:25:54.102378 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:25:54.103320 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:25:54.103320 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:25:54.103320 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:25:54.103320 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:25:54.103320 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:25:54.103320 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:25:54.103320 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:25:54.103320 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:25:54.103320 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:25:54.103320 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:25:54.103320 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:25:54.103320 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 01 15:25:54.103320 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:25:54.103320 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:25:54.103320 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:25:54.103320 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:25:54.104163 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:25:54.104163 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:25:54.104163 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:25:54.104163 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:25:54.104163 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:25:54.104163 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:25:54.104163 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:25:54.104163 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:25:54.104163 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:25:54.104163 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:25:54.104163 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 15:25:54.104163 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 01 15:25:54.104163 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 401/811] 10.222.0.102 () {56 vars in 1101 bytes} [Mon Aug 1 15:25:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:25:54.110816 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dde9be6-8b5a-40a7-8724-924a74120f77 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:54.214880 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0519a02-1171-4940-8c4e-c956deac511e None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:54.243303 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:54.243598 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dde9be6-8b5a-40a7-8724-924a74120f77 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:54.263287 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e438d836-bbd3-4d0c-8e50-ee6134b149a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:54.264302 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e438d836-bbd3-4d0c-8e50-ee6134b149a5 None admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:54.265263 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e438d836-bbd3-4d0c-8e50-ee6134b149a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:54.265566 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e438d836-bbd3-4d0c-8e50-ee6134b149a5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:54.266323 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e438d836-bbd3-4d0c-8e50-ee6134b149a5 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:54.267707 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e438d836-bbd3-4d0c-8e50-ee6134b149a5 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:54.285016 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8738aae9-1fb0-45ac-9ce2-90bb1d1c303a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:54.285763 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8738aae9-1fb0-45ac-9ce2-90bb1d1c303a None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:54.286110 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8738aae9-1fb0-45ac-9ce2-90bb1d1c303a None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:54.286453 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8738aae9-1fb0-45ac-9ce2-90bb1d1c303a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:54.293958 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8738aae9-1fb0-45ac-9ce2-90bb1d1c303a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:54.295476 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8738aae9-1fb0-45ac-9ce2-90bb1d1c303a None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:54.307601 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-8738aae9-1fb0-45ac-9ce2-90bb1d1c303a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 15:25:54.307601 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:25:54.307601 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:25:54.307601 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:25:54.307601 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:25:54.307601 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:25:54.307601 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:25:54.307601 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:25:54.307601 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:25:54.307601 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:25:54.307601 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:25:54.307601 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:25:54.307601 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 15:25:54.307601 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 15:25:54.307601 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 15:25:54.308542 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 15:25:54.308542 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:25:54.308542 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:25:54.308542 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:25:54.308542 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:25:54.308542 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:25:54.308542 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:25:54.308542 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:25:54.308542 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 01 15:25:54.308542 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:25:54.308542 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:25:54.308542 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:25:54.308542 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:25:54.308542 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:25:54.308542 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:25:54.308542 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:25:54.308542 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:25:54.309538 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 15:25:54.309538 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 15:25:54.309538 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 15:25:54.309538 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 15:25:54.309538 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 15:25:54.309538 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 15:25:54.309538 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 15:25:54.309538 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 01 15:25:54.309538 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 402/812] 10.222.0.102 () {56 vars in 1116 bytes} [Mon Aug 1 15:25:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:25:54.310043 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8738aae9-1fb0-45ac-9ce2-90bb1d1c303a None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:54.368922 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:54.413396 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 411/813] 10.222.0.102 () {60 vars in 1149 bytes} [Mon Aug 1 15:25:54 2022] POST /identity/v3/endpoints => generated 329 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:25:54.420987 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e438d836-bbd3-4d0c-8e50-ee6134b149a5 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:54.455884 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8738aae9-1fb0-45ac-9ce2-90bb1d1c303a None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:54.542700 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c328946a-8deb-424a-9bd8-aa28b517fefe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:54.543709 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c328946a-8deb-424a-9bd8-aa28b517fefe None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:54.544209 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c328946a-8deb-424a-9bd8-aa28b517fefe None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:54.544687 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c328946a-8deb-424a-9bd8-aa28b517fefe None admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:54.545985 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c328946a-8deb-424a-9bd8-aa28b517fefe None admin] RBAC: Adding query filter params (name=admin) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:25:54.547055 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c328946a-8deb-424a-9bd8-aa28b517fefe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:54.549058 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c328946a-8deb-424a-9bd8-aa28b517fefe None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:54.565089 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 403/814] 10.222.0.102 () {56 vars in 1104 bytes} [Mon Aug 1 15:25:54 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:54.567769 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c328946a-8deb-424a-9bd8-aa28b517fefe None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:54.587439 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e438d836-bbd3-4d0c-8e50-ee6134b149a5 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:54.625876 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52eecc2-0315-4840-8707-65f227ae104e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:54.626282 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52eecc2-0315-4840-8707-65f227ae104e None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:54.626561 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52eecc2-0315-4840-8707-65f227ae104e None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:54.626832 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52eecc2-0315-4840-8707-65f227ae104e None admin] PATH_INFO: `/v3/projects` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:54.627666 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52eecc2-0315-4840-8707-65f227ae104e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:25:54.627973 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52eecc2-0315-4840-8707-65f227ae104e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:54.629591 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52eecc2-0315-4840-8707-65f227ae104e None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:54.645166 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 412/815] 10.222.0.102 () {56 vars in 1153 bytes} [Mon Aug 1 15:25:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:54.651577 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52eecc2-0315-4840-8707-65f227ae104e None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:54.693318 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:54.702023 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c328946a-8deb-424a-9bd8-aa28b517fefe None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:54.712035 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:54.754442 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b71f161-351c-4fdf-9709-3a3d945c2253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:54.755249 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b71f161-351c-4fdf-9709-3a3d945c2253 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:54.755750 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b71f161-351c-4fdf-9709-3a3d945c2253 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:54.756014 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b71f161-351c-4fdf-9709-3a3d945c2253 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:54.768700 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b71f161-351c-4fdf-9709-3a3d945c2253 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:54.770320 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b71f161-351c-4fdf-9709-3a3d945c2253 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:54.775765 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52eecc2-0315-4840-8707-65f227ae104e None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:54.788181 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-9b71f161-351c-4fdf-9709-3a3d945c2253 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:25:54.788181 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:25:54.788181 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:25:54.788181 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:25:54.788181 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:25:54.788181 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:25:54.788181 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:25:54.788181 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:25:54.788181 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:25:54.788181 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:25:54.788181 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:25:54.788181 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:25:54.788181 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:25:54.788181 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:25:54.788181 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:25:54.789952 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:25:54.789952 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:25:54.789952 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:25:54.789952 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:25:54.789952 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:25:54.789952 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:25:54.789952 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:25:54.789952 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:25:54.789952 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 01 15:25:54.789952 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:25:54.789952 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:25:54.789952 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:25:54.789952 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:25:54.789952 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:25:54.789952 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:25:54.789952 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:25:54.789952 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:25:54.791067 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:25:54.791067 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:25:54.791067 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:25:54.791067 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 01 15:25:54.797123 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 404/816] 10.222.0.102 () {56 vars in 1113 bytes} [Mon Aug 1 15:25:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 15:25:54.798266 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b71f161-351c-4fdf-9709-3a3d945c2253 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:54.817230 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26f0f32-43d2-4368-81a4-4ea23e9595f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:54.818174 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26f0f32-43d2-4368-81a4-4ea23e9595f7 None admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:54.818683 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26f0f32-43d2-4368-81a4-4ea23e9595f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:54.819107 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26f0f32-43d2-4368-81a4-4ea23e9595f7 None admin] PATH_INFO: `/v3/projects/2eb32fbe631843d8be84d41f8ba88d6e/users/90673f47354f4403aa0e12e3658441c8/roles/de1374f966c04c27b579515b54334fd2` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:54.821531 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26f0f32-43d2-4368-81a4-4ea23e9595f7 None admin] RBAC: Authorizing `identity:create_grant(project_id=2eb32fbe631843d8be84d41f8ba88d6e, user_id=90673f47354f4403aa0e12e3658441c8, role_id=de1374f966c04c27b579515b54334fd2)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:54.823181 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26f0f32-43d2-4368-81a4-4ea23e9595f7 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:54.899324 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 413/817] 10.222.0.102 () {58 vars in 1444 bytes} [Mon Aug 1 15:25:54 2022] PUT /identity/v3/projects/2eb32fbe631843d8be84d41f8ba88d6e/users/90673f47354f4403aa0e12e3658441c8/roles/de1374f966c04c27b579515b54334fd2 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:25:54.900581 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3afd98-21da-4c2a-a82b-b52346315201 None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:54.900935 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3afd98-21da-4c2a-a82b-b52346315201 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:54.901177 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3afd98-21da-4c2a-a82b-b52346315201 None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:54.906555 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 414/818] 10.222.0.102 () {54 vars in 931 bytes} [Mon Aug 1 15:25:54 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 15:25:54.908832 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25f12e6-9a21-40bd-9198-610f312b584d None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:54.909177 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25f12e6-9a21-40bd-9198-610f312b584d None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:54.909453 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25f12e6-9a21-40bd-9198-610f312b584d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:54.931083 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b71f161-351c-4fdf-9709-3a3d945c2253 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:54.931975 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-d25f12e6-9a21-40bd-9198-610f312b584d None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:25:54.933762 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-d25f12e6-9a21-40bd-9198-610f312b584d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:25:54.970442 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7e7ffe-67f0-41c8-929c-e388e25a229c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:54.971442 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7e7ffe-67f0-41c8-929c-e388e25a229c None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:54.971946 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7e7ffe-67f0-41c8-929c-e388e25a229c None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:54.972424 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7e7ffe-67f0-41c8-929c-e388e25a229c None admin] PATH_INFO: `/v3/domains` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:54.973433 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7e7ffe-67f0-41c8-929c-e388e25a229c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:25:54.973931 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7e7ffe-67f0-41c8-929c-e388e25a229c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:54.975598 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7e7ffe-67f0-41c8-929c-e388e25a229c None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:54.990682 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 405/819] 10.222.0.102 () {56 vars in 1114 bytes} [Mon Aug 1 15:25:54 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:54.996320 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7e7ffe-67f0-41c8-929c-e388e25a229c None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:55.020930 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 415/820] 10.222.0.102 () {58 vars in 1028 bytes} [Mon Aug 1 15:25:54 2022] POST /identity/v3/auth/tokens => generated 1153 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 15:25:55.041813 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:55.049878 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25f12e6-9a21-40bd-9198-610f312b584d None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:55.082261 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:55.135069 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7e7ffe-67f0-41c8-929c-e388e25a229c None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:55.168648 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25f12e6-9a21-40bd-9198-610f312b584d None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:55.185254 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8054e872-b094-4ba3-9326-510eadca08bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:55.186376 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8054e872-b094-4ba3-9326-510eadca08bb None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:55.186678 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8054e872-b094-4ba3-9326-510eadca08bb None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:55.186959 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8054e872-b094-4ba3-9326-510eadca08bb None admin] PATH_INFO: `/v3/users/nova` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:55.197534 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8054e872-b094-4ba3-9326-510eadca08bb None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:55.199307 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8054e872-b094-4ba3-9326-510eadca08bb None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:55.209283 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea74d71-cb9f-44d0-bf5d-62a8ff1c480d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:55.210122 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea74d71-cb9f-44d0-bf5d-62a8ff1c480d None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:55.210708 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea74d71-cb9f-44d0-bf5d-62a8ff1c480d None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:55.211147 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea74d71-cb9f-44d0-bf5d-62a8ff1c480d None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:55.211937 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea74d71-cb9f-44d0-bf5d-62a8ff1c480d None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:55.213527 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea74d71-cb9f-44d0-bf5d-62a8ff1c480d None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:55.213878 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-8054e872-b094-4ba3-9326-510eadca08bb None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 01 15:25:55.213878 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:25:55.213878 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:25:55.213878 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:25:55.213878 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:25:55.213878 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:25:55.213878 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:25:55.213878 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:25:55.213878 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:25:55.213878 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:25:55.213878 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:25:55.213878 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:25:55.213878 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 15:25:55.213878 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 15:25:55.213878 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 15:25:55.213878 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 15:25:55.215003 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:25:55.215003 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:25:55.215003 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 15:25:55.215003 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 15:25:55.215003 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 15:25:55.215003 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 15:25:55.215003 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:25:55.215003 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:25:55.215003 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:25:55.215003 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:25:55.215003 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:25:55.215003 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 01 15:25:55.215003 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:25:55.215003 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:25:55.215003 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:25:55.215003 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:25:55.215003 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:25:55.215003 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:25:55.220669 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:25:55.220669 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:25:55.220669 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 15:25:55.220669 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 15:25:55.220669 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 15:25:55.220669 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 15:25:55.220669 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 15:25:55.220669 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 15:25:55.220669 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 01 15:25:55.220669 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 01 15:25:55.220669 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 406/821] 10.222.0.102 () {56 vars in 1098 bytes} [Mon Aug 1 15:25:54 2022] GET /identity/v3/users/nova => generated 82 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 15:25:55.222605 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8054e872-b094-4ba3-9326-510eadca08bb None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:55.232623 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-6ea74d71-cb9f-44d0-bf5d-62a8ff1c480d None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 01 15:25:55.232623 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:25:55.232623 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 01 15:25:55.232623 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 01 15:25:55.232623 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 01 15:25:55.232623 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 01 15:25:55.232623 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 01 15:25:55.232623 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 15:25:55.232623 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 01 15:25:55.232623 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 01 15:25:55.232623 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 15:25:55.232623 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 01 15:25:55.232623 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:25:55.232623 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:25:55.232623 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:25:55.232623 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:25:55.233814 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:25:55.233814 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:25:55.233814 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:25:55.233814 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:25:55.233814 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:25:55.233814 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:25:55.233814 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:25:55.233814 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 01 15:25:55.233814 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 01 15:25:55.233814 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 01 15:25:55.233814 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 01 15:25:55.233814 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:25:55.233814 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:25:55.233814 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:25:55.233814 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:25:55.233814 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:25:55.234841 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:25:55.234841 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:25:55.234841 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 01 15:25:55.234841 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:25:55.234841 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:25:55.234841 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:25:55.234841 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:25:55.234841 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:25:55.234841 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:25:55.234841 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:25:55.234841 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:25:55.234841 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 01 15:25:55.234841 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 15:25:55.234841 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 01 15:25:55.234841 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 01 15:25:55.236531 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 416/822] 10.222.0.102 () {56 vars in 1134 bytes} [Mon Aug 1 15:25:55 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 15:25:55.243003 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea74d71-cb9f-44d0-bf5d-62a8ff1c480d None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:55.317407 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:55.340412 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8054e872-b094-4ba3-9326-510eadca08bb None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:55.341601 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:55.352088 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea74d71-cb9f-44d0-bf5d-62a8ff1c480d None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:55.376899 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628aecc8-a1f6-4165-a6a6-acfeb021f040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:55.378080 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628aecc8-a1f6-4165-a6a6-acfeb021f040 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:55.378570 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628aecc8-a1f6-4165-a6a6-acfeb021f040 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:55.378941 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628aecc8-a1f6-4165-a6a6-acfeb021f040 None admin] PATH_INFO: `/v3/users` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:55.379841 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628aecc8-a1f6-4165-a6a6-acfeb021f040 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:25:55.380257 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628aecc8-a1f6-4165-a6a6-acfeb021f040 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:55.382064 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628aecc8-a1f6-4165-a6a6-acfeb021f040 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:55.389082 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16277d13-65e0-4f2e-8225-6511d65ef644 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:55.389778 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16277d13-65e0-4f2e-8225-6511d65ef644 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:55.390125 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16277d13-65e0-4f2e-8225-6511d65ef644 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:55.390460 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16277d13-65e0-4f2e-8225-6511d65ef644 None admin] PATH_INFO: `/v3/services` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:55.391201 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16277d13-65e0-4f2e-8225-6511d65ef644 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:25:55.391615 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16277d13-65e0-4f2e-8225-6511d65ef644 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:55.393006 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16277d13-65e0-4f2e-8225-6511d65ef644 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:55.397567 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 417/823] 10.222.0.102 () {56 vars in 1129 bytes} [Mon Aug 1 15:25:55 2022] GET /identity/v3/services?name=block-storage => generated 131 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:55.399328 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f7dcc3-7299-4237-a01e-41362491f261 None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:55.399614 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f7dcc3-7299-4237-a01e-41362491f261 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:55.399887 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f7dcc3-7299-4237-a01e-41362491f261 None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:55.401267 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 418/824] 10.222.0.102 () {54 vars in 931 bytes} [Mon Aug 1 15:25:55 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 15:25:55.403579 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f7dcc3-7299-4237-a01e-41362491f261 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:55.409955 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 407/825] 10.222.0.102 () {56 vars in 1138 bytes} [Mon Aug 1 15:25:55 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 370 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:25:55.411431 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfec8e94-4ab8-4d8f-a0b4-cdfada3e4b51 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:55.411971 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfec8e94-4ab8-4d8f-a0b4-cdfada3e4b51 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:55.412469 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfec8e94-4ab8-4d8f-a0b4-cdfada3e4b51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:55.431630 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-dfec8e94-4ab8-4d8f-a0b4-cdfada3e4b51 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:25:55.432937 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-dfec8e94-4ab8-4d8f-a0b4-cdfada3e4b51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:25:55.504085 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 408/826] 10.222.0.102 () {58 vars in 1028 bytes} [Mon Aug 1 15:25:55 2022] POST /identity/v3/auth/tokens => generated 1153 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 15:25:55.514214 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfec8e94-4ab8-4d8f-a0b4-cdfada3e4b51 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:55.519180 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f7dcc3-7299-4237-a01e-41362491f261 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:55.554807 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af6c62b-e874-4e8f-bf67-3c40f8263609 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:55.555429 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af6c62b-e874-4e8f-bf67-3c40f8263609 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:55.555714 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af6c62b-e874-4e8f-bf67-3c40f8263609 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:55.555991 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af6c62b-e874-4e8f-bf67-3c40f8263609 None admin] PATH_INFO: `/v3/services` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:55.556667 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af6c62b-e874-4e8f-bf67-3c40f8263609 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:25:55.557016 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af6c62b-e874-4e8f-bf67-3c40f8263609 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:55.558395 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af6c62b-e874-4e8f-bf67-3c40f8263609 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:55.564997 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 419/827] 10.222.0.102 () {56 vars in 1129 bytes} [Mon Aug 1 15:25:55 2022] GET /identity/v3/services?type=block-storage => generated 369 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:25:55.566296 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af6c62b-e874-4e8f-bf67-3c40f8263609 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:55.587267 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:55.593787 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:55.621944 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfec8e94-4ab8-4d8f-a0b4-cdfada3e4b51 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:55.658318 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff39f439-629d-499a-a8b2-29ecde02a598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:55.658943 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff39f439-629d-499a-a8b2-29ecde02a598 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:55.659219 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff39f439-629d-499a-a8b2-29ecde02a598 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:55.659485 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff39f439-629d-499a-a8b2-29ecde02a598 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:55.686934 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af6c62b-e874-4e8f-bf67-3c40f8263609 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:55.725834 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed7d7fb-add2-493a-9648-116a0a6eaa2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:55.726654 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed7d7fb-add2-493a-9648-116a0a6eaa2f None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:55.727071 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed7d7fb-add2-493a-9648-116a0a6eaa2f None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:55.727452 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed7d7fb-add2-493a-9648-116a0a6eaa2f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:55.730932 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff39f439-629d-499a-a8b2-29ecde02a598 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:55.732457 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff39f439-629d-499a-a8b2-29ecde02a598 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:55.738685 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed7d7fb-add2-493a-9648-116a0a6eaa2f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:25:55.743730 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-1ed7d7fb-add2-493a-9648-116a0a6eaa2f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 01 15:25:55.743730 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:25:55.743730 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:25:55.743730 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:25:55.743730 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:25:55.743730 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:25:55.743730 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:25:55.743730 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:25:55.743730 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:25:55.743730 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:25:55.743730 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:25:55.743730 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:25:55.743730 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:25:55.743730 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:25:55.743730 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:25:55.743730 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:25:55.744896 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:25:55.744896 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:25:55.744896 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:25:55.744896 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:25:55.744896 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:25:55.744896 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:25:55.744896 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:25:55.744896 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:25:55.744896 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:25:55.744896 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:25:55.744896 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:25:55.744896 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 01 15:25:55.744896 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:25:55.744896 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:25:55.744896 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:25:55.744896 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:25:55.745809 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:25:55.745809 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:25:55.745809 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:25:55.745809 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:25:55.745809 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:25:55.745809 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:25:55.745809 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:25:55.745809 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:25:55.745809 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:25:55.745809 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:25:55.745809 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 01 15:25:55.745809 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 01 15:25:55.746443 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 420/828] 10.222.0.102 () {56 vars in 1107 bytes} [Mon Aug 1 15:25:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:25:55.747124 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed7d7fb-add2-493a-9648-116a0a6eaa2f None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:55.814713 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:55.831104 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:55.853743 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 409/829] 10.222.0.102 () {58 vars in 1287 bytes} [Mon Aug 1 15:25:55 2022] GET /identity/v3/auth/tokens => generated 1153 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 01 15:25:55.854417 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed7d7fb-add2-493a-9648-116a0a6eaa2f None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:55.855354 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff39f439-629d-499a-a8b2-29ecde02a598 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:55.899965 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96605e7c-2ae5-477e-87ea-fd21bfbd25b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:55.900743 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96605e7c-2ae5-477e-87ea-fd21bfbd25b5 None admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:55.901168 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96605e7c-2ae5-477e-87ea-fd21bfbd25b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:55.901542 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96605e7c-2ae5-477e-87ea-fd21bfbd25b5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:55.902356 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96605e7c-2ae5-477e-87ea-fd21bfbd25b5 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:55.903834 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96605e7c-2ae5-477e-87ea-fd21bfbd25b5 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:55.966570 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff39f439-629d-499a-a8b2-29ecde02a598 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:55.978981 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 421/830] 10.222.0.102 () {60 vars in 1149 bytes} [Mon Aug 1 15:25:55 2022] POST /identity/v3/endpoints => generated 348 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:25:55.980326 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96605e7c-2ae5-477e-87ea-fd21bfbd25b5 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:56.010010 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde2c083-75eb-41c2-96af-ccd6432ec2ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:56.010698 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde2c083-75eb-41c2-96af-ccd6432ec2ac None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:56.010977 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde2c083-75eb-41c2-96af-ccd6432ec2ac None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:56.011248 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde2c083-75eb-41c2-96af-ccd6432ec2ac None admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:56.011969 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde2c083-75eb-41c2-96af-ccd6432ec2ac None admin] RBAC: Adding query filter params (name=service) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:25:56.012327 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde2c083-75eb-41c2-96af-ccd6432ec2ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:56.013945 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde2c083-75eb-41c2-96af-ccd6432ec2ac None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:56.028489 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 410/831] 10.222.0.102 () {56 vars in 1108 bytes} [Mon Aug 1 15:25:55 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:56.030422 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde2c083-75eb-41c2-96af-ccd6432ec2ac None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:56.069266 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:56.147378 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96605e7c-2ae5-477e-87ea-fd21bfbd25b5 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:56.154638 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde2c083-75eb-41c2-96af-ccd6432ec2ac None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:56.193653 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb4cbdf-b52a-407f-889e-1fd9b51ddc4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:56.194700 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb4cbdf-b52a-407f-889e-1fd9b51ddc4c None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:56.195734 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb4cbdf-b52a-407f-889e-1fd9b51ddc4c None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:56.196163 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb4cbdf-b52a-407f-889e-1fd9b51ddc4c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:56.198529 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:56.202152 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74937ff-11b4-45e6-a984-7d0fc78598c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:56.202808 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74937ff-11b4-45e6-a984-7d0fc78598c2 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:56.203092 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74937ff-11b4-45e6-a984-7d0fc78598c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:56.203362 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74937ff-11b4-45e6-a984-7d0fc78598c2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:56.210054 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb4cbdf-b52a-407f-889e-1fd9b51ddc4c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:56.211557 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb4cbdf-b52a-407f-889e-1fd9b51ddc4c None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:56.214627 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74937ff-11b4-45e6-a984-7d0fc78598c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:56.216078 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74937ff-11b4-45e6-a984-7d0fc78598c2 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:56.227470 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-bdb4cbdf-b52a-407f-889e-1fd9b51ddc4c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:25:56.227470 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:25:56.227470 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:25:56.227470 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:25:56.227470 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:25:56.227470 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:25:56.227470 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:25:56.227470 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:25:56.227470 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:25:56.227470 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:25:56.227470 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:25:56.227470 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:25:56.227470 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:25:56.227470 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:25:56.227470 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:25:56.228393 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:25:56.228393 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:25:56.228393 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:25:56.228393 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:25:56.228393 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:25:56.228393 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:25:56.228393 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:25:56.228393 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:25:56.228393 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 01 15:25:56.228393 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:25:56.228393 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:25:56.228393 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:25:56.228393 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:25:56.228393 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:25:56.228393 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:25:56.228393 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:25:56.228393 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:25:56.229389 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:25:56.229389 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:25:56.229389 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:25:56.229389 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 01 15:25:56.229389 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 422/832] 10.222.0.102 () {56 vars in 1113 bytes} [Mon Aug 1 15:25:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:25:56.231316 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-c74937ff-11b4-45e6-a984-7d0fc78598c2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:25:56.231316 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:25:56.231316 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:25:56.231316 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:25:56.231316 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:25:56.231316 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:25:56.231316 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:25:56.231316 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:25:56.231316 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:25:56.231316 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:25:56.231316 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:25:56.231316 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:25:56.231316 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:25:56.231316 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:25:56.231316 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:25:56.232226 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:25:56.232226 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:25:56.232226 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:25:56.232226 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:25:56.232226 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:25:56.232226 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:25:56.232226 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:25:56.232226 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:25:56.232226 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 01 15:25:56.232226 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:25:56.232226 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:25:56.232226 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:25:56.232226 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:25:56.232226 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:25:56.232226 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:25:56.232226 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:25:56.232226 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:25:56.233576 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:25:56.233576 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:25:56.233576 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:25:56.233576 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 01 15:25:56.233576 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 411/833] 10.222.0.102 () {56 vars in 1113 bytes} [Mon Aug 1 15:25:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 15:25:56.238047 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb4cbdf-b52a-407f-889e-1fd9b51ddc4c None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:56.239348 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74937ff-11b4-45e6-a984-7d0fc78598c2 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:56.329283 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:56.349907 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74937ff-11b4-45e6-a984-7d0fc78598c2 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:56.373533 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb4cbdf-b52a-407f-889e-1fd9b51ddc4c None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:56.388108 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd35824e-f9c3-4a1f-9e80-281448956113 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:56.389036 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd35824e-f9c3-4a1f-9e80-281448956113 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:56.389633 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd35824e-f9c3-4a1f-9e80-281448956113 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:56.390066 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd35824e-f9c3-4a1f-9e80-281448956113 None admin] PATH_INFO: `/v3/domains` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:56.391013 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd35824e-f9c3-4a1f-9e80-281448956113 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:25:56.391465 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd35824e-f9c3-4a1f-9e80-281448956113 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:56.393078 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd35824e-f9c3-4a1f-9e80-281448956113 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:56.411158 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 412/834] 10.222.0.102 () {56 vars in 1114 bytes} [Mon Aug 1 15:25:56 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:56.412576 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd35824e-f9c3-4a1f-9e80-281448956113 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:56.415254 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e550f5d5-46a1-4208-96dd-5c7d4c88454c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:56.416048 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e550f5d5-46a1-4208-96dd-5c7d4c88454c None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:56.416425 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e550f5d5-46a1-4208-96dd-5c7d4c88454c None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:56.416977 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e550f5d5-46a1-4208-96dd-5c7d4c88454c None admin] PATH_INFO: `/v3/domains` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:56.418613 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e550f5d5-46a1-4208-96dd-5c7d4c88454c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:25:56.419027 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e550f5d5-46a1-4208-96dd-5c7d4c88454c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:56.420504 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e550f5d5-46a1-4208-96dd-5c7d4c88454c None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:56.436969 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 423/835] 10.222.0.102 () {56 vars in 1114 bytes} [Mon Aug 1 15:25:56 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:25:56.441944 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e550f5d5-46a1-4208-96dd-5c7d4c88454c None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:56.503153 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:56.534341 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd35824e-f9c3-4a1f-9e80-281448956113 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:56.566703 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e550f5d5-46a1-4208-96dd-5c7d4c88454c None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:56.581703 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3820c4ee-ff29-4a46-9840-b24103615532 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:56.582824 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3820c4ee-ff29-4a46-9840-b24103615532 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:56.583105 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3820c4ee-ff29-4a46-9840-b24103615532 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:56.583375 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3820c4ee-ff29-4a46-9840-b24103615532 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:56.588170 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:56.597240 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3820c4ee-ff29-4a46-9840-b24103615532 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:56.599531 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3820c4ee-ff29-4a46-9840-b24103615532 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:56.619201 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-3820c4ee-ff29-4a46-9840-b24103615532 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 15:25:56.619201 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:25:56.619201 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:25:56.619201 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:25:56.619201 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:25:56.619201 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:25:56.619201 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:25:56.619201 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:25:56.619201 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:25:56.619201 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:25:56.619201 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:25:56.619201 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:25:56.619201 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 15:25:56.619201 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 15:25:56.619201 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 15:25:56.620327 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 15:25:56.620327 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:25:56.620327 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:25:56.620327 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:25:56.620327 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:25:56.620327 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:25:56.620327 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:25:56.620327 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:25:56.620327 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 01 15:25:56.620327 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:25:56.620327 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:25:56.620327 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:25:56.620327 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:25:56.620327 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:25:56.620327 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:25:56.620327 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:25:56.620327 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:25:56.621588 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 15:25:56.621588 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 15:25:56.621588 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 15:25:56.621588 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 15:25:56.621588 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 15:25:56.621588 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 15:25:56.621588 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 15:25:56.621588 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 01 15:25:56.623494 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 413/836] 10.222.0.102 () {56 vars in 1116 bytes} [Mon Aug 1 15:25:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:25:56.632262 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ebf2a9-43fe-4356-9e68-7762cdebdcff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:56.641596 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ebf2a9-43fe-4356-9e68-7762cdebdcff None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:56.641947 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ebf2a9-43fe-4356-9e68-7762cdebdcff None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:56.642325 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ebf2a9-43fe-4356-9e68-7762cdebdcff None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:56.643775 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3820c4ee-ff29-4a46-9840-b24103615532 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:56.656638 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ebf2a9-43fe-4356-9e68-7762cdebdcff None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:56.659332 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ebf2a9-43fe-4356-9e68-7762cdebdcff None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:56.681421 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-81ebf2a9-43fe-4356-9e68-7762cdebdcff None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 01 15:25:56.681421 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:25:56.681421 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:25:56.681421 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:25:56.681421 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:25:56.681421 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:25:56.681421 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:25:56.681421 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:25:56.681421 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:25:56.681421 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:25:56.681421 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:25:56.681421 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:25:56.681421 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 15:25:56.681421 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 15:25:56.681421 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 15:25:56.681421 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 15:25:56.682559 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:25:56.682559 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:25:56.682559 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 15:25:56.682559 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 15:25:56.682559 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 15:25:56.682559 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 15:25:56.682559 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:25:56.682559 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:25:56.682559 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:25:56.682559 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:25:56.682559 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:25:56.682559 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 01 15:25:56.682559 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:25:56.682559 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:25:56.682559 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:25:56.682559 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:25:56.682559 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:25:56.682559 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:25:56.683725 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:25:56.683725 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:25:56.683725 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 15:25:56.683725 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 15:25:56.683725 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 15:25:56.683725 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 15:25:56.683725 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 15:25:56.683725 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 15:25:56.683725 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 01 15:25:56.683725 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 01 15:25:56.686775 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 424/837] 10.222.0.102 () {56 vars in 1122 bytes} [Mon Aug 1 15:25:56 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 15:25:56.692053 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ebf2a9-43fe-4356-9e68-7762cdebdcff None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:56.840204 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3820c4ee-ff29-4a46-9840-b24103615532 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:56.880200 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ebf2a9-43fe-4356-9e68-7762cdebdcff None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:56.894746 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:56.919326 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12caa2c-6ae8-49d5-85d0-b26accf4e4ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:56.921815 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12caa2c-6ae8-49d5-85d0-b26accf4e4ea None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:56.923657 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1887fab9-fb03-4207-8586-41d026d06c24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:56.924173 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12caa2c-6ae8-49d5-85d0-b26accf4e4ea None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:56.924461 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1887fab9-fb03-4207-8586-41d026d06c24 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:56.924871 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1887fab9-fb03-4207-8586-41d026d06c24 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:56.925250 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1887fab9-fb03-4207-8586-41d026d06c24 None admin] PATH_INFO: `/v3/users` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:56.925878 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12caa2c-6ae8-49d5-85d0-b26accf4e4ea None admin] PATH_INFO: `/v3/projects` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:56.926234 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1887fab9-fb03-4207-8586-41d026d06c24 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:25:56.926687 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1887fab9-fb03-4207-8586-41d026d06c24 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:56.927972 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12caa2c-6ae8-49d5-85d0-b26accf4e4ea None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:25:56.928346 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1887fab9-fb03-4207-8586-41d026d06c24 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:56.930090 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12caa2c-6ae8-49d5-85d0-b26accf4e4ea None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:56.935117 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12caa2c-6ae8-49d5-85d0-b26accf4e4ea None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:56.948392 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 425/838] 10.222.0.102 () {56 vars in 1154 bytes} [Mon Aug 1 15:25:56 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 386 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:56.953678 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1887fab9-fb03-4207-8586-41d026d06c24 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:56.971257 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 414/839] 10.222.0.102 () {56 vars in 1153 bytes} [Mon Aug 1 15:25:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:56.977185 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12caa2c-6ae8-49d5-85d0-b26accf4e4ea None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:57.081285 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:57.116622 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1887fab9-fb03-4207-8586-41d026d06c24 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:57.129366 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12caa2c-6ae8-49d5-85d0-b26accf4e4ea None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:57.152449 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34889ddc-c2b5-45d7-859a-c20578eeecf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:57.153192 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34889ddc-c2b5-45d7-859a-c20578eeecf9 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:57.153468 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34889ddc-c2b5-45d7-859a-c20578eeecf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:57.153738 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34889ddc-c2b5-45d7-859a-c20578eeecf9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:57.166880 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452d4efe-ed85-4f20-a161-5b5a610986ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:57.167818 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452d4efe-ed85-4f20-a161-5b5a610986ba None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:57.168281 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452d4efe-ed85-4f20-a161-5b5a610986ba None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:57.168529 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452d4efe-ed85-4f20-a161-5b5a610986ba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:57.169364 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452d4efe-ed85-4f20-a161-5b5a610986ba None admin] RBAC: Adding query filter params (role.id=de1374f966c04c27b579515b54334fd2, scope.project.id=2eb32fbe631843d8be84d41f8ba88d6e, user.id=77b43f1ee8cc4be3907a494abe90c1cc) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:25:57.169699 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452d4efe-ed85-4f20-a161-5b5a610986ba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:57.171154 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452d4efe-ed85-4f20-a161-5b5a610986ba None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:57.178283 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 415/840] 10.222.0.102 () {56 vars in 1379 bytes} [Mon Aug 1 15:25:56 2022] GET /identity/v3/role_assignments?user.id=77b43f1ee8cc4be3907a494abe90c1cc&scope.project.id=2eb32fbe631843d8be84d41f8ba88d6e&role.id=de1374f966c04c27b579515b54334fd2 => generated 610 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:25:57.180143 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf80b19a-8406-4855-a215-a4c60f09ae41 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:57.180432 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf80b19a-8406-4855-a215-a4c60f09ae41 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:57.180705 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf80b19a-8406-4855-a215-a4c60f09ae41 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:57.182320 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 416/841] 10.222.0.102 () {54 vars in 931 bytes} [Mon Aug 1 15:25:57 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 15:25:57.188094 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b798474b-5be7-40bb-84a3-a4b77cbf7610 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:57.188377 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b798474b-5be7-40bb-84a3-a4b77cbf7610 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:57.188563 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b798474b-5be7-40bb-84a3-a4b77cbf7610 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:57.207555 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:57.217469 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-b798474b-5be7-40bb-84a3-a4b77cbf7610 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:25:57.219525 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-b798474b-5be7-40bb-84a3-a4b77cbf7610 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:25:57.257782 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34889ddc-c2b5-45d7-859a-c20578eeecf9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:57.259475 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34889ddc-c2b5-45d7-859a-c20578eeecf9 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:57.325315 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 417/842] 10.222.0.102 () {58 vars in 1028 bytes} [Mon Aug 1 15:25:57 2022] POST /identity/v3/auth/tokens => generated 1153 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 01 15:25:57.347013 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b798474b-5be7-40bb-84a3-a4b77cbf7610 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:57.401623 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 426/843] 10.222.0.102 () {58 vars in 1287 bytes} [Mon Aug 1 15:25:56 2022] GET /identity/v3/auth/tokens => generated 1153 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 01 15:25:57.413601 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34889ddc-c2b5-45d7-859a-c20578eeecf9 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:57.426728 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:57.486808 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b798474b-5be7-40bb-84a3-a4b77cbf7610 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:57.496269 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:57.526437 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75680643-7b5b-4b8d-9a4d-511724281a81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:57.527191 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75680643-7b5b-4b8d-9a4d-511724281a81 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:57.527475 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75680643-7b5b-4b8d-9a4d-511724281a81 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:57.527746 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75680643-7b5b-4b8d-9a4d-511724281a81 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:57.539703 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75680643-7b5b-4b8d-9a4d-511724281a81 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:25:57.544324 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34889ddc-c2b5-45d7-859a-c20578eeecf9 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:57.544970 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-75680643-7b5b-4b8d-9a4d-511724281a81 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 15:25:57.544970 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:25:57.544970 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:25:57.544970 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:25:57.544970 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:25:57.544970 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:25:57.544970 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:25:57.544970 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:25:57.544970 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:25:57.544970 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:25:57.544970 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:25:57.544970 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:25:57.544970 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:25:57.544970 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:25:57.544970 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:25:57.544970 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:25:57.545905 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:25:57.545905 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:25:57.545905 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:25:57.545905 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:25:57.545905 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:25:57.545905 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:25:57.545905 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:25:57.545905 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:25:57.545905 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:25:57.545905 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:25:57.545905 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:25:57.545905 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 01 15:25:57.545905 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:25:57.545905 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:25:57.545905 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:25:57.545905 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:25:57.547195 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:25:57.547195 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:25:57.547195 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:25:57.547195 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:25:57.547195 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:25:57.547195 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:25:57.547195 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:25:57.547195 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:25:57.547195 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:25:57.547195 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:25:57.547195 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 15:25:57.547195 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 01 15:25:57.547195 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 418/844] 10.222.0.102 () {56 vars in 1101 bytes} [Mon Aug 1 15:25:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 15:25:57.552997 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75680643-7b5b-4b8d-9a4d-511724281a81 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:57.588534 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3a884d-2c37-4b8e-b2cb-b567e5666a6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:57.589652 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3a884d-2c37-4b8e-b2cb-b567e5666a6a None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:57.589959 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3a884d-2c37-4b8e-b2cb-b567e5666a6a None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:57.590562 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3a884d-2c37-4b8e-b2cb-b567e5666a6a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:57.604732 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3a884d-2c37-4b8e-b2cb-b567e5666a6a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:57.606393 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3a884d-2c37-4b8e-b2cb-b567e5666a6a None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:57.625328 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-ac3a884d-2c37-4b8e-b2cb-b567e5666a6a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:25:57.625328 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:25:57.625328 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:25:57.625328 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:25:57.625328 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:25:57.625328 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:25:57.625328 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:25:57.625328 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:25:57.625328 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:25:57.625328 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:25:57.625328 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:25:57.625328 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:25:57.625328 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:25:57.625328 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:25:57.625328 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:25:57.627406 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:25:57.627406 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:25:57.627406 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:25:57.627406 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:25:57.627406 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:25:57.627406 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:25:57.627406 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:25:57.627406 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:25:57.627406 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 01 15:25:57.627406 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:25:57.627406 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:25:57.627406 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:25:57.627406 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:25:57.627406 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:25:57.627406 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:25:57.627406 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:25:57.627406 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:25:57.629636 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:25:57.629636 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:25:57.629636 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:25:57.629636 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 01 15:25:57.629636 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 427/845] 10.222.0.102 () {56 vars in 1113 bytes} [Mon Aug 1 15:25:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 15:25:57.632821 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3a884d-2c37-4b8e-b2cb-b567e5666a6a None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:57.675589 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75680643-7b5b-4b8d-9a4d-511724281a81 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:57.691531 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:57.723386 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758e0e05-dc25-49b7-95bf-0e93abd60d2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:57.724964 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758e0e05-dc25-49b7-95bf-0e93abd60d2b None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:57.725482 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758e0e05-dc25-49b7-95bf-0e93abd60d2b None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:57.725983 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758e0e05-dc25-49b7-95bf-0e93abd60d2b None admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:57.726955 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758e0e05-dc25-49b7-95bf-0e93abd60d2b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:25:57.727583 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758e0e05-dc25-49b7-95bf-0e93abd60d2b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:57.729701 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758e0e05-dc25-49b7-95bf-0e93abd60d2b None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:57.746080 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 419/846] 10.222.0.102 () {56 vars in 1104 bytes} [Mon Aug 1 15:25:57 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:25:57.747768 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758e0e05-dc25-49b7-95bf-0e93abd60d2b None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:57.778466 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3a884d-2c37-4b8e-b2cb-b567e5666a6a None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:57.796293 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:57.815113 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65157c1-6909-49df-8bbe-09945d148c58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:57.815870 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65157c1-6909-49df-8bbe-09945d148c58 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:57.824333 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65157c1-6909-49df-8bbe-09945d148c58 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:57.824333 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65157c1-6909-49df-8bbe-09945d148c58 None admin] PATH_INFO: `/v3/domains` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:57.824333 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65157c1-6909-49df-8bbe-09945d148c58 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:25:57.824333 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65157c1-6909-49df-8bbe-09945d148c58 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:57.824333 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65157c1-6909-49df-8bbe-09945d148c58 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:57.832790 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 428/847] 10.222.0.102 () {56 vars in 1114 bytes} [Mon Aug 1 15:25:57 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:57.842131 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65157c1-6909-49df-8bbe-09945d148c58 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:57.863211 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758e0e05-dc25-49b7-95bf-0e93abd60d2b None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:57.908968 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950805c5-8e56-4441-8292-54fd814a5bdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:57.909723 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950805c5-8e56-4441-8292-54fd814a5bdd None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:57.910135 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950805c5-8e56-4441-8292-54fd814a5bdd None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:57.910507 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950805c5-8e56-4441-8292-54fd814a5bdd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:57.921957 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950805c5-8e56-4441-8292-54fd814a5bdd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:57.923821 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950805c5-8e56-4441-8292-54fd814a5bdd None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:57.938706 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-950805c5-8e56-4441-8292-54fd814a5bdd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:25:57.938706 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:25:57.938706 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:25:57.938706 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:25:57.938706 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:25:57.938706 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:25:57.938706 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:25:57.938706 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:25:57.938706 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:25:57.938706 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:25:57.938706 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:25:57.938706 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:25:57.938706 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:25:57.938706 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:25:57.938706 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:25:57.939842 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:25:57.939842 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:25:57.939842 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:25:57.939842 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:25:57.939842 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:25:57.939842 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:25:57.939842 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:25:57.939842 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:25:57.939842 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 01 15:25:57.939842 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:25:57.939842 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:25:57.939842 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:25:57.939842 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:25:57.939842 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:25:57.939842 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:25:57.939842 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:25:57.939842 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:25:57.940991 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:25:57.940991 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:25:57.940991 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:25:57.940991 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 01 15:25:57.947418 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 420/848] 10.222.0.102 () {56 vars in 1113 bytes} [Mon Aug 1 15:25:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:25:57.948572 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950805c5-8e56-4441-8292-54fd814a5bdd None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:57.981693 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65157c1-6909-49df-8bbe-09945d148c58 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:57.985617 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:58.021997 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c019f8b5-6153-4b39-9902-9d2c934a6cd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:58.022674 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c019f8b5-6153-4b39-9902-9d2c934a6cd6 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:58.023012 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c019f8b5-6153-4b39-9902-9d2c934a6cd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:58.023886 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c019f8b5-6153-4b39-9902-9d2c934a6cd6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:58.031667 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c019f8b5-6153-4b39-9902-9d2c934a6cd6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:58.033270 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c019f8b5-6153-4b39-9902-9d2c934a6cd6 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:58.045802 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-c019f8b5-6153-4b39-9902-9d2c934a6cd6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 15:25:58.045802 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:25:58.045802 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:25:58.045802 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:25:58.045802 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:25:58.045802 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:25:58.045802 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:25:58.045802 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:25:58.045802 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:25:58.045802 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:25:58.045802 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:25:58.045802 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:25:58.045802 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 15:25:58.045802 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 15:25:58.045802 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 15:25:58.046758 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 15:25:58.046758 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:25:58.046758 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:25:58.046758 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:25:58.046758 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:25:58.046758 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:25:58.046758 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:25:58.046758 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:25:58.046758 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 01 15:25:58.046758 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:25:58.046758 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:25:58.046758 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:25:58.046758 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:25:58.046758 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:25:58.046758 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:25:58.046758 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:25:58.046758 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:25:58.047642 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 15:25:58.047642 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 15:25:58.047642 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 15:25:58.047642 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 15:25:58.047642 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 15:25:58.047642 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 15:25:58.047642 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 15:25:58.047642 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 01 15:25:58.051743 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 429/849] 10.222.0.102 () {56 vars in 1116 bytes} [Mon Aug 1 15:25:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:25:58.053246 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c019f8b5-6153-4b39-9902-9d2c934a6cd6 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:58.089003 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950805c5-8e56-4441-8292-54fd814a5bdd None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:58.093772 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:58.126614 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61a3262-0501-4c13-bf49-a5f81e6f7f93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:58.127418 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61a3262-0501-4c13-bf49-a5f81e6f7f93 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:58.127700 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61a3262-0501-4c13-bf49-a5f81e6f7f93 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:58.128458 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61a3262-0501-4c13-bf49-a5f81e6f7f93 None admin] PATH_INFO: `/v3/domains` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:58.129244 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61a3262-0501-4c13-bf49-a5f81e6f7f93 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:25:58.129514 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61a3262-0501-4c13-bf49-a5f81e6f7f93 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:58.130849 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61a3262-0501-4c13-bf49-a5f81e6f7f93 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:58.147879 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 421/850] 10.222.0.102 () {56 vars in 1114 bytes} [Mon Aug 1 15:25:57 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:58.147879 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e201c2-4bb5-4720-8ed2-dd96fad761ba None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:58.147879 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e201c2-4bb5-4720-8ed2-dd96fad761ba None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:58.147879 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e201c2-4bb5-4720-8ed2-dd96fad761ba None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:58.147879 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 422/851] 10.222.0.102 () {54 vars in 931 bytes} [Mon Aug 1 15:25:58 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 15:25:58.149667 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e201c2-4bb5-4720-8ed2-dd96fad761ba None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:58.169771 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c019f8b5-6153-4b39-9902-9d2c934a6cd6 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:58.207806 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85681dbf-1899-4120-a29b-78e9779b4c1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:58.208407 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85681dbf-1899-4120-a29b-78e9779b4c1e None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:58.208686 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85681dbf-1899-4120-a29b-78e9779b4c1e None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:58.208990 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85681dbf-1899-4120-a29b-78e9779b4c1e None admin] PATH_INFO: `/v3/projects` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:58.209861 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85681dbf-1899-4120-a29b-78e9779b4c1e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:25:58.210172 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85681dbf-1899-4120-a29b-78e9779b4c1e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:58.211749 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85681dbf-1899-4120-a29b-78e9779b4c1e None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:58.228870 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 430/852] 10.222.0.102 () {56 vars in 1153 bytes} [Mon Aug 1 15:25:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:25:58.228870 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd079a2-a1db-413c-8aed-368bde3308ac None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:58.228870 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd079a2-a1db-413c-8aed-368bde3308ac None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:58.228870 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd079a2-a1db-413c-8aed-368bde3308ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:58.240009 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:58.245580 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-abd079a2-a1db-413c-8aed-368bde3308ac None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:25:58.246782 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-abd079a2-a1db-413c-8aed-368bde3308ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:25:58.258332 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e201c2-4bb5-4720-8ed2-dd96fad761ba None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:58.296966 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81250d8-0206-45e3-9798-17261010e8d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:58.297517 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81250d8-0206-45e3-9798-17261010e8d4 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:58.297796 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81250d8-0206-45e3-9798-17261010e8d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:58.298067 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81250d8-0206-45e3-9798-17261010e8d4 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:58.306979 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81250d8-0206-45e3-9798-17261010e8d4 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:58.308419 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81250d8-0206-45e3-9798-17261010e8d4 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:58.320468 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-f81250d8-0206-45e3-9798-17261010e8d4 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 01 15:25:58.320468 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:25:58.320468 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:25:58.320468 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:25:58.320468 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:25:58.320468 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:25:58.320468 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:25:58.320468 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:25:58.320468 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:25:58.320468 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:25:58.320468 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:25:58.320468 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:25:58.320468 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 15:25:58.320468 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 15:25:58.320468 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 15:25:58.320468 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 15:25:58.321418 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:25:58.321418 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:25:58.321418 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 15:25:58.321418 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 15:25:58.321418 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 15:25:58.321418 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 15:25:58.321418 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:25:58.321418 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:25:58.321418 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:25:58.321418 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:25:58.321418 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:25:58.321418 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 01 15:25:58.321418 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:25:58.321418 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:25:58.321418 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:25:58.321418 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:25:58.321418 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:25:58.321418 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:25:58.322358 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:25:58.322358 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:25:58.322358 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 15:25:58.322358 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 15:25:58.322358 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 15:25:58.322358 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 15:25:58.322358 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 15:25:58.322358 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 15:25:58.322358 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 01 15:25:58.322358 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 01 15:25:58.322358 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 423/853] 10.222.0.102 () {56 vars in 1101 bytes} [Mon Aug 1 15:25:58 2022] GET /identity/v3/users/swift => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:25:58.322358 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81250d8-0206-45e3-9798-17261010e8d4 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:58.333261 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 431/854] 10.222.0.102 () {58 vars in 1028 bytes} [Mon Aug 1 15:25:58 2022] POST /identity/v3/auth/tokens => generated 1153 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 15:25:58.333973 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd079a2-a1db-413c-8aed-368bde3308ac None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:58.361978 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:58.440354 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd079a2-a1db-413c-8aed-368bde3308ac None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:58.449709 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81250d8-0206-45e3-9798-17261010e8d4 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:58.475731 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab14dd3-4439-4b8f-900e-29903fd72260 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:58.476890 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab14dd3-4439-4b8f-900e-29903fd72260 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:58.477237 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab14dd3-4439-4b8f-900e-29903fd72260 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:58.477507 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab14dd3-4439-4b8f-900e-29903fd72260 None admin] PATH_INFO: `/v3/users` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:58.478294 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab14dd3-4439-4b8f-900e-29903fd72260 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:25:58.478593 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab14dd3-4439-4b8f-900e-29903fd72260 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:58.480030 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab14dd3-4439-4b8f-900e-29903fd72260 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:58.490005 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7692e3b6-90f0-43cf-8a9a-71647ef102d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:58.490615 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7692e3b6-90f0-43cf-8a9a-71647ef102d8 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:58.490891 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7692e3b6-90f0-43cf-8a9a-71647ef102d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:58.491160 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7692e3b6-90f0-43cf-8a9a-71647ef102d8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:58.492515 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7692e3b6-90f0-43cf-8a9a-71647ef102d8 None admin] RBAC: Adding query filter params (role.id=3087c03acf8d44d9ae512385924c5d0d, scope.project.id=2eb32fbe631843d8be84d41f8ba88d6e, user.id=ae8514df55144c9086ed98ba44efbbd4) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:25:58.492823 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7692e3b6-90f0-43cf-8a9a-71647ef102d8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:58.494288 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7692e3b6-90f0-43cf-8a9a-71647ef102d8 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:58.502552 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 432/855] 10.222.0.102 () {56 vars in 1140 bytes} [Mon Aug 1 15:25:58 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 372 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:58.502552 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab14dd3-4439-4b8f-900e-29903fd72260 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:58.505358 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 424/856] 10.222.0.102 () {56 vars in 1379 bytes} [Mon Aug 1 15:25:58 2022] GET /identity/v3/role_assignments?user.id=ae8514df55144c9086ed98ba44efbbd4&scope.project.id=2eb32fbe631843d8be84d41f8ba88d6e&role.id=3087c03acf8d44d9ae512385924c5d0d => generated 610 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:58.512930 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7692e3b6-90f0-43cf-8a9a-71647ef102d8 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:58.523025 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:58.603838 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:58.622036 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab14dd3-4439-4b8f-900e-29903fd72260 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:58.639805 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7692e3b6-90f0-43cf-8a9a-71647ef102d8 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:58.660118 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3d2ad4-8076-4e8f-bb0b-0ccb6df417ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:58.661106 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3d2ad4-8076-4e8f-bb0b-0ccb6df417ab None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:58.661220 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3d2ad4-8076-4e8f-bb0b-0ccb6df417ab None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:58.661566 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3d2ad4-8076-4e8f-bb0b-0ccb6df417ab None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:58.662264 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3d2ad4-8076-4e8f-bb0b-0ccb6df417ab None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:58.664381 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3d2ad4-8076-4e8f-bb0b-0ccb6df417ab None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:58.674807 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-bb3d2ad4-8076-4e8f-bb0b-0ccb6df417ab None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 01 15:25:58.674807 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:25:58.674807 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 01 15:25:58.674807 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 01 15:25:58.674807 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 01 15:25:58.674807 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 01 15:25:58.674807 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 01 15:25:58.674807 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 15:25:58.674807 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 01 15:25:58.674807 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 01 15:25:58.674807 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 15:25:58.674807 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 01 15:25:58.674807 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:25:58.674807 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:25:58.674807 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:25:58.674807 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:25:58.674807 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:25:58.675970 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:25:58.675970 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:25:58.675970 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:25:58.675970 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:25:58.675970 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:25:58.675970 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:25:58.675970 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 01 15:25:58.675970 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 01 15:25:58.675970 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 01 15:25:58.675970 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 01 15:25:58.675970 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:25:58.675970 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:25:58.675970 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:25:58.675970 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:25:58.675970 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:25:58.675970 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:25:58.677033 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:25:58.677033 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 01 15:25:58.677033 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:25:58.677033 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:25:58.677033 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:25:58.677033 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:25:58.677033 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:25:58.677033 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:25:58.677033 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:25:58.677033 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:25:58.677033 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 01 15:25:58.677033 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 15:25:58.677033 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 01 15:25:58.677033 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 01 15:25:58.679136 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 433/857] 10.222.0.102 () {56 vars in 1119 bytes} [Mon Aug 1 15:25:58 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:25:58.683766 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3d2ad4-8076-4e8f-bb0b-0ccb6df417ab None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:58.687934 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa204bb-d88e-4fd0-833a-a508a4d3afd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:58.688654 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa204bb-d88e-4fd0-833a-a508a4d3afd4 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:58.689020 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa204bb-d88e-4fd0-833a-a508a4d3afd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:58.694903 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa204bb-d88e-4fd0-833a-a508a4d3afd4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:58.784027 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa204bb-d88e-4fd0-833a-a508a4d3afd4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:58.785530 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa204bb-d88e-4fd0-833a-a508a4d3afd4 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:58.798019 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:58.811282 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3d2ad4-8076-4e8f-bb0b-0ccb6df417ab None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:58.857082 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f70a4cd-1a8e-461a-b682-2fef0f89482b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:58.857624 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f70a4cd-1a8e-461a-b682-2fef0f89482b None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:58.858157 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f70a4cd-1a8e-461a-b682-2fef0f89482b None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:58.858438 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f70a4cd-1a8e-461a-b682-2fef0f89482b None admin] PATH_INFO: `/v3/services` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:58.859549 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f70a4cd-1a8e-461a-b682-2fef0f89482b None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:25:58.860133 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f70a4cd-1a8e-461a-b682-2fef0f89482b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:58.862269 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f70a4cd-1a8e-461a-b682-2fef0f89482b None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:58.868944 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 434/858] 10.222.0.102 () {56 vars in 1119 bytes} [Mon Aug 1 15:25:58 2022] GET /identity/v3/services?name=volumev3 => generated 126 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:58.878485 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f70a4cd-1a8e-461a-b682-2fef0f89482b None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:58.900762 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:58.926107 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 425/859] 10.222.0.102 () {58 vars in 1287 bytes} [Mon Aug 1 15:25:58 2022] GET /identity/v3/auth/tokens => generated 1153 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 01 15:25:58.927779 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa204bb-d88e-4fd0-833a-a508a4d3afd4 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:59.002187 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f70a4cd-1a8e-461a-b682-2fef0f89482b None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:59.042107 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a087c2-2f48-4c21-94b4-db5a40149b25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:59.042732 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a087c2-2f48-4c21-94b4-db5a40149b25 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:59.043011 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a087c2-2f48-4c21-94b4-db5a40149b25 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:59.043285 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a087c2-2f48-4c21-94b4-db5a40149b25 None admin] PATH_INFO: `/v3/services` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:59.044218 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a087c2-2f48-4c21-94b4-db5a40149b25 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:25:59.044527 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a087c2-2f48-4c21-94b4-db5a40149b25 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:59.046625 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a087c2-2f48-4c21-94b4-db5a40149b25 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:59.054646 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa204bb-d88e-4fd0-833a-a508a4d3afd4 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:59.056929 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 435/860] 10.222.0.102 () {56 vars in 1119 bytes} [Mon Aug 1 15:25:58 2022] GET /identity/v3/services?type=volumev3 => generated 126 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:59.072719 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:59.100862 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e983aad4-9fe5-4954-947f-86662c433ed0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:59.102260 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e983aad4-9fe5-4954-947f-86662c433ed0 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:59.102545 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e983aad4-9fe5-4954-947f-86662c433ed0 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:59.102818 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e983aad4-9fe5-4954-947f-86662c433ed0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:59.115048 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e983aad4-9fe5-4954-947f-86662c433ed0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:59.116512 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e983aad4-9fe5-4954-947f-86662c433ed0 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:59.133415 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-e983aad4-9fe5-4954-947f-86662c433ed0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:25:59.133415 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:25:59.133415 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:25:59.133415 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:25:59.133415 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:25:59.133415 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:25:59.133415 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:25:59.133415 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:25:59.133415 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:25:59.133415 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:25:59.133415 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:25:59.133415 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:25:59.133415 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:25:59.133415 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:25:59.133415 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:25:59.134484 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:25:59.134484 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:25:59.134484 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:25:59.134484 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:25:59.134484 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:25:59.134484 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:25:59.134484 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:25:59.134484 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:25:59.134484 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 01 15:25:59.134484 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:25:59.134484 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:25:59.134484 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:25:59.134484 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:25:59.134484 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:25:59.134484 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:25:59.134484 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:25:59.134484 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:25:59.135379 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:25:59.135379 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:25:59.135379 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:25:59.135379 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 01 15:25:59.135379 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 426/861] 10.222.0.102 () {56 vars in 1113 bytes} [Mon Aug 1 15:25:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 15:25:59.140816 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a087c2-2f48-4c21-94b4-db5a40149b25 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:59.230181 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:59.258996 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a087c2-2f48-4c21-94b4-db5a40149b25 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:59.296151 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86c8d6e-e235-4b25-a012-17f4f97db0a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:59.296838 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86c8d6e-e235-4b25-a012-17f4f97db0a9 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:59.297141 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86c8d6e-e235-4b25-a012-17f4f97db0a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:59.297414 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86c8d6e-e235-4b25-a012-17f4f97db0a9 None admin] PATH_INFO: `/v3/domains` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:59.298116 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86c8d6e-e235-4b25-a012-17f4f97db0a9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:25:59.298420 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86c8d6e-e235-4b25-a012-17f4f97db0a9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:59.299805 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86c8d6e-e235-4b25-a012-17f4f97db0a9 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:59.313730 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 436/862] 10.222.0.102 () {56 vars in 1114 bytes} [Mon Aug 1 15:25:59 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:59.319185 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e983aad4-9fe5-4954-947f-86662c433ed0 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:59.335243 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c949d0c-d2fd-44be-bd8e-110e5b89c244 None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:59.335243 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c949d0c-d2fd-44be-bd8e-110e5b89c244 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:59.335243 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c949d0c-d2fd-44be-bd8e-110e5b89c244 None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:59.336752 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 437/863] 10.222.0.102 () {54 vars in 931 bytes} [Mon Aug 1 15:25:59 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 01 15:25:59.341688 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3120b24-3d5b-4550-951f-11c1e52e3649 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:59.341978 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3120b24-3d5b-4550-951f-11c1e52e3649 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:59.342254 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3120b24-3d5b-4550-951f-11c1e52e3649 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:59.360915 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-d3120b24-3d5b-4550-951f-11c1e52e3649 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:25:59.362177 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-d3120b24-3d5b-4550-951f-11c1e52e3649 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:25:59.443382 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 438/864] 10.222.0.102 () {58 vars in 1028 bytes} [Mon Aug 1 15:25:59 2022] POST /identity/v3/auth/tokens => generated 1153 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 01 15:25:59.448126 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e983aad4-9fe5-4954-947f-86662c433ed0 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:59.467975 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3120b24-3d5b-4550-951f-11c1e52e3649 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:59.496595 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c1506a-6de8-4fbb-8171-619fd4881d8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:59.497746 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c1506a-6de8-4fbb-8171-619fd4881d8a None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:59.498326 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c1506a-6de8-4fbb-8171-619fd4881d8a None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:59.498755 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c1506a-6de8-4fbb-8171-619fd4881d8a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:59.508023 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c1506a-6de8-4fbb-8171-619fd4881d8a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:59.510071 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c1506a-6de8-4fbb-8171-619fd4881d8a None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:59.526797 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-62c1506a-6de8-4fbb-8171-619fd4881d8a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 15:25:59.526797 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:25:59.526797 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:25:59.526797 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:25:59.526797 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:25:59.526797 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:25:59.526797 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:25:59.526797 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:25:59.526797 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:25:59.526797 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:25:59.526797 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:25:59.526797 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:25:59.526797 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 15:25:59.526797 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 15:25:59.526797 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 15:25:59.527911 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 15:25:59.527911 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:25:59.527911 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:25:59.527911 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:25:59.527911 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:25:59.527911 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:25:59.527911 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:25:59.527911 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:25:59.527911 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 01 15:25:59.527911 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:25:59.527911 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:25:59.527911 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:25:59.527911 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:25:59.527911 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:25:59.527911 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:25:59.527911 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:25:59.527911 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:25:59.529067 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 15:25:59.529067 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 15:25:59.529067 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 15:25:59.529067 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 15:25:59.529067 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 15:25:59.529067 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 15:25:59.529067 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 15:25:59.529067 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 01 15:25:59.535639 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 427/865] 10.222.0.102 () {56 vars in 1116 bytes} [Mon Aug 1 15:25:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:25:59.537678 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c1506a-6de8-4fbb-8171-619fd4881d8a None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:59.546708 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:59.568289 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:59.583666 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3120b24-3d5b-4550-951f-11c1e52e3649 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:59.630064 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3993b38-8d82-41df-8274-7b9b92ef519e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:59.630696 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3993b38-8d82-41df-8274-7b9b92ef519e None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:59.630983 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3993b38-8d82-41df-8274-7b9b92ef519e None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:59.631256 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3993b38-8d82-41df-8274-7b9b92ef519e None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:59.631885 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3993b38-8d82-41df-8274-7b9b92ef519e None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:59.633887 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3993b38-8d82-41df-8274-7b9b92ef519e None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:59.646523 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-b3993b38-8d82-41df-8274-7b9b92ef519e None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 01 15:25:59.646523 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:25:59.646523 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 01 15:25:59.646523 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 01 15:25:59.646523 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 01 15:25:59.646523 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 01 15:25:59.646523 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 01 15:25:59.646523 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 15:25:59.646523 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 01 15:25:59.646523 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 01 15:25:59.646523 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 15:25:59.646523 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 01 15:25:59.646523 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:25:59.646523 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:25:59.646523 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:25:59.646523 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:25:59.647722 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:25:59.647722 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:25:59.647722 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:25:59.647722 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:25:59.647722 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:25:59.647722 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:25:59.647722 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:25:59.647722 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 01 15:25:59.647722 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 01 15:25:59.647722 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 01 15:25:59.647722 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 01 15:25:59.647722 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:25:59.647722 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:25:59.647722 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:25:59.647722 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:25:59.647722 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:25:59.648691 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:25:59.648691 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:25:59.648691 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 01 15:25:59.648691 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:25:59.648691 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:25:59.648691 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:25:59.648691 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:25:59.648691 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:25:59.648691 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:25:59.648691 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:25:59.648691 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:25:59.648691 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 01 15:25:59.648691 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 15:25:59.648691 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 01 15:25:59.648691 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 01 15:25:59.653156 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 439/866] 10.222.0.102 () {56 vars in 1137 bytes} [Mon Aug 1 15:25:59 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:25:59.653921 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3993b38-8d82-41df-8274-7b9b92ef519e None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:59.665954 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c1506a-6de8-4fbb-8171-619fd4881d8a None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:59.705250 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6a367a-0e5a-4a84-a2d0-25583b929284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:59.706119 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6a367a-0e5a-4a84-a2d0-25583b929284 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:59.706545 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6a367a-0e5a-4a84-a2d0-25583b929284 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:59.706912 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6a367a-0e5a-4a84-a2d0-25583b929284 None admin] PATH_INFO: `/v3/projects` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:59.707800 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6a367a-0e5a-4a84-a2d0-25583b929284 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:25:59.708205 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6a367a-0e5a-4a84-a2d0-25583b929284 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:59.709754 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6a367a-0e5a-4a84-a2d0-25583b929284 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:59.723424 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 428/867] 10.222.0.102 () {56 vars in 1153 bytes} [Mon Aug 1 15:25:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:59.728822 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6a367a-0e5a-4a84-a2d0-25583b929284 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:59.786695 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3993b38-8d82-41df-8274-7b9b92ef519e None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:59.818905 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:59.827799 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f3f1c4-59db-493d-8a5f-7e458d7e3955 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:59.828447 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f3f1c4-59db-493d-8a5f-7e458d7e3955 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:59.828730 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f3f1c4-59db-493d-8a5f-7e458d7e3955 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:59.829040 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f3f1c4-59db-493d-8a5f-7e458d7e3955 None admin] PATH_INFO: `/v3/services` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:59.829740 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f3f1c4-59db-493d-8a5f-7e458d7e3955 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:25:59.830048 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f3f1c4-59db-493d-8a5f-7e458d7e3955 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:59.831881 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f3f1c4-59db-493d-8a5f-7e458d7e3955 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:59.840372 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 440/868] 10.222.0.102 () {56 vars in 1131 bytes} [Mon Aug 1 15:25:59 2022] GET /identity/v3/services?name=compute_legacy => generated 132 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:59.846124 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f3f1c4-59db-493d-8a5f-7e458d7e3955 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:25:59.858422 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:59.885593 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6a367a-0e5a-4a84-a2d0-25583b929284 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:25:59.932998 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab8eda9-faf8-418b-a5f8-4095f084b611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:25:59.933639 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab8eda9-faf8-418b-a5f8-4095f084b611 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:25:59.933915 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab8eda9-faf8-418b-a5f8-4095f084b611 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:25:59.934180 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab8eda9-faf8-418b-a5f8-4095f084b611 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:25:59.934962 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab8eda9-faf8-418b-a5f8-4095f084b611 None admin] RBAC: Adding query filter params (role.id=de1374f966c04c27b579515b54334fd2, scope.project.id=2eb32fbe631843d8be84d41f8ba88d6e, user.id=90673f47354f4403aa0e12e3658441c8) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:25:59.935336 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab8eda9-faf8-418b-a5f8-4095f084b611 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:25:59.936796 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab8eda9-faf8-418b-a5f8-4095f084b611 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:25:59.953241 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 429/869] 10.222.0.102 () {56 vars in 1379 bytes} [Mon Aug 1 15:25:59 2022] GET /identity/v3/role_assignments?user.id=90673f47354f4403aa0e12e3658441c8&scope.project.id=2eb32fbe631843d8be84d41f8ba88d6e&role.id=de1374f966c04c27b579515b54334fd2 => generated 610 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:25:59.978577 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f3f1c4-59db-493d-8a5f-7e458d7e3955 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:26:00.018924 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6005e241-ad82-4034-84b8-3850602f28ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:26:00.019759 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6005e241-ad82-4034-84b8-3850602f28ed None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:00.020034 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6005e241-ad82-4034-84b8-3850602f28ed None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:00.020303 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6005e241-ad82-4034-84b8-3850602f28ed None admin] PATH_INFO: `/v3/services` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:00.021034 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6005e241-ad82-4034-84b8-3850602f28ed None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:26:00.021417 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6005e241-ad82-4034-84b8-3850602f28ed None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:26:00.022928 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6005e241-ad82-4034-84b8-3850602f28ed None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:26:00.034305 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 441/870] 10.222.0.102 () {56 vars in 1131 bytes} [Mon Aug 1 15:25:59 2022] GET /identity/v3/services?type=compute_legacy => generated 132 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:26:00.744083 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df67c3fb-3be5-4ada-bd79-3b4ca3c830fe None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:00.744598 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df67c3fb-3be5-4ada-bd79-3b4ca3c830fe None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:00.744598 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df67c3fb-3be5-4ada-bd79-3b4ca3c830fe None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:00.746378 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 430/871] 10.222.0.102 () {54 vars in 931 bytes} [Mon Aug 1 15:26:00 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 15:26:00.751769 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8426846e-2527-4562-bdee-def7f4a3d0eb None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:00.752174 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8426846e-2527-4562-bdee-def7f4a3d0eb None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:00.752345 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8426846e-2527-4562-bdee-def7f4a3d0eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:00.771939 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-8426846e-2527-4562-bdee-def7f4a3d0eb None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:26:00.773703 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-8426846e-2527-4562-bdee-def7f4a3d0eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:26:00.832373 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:26:00.848245 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 442/872] 10.222.0.102 () {58 vars in 1028 bytes} [Mon Aug 1 15:26:00 2022] POST /identity/v3/auth/tokens => generated 1153 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 15:26:00.870733 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df67c3fb-3be5-4ada-bd79-3b4ca3c830fe None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:26:00.988050 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df67c3fb-3be5-4ada-bd79-3b4ca3c830fe None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:26:01.024132 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5924a836-c618-4501-a201-17f0022bc780 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:26:01.024713 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5924a836-c618-4501-a201-17f0022bc780 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:01.025078 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5924a836-c618-4501-a201-17f0022bc780 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:01.025352 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5924a836-c618-4501-a201-17f0022bc780 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:01.036000 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5924a836-c618-4501-a201-17f0022bc780 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:26:01.040885 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-5924a836-c618-4501-a201-17f0022bc780 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 01 15:26:01.040885 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:26:01.040885 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:26:01.040885 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:26:01.040885 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:26:01.040885 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:26:01.040885 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:26:01.040885 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:26:01.040885 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:26:01.040885 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:26:01.040885 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:26:01.040885 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:26:01.040885 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:26:01.040885 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:26:01.040885 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:26:01.040885 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:26:01.041832 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:26:01.041832 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:26:01.041832 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:26:01.041832 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:26:01.041832 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:26:01.041832 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:26:01.041832 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:26:01.041832 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:26:01.041832 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:26:01.041832 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:26:01.041832 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:26:01.041832 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 01 15:26:01.041832 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:26:01.041832 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:26:01.041832 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:26:01.041832 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:26:01.043098 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:26:01.043098 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:26:01.043098 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:26:01.043098 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:26:01.043098 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:26:01.043098 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:26:01.043098 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:26:01.043098 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:26:01.043098 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:26:01.043098 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:26:01.043098 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 01 15:26:01.043098 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 01 15:26:01.043098 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 431/873] 10.222.0.102 () {56 vars in 1125 bytes} [Mon Aug 1 15:26:00 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:26:01.050024 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8426846e-2527-4562-bdee-def7f4a3d0eb None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:26:01.151486 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1dfa46-9213-4449-87a3-fc4482b76d72 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:01.151809 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1dfa46-9213-4449-87a3-fc4482b76d72 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:01.152028 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1dfa46-9213-4449-87a3-fc4482b76d72 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:01.154474 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 432/874] 10.222.0.102 () {54 vars in 931 bytes} [Mon Aug 1 15:26:01 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 01 15:26:01.160889 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8426846e-2527-4562-bdee-def7f4a3d0eb None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:26:01.161118 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2217fc-501e-490a-b66f-441a1a848d83 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:01.161333 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2217fc-501e-490a-b66f-441a1a848d83 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:01.161593 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2217fc-501e-490a-b66f-441a1a848d83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:01.171249 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:26:01.183323 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-ea2217fc-501e-490a-b66f-441a1a848d83 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:26:01.187331 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-ea2217fc-501e-490a-b66f-441a1a848d83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:26:01.215085 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63856fd-cd54-4a24-86ce-0a01a7a76be2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:26:01.215863 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63856fd-cd54-4a24-86ce-0a01a7a76be2 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:01.216243 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63856fd-cd54-4a24-86ce-0a01a7a76be2 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:01.216621 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63856fd-cd54-4a24-86ce-0a01a7a76be2 None admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:01.217589 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63856fd-cd54-4a24-86ce-0a01a7a76be2 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:26:01.218000 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63856fd-cd54-4a24-86ce-0a01a7a76be2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:26:01.219630 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63856fd-cd54-4a24-86ce-0a01a7a76be2 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:26:01.229762 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 443/875] 10.222.0.102 () {56 vars in 1120 bytes} [Mon Aug 1 15:26:01 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 340 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:26:01.237791 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63856fd-cd54-4a24-86ce-0a01a7a76be2 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:26:01.273223 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 433/876] 10.222.0.102 () {58 vars in 1028 bytes} [Mon Aug 1 15:26:01 2022] POST /identity/v3/auth/tokens => generated 1153 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 01 15:26:01.297950 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2217fc-501e-490a-b66f-441a1a848d83 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:26:01.301264 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:26:01.352779 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63856fd-cd54-4a24-86ce-0a01a7a76be2 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:26:01.390063 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83acc13e-e616-4f95-bd05-ed8be3fda370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:26:01.391276 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83acc13e-e616-4f95-bd05-ed8be3fda370 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:01.391585 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83acc13e-e616-4f95-bd05-ed8be3fda370 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:01.391848 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83acc13e-e616-4f95-bd05-ed8be3fda370 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:01.404472 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83acc13e-e616-4f95-bd05-ed8be3fda370 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:26:01.406040 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83acc13e-e616-4f95-bd05-ed8be3fda370 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:26:01.426137 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-83acc13e-e616-4f95-bd05-ed8be3fda370 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:26:01.426137 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:26:01.426137 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:26:01.426137 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:26:01.426137 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:26:01.426137 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:26:01.426137 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:26:01.426137 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:26:01.426137 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:26:01.426137 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:26:01.426137 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:26:01.426137 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:26:01.426137 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:26:01.426137 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:26:01.426137 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:26:01.427080 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:26:01.427080 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:26:01.427080 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:26:01.427080 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:26:01.427080 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:26:01.427080 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:26:01.427080 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:26:01.427080 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:26:01.427080 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 01 15:26:01.427080 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:26:01.427080 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:26:01.427080 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:26:01.427080 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:26:01.427080 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:26:01.427080 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:26:01.427080 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:26:01.427080 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:26:01.427971 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:26:01.427971 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:26:01.427971 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:26:01.427971 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 01 15:26:01.432762 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 444/877] 10.222.0.102 () {56 vars in 1113 bytes} [Mon Aug 1 15:26:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:26:01.434455 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83acc13e-e616-4f95-bd05-ed8be3fda370 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:26:01.440461 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2217fc-501e-490a-b66f-441a1a848d83 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:26:01.487526 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677ff910-9d35-467f-a266-f0db709bd9a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:26:01.488165 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677ff910-9d35-467f-a266-f0db709bd9a4 None admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:01.488445 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677ff910-9d35-467f-a266-f0db709bd9a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:01.488719 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677ff910-9d35-467f-a266-f0db709bd9a4 None admin] PATH_INFO: `/v3/services` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:01.489452 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677ff910-9d35-467f-a266-f0db709bd9a4 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:26:01.490829 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677ff910-9d35-467f-a266-f0db709bd9a4 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:26:01.494399 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:26:01.552965 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 434/878] 10.222.0.102 () {60 vars in 1146 bytes} [Mon Aug 1 15:26:01 2022] POST /identity/v3/services => generated 252 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:26:01.570872 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83acc13e-e616-4f95-bd05-ed8be3fda370 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:26:01.573732 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:26:01.631435 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a83955-9e3b-4a26-ad31-d5b73b68632b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:26:01.631435 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a83955-9e3b-4a26-ad31-d5b73b68632b None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:01.631435 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a83955-9e3b-4a26-ad31-d5b73b68632b None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:01.631435 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a83955-9e3b-4a26-ad31-d5b73b68632b None admin] PATH_INFO: `/v3/domains` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:01.631928 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a83955-9e3b-4a26-ad31-d5b73b68632b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:26:01.631928 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a83955-9e3b-4a26-ad31-d5b73b68632b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:26:01.631928 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a83955-9e3b-4a26-ad31-d5b73b68632b None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:26:01.646530 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 445/879] 10.222.0.102 () {56 vars in 1114 bytes} [Mon Aug 1 15:26:01 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:26:01.652805 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677ff910-9d35-467f-a266-f0db709bd9a4 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:26:01.772497 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677ff910-9d35-467f-a266-f0db709bd9a4 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:26:01.810270 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c69fed-65c6-4eff-aced-a7ecb6caa659 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:26:01.810846 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c69fed-65c6-4eff-aced-a7ecb6caa659 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:01.811129 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c69fed-65c6-4eff-aced-a7ecb6caa659 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:01.811402 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c69fed-65c6-4eff-aced-a7ecb6caa659 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:01.820416 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c69fed-65c6-4eff-aced-a7ecb6caa659 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:26:01.821986 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c69fed-65c6-4eff-aced-a7ecb6caa659 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:26:01.834922 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-65c69fed-65c6-4eff-aced-a7ecb6caa659 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 01 15:26:01.834922 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:26:01.834922 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:26:01.834922 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:26:01.834922 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:26:01.834922 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:26:01.834922 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:26:01.834922 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:26:01.834922 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:26:01.834922 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:26:01.834922 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:26:01.834922 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:26:01.834922 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 15:26:01.834922 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 15:26:01.834922 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 15:26:01.834922 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 15:26:01.836495 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:26:01.836495 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:26:01.836495 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 15:26:01.836495 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 15:26:01.836495 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 15:26:01.836495 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 15:26:01.836495 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:26:01.836495 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:26:01.836495 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:26:01.836495 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:26:01.836495 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:26:01.836495 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 01 15:26:01.836495 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:26:01.836495 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:26:01.836495 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:26:01.836495 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:26:01.836495 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:26:01.836495 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:26:01.837478 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:26:01.837478 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:26:01.837478 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 15:26:01.837478 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 15:26:01.837478 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 15:26:01.837478 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 15:26:01.837478 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 15:26:01.837478 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 15:26:01.837478 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 01 15:26:01.837478 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 01 15:26:01.840976 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 435/880] 10.222.0.102 () {56 vars in 1122 bytes} [Mon Aug 1 15:26:01 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:26:01.842689 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a83955-9e3b-4a26-ad31-d5b73b68632b None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:26:01.967795 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a83955-9e3b-4a26-ad31-d5b73b68632b None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:26:02.003493 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de87ded-ddb5-45d9-9d32-08864b660690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:26:02.004345 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de87ded-ddb5-45d9-9d32-08864b660690 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:02.004771 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de87ded-ddb5-45d9-9d32-08864b660690 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:02.005229 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de87ded-ddb5-45d9-9d32-08864b660690 None admin] PATH_INFO: `/v3/users` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:02.006178 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de87ded-ddb5-45d9-9d32-08864b660690 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:26:02.006629 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de87ded-ddb5-45d9-9d32-08864b660690 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:26:02.008875 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de87ded-ddb5-45d9-9d32-08864b660690 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:26:02.027423 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 446/881] 10.222.0.102 () {56 vars in 1154 bytes} [Mon Aug 1 15:26:01 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 386 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:26:02.033097 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c69fed-65c6-4eff-aced-a7ecb6caa659 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:26:02.090414 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68af9a5-fb69-476a-8809-147a1d44da11 None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:02.090720 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68af9a5-fb69-476a-8809-147a1d44da11 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:02.090893 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68af9a5-fb69-476a-8809-147a1d44da11 None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:02.092502 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 447/882] 10.222.0.102 () {54 vars in 931 bytes} [Mon Aug 1 15:26:02 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 15:26:02.097435 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e4342c-be29-4524-bc57-8884d3c5e586 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:02.097726 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e4342c-be29-4524-bc57-8884d3c5e586 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:02.097993 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e4342c-be29-4524-bc57-8884d3c5e586 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:02.105243 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:26:02.118368 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-95e4342c-be29-4524-bc57-8884d3c5e586 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:26:02.119865 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-95e4342c-be29-4524-bc57-8884d3c5e586 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:26:02.134851 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:26:02.143752 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c69fed-65c6-4eff-aced-a7ecb6caa659 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:26:02.180308 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04e32b7-2917-4283-a28e-9e202e29c24c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:26:02.181108 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04e32b7-2917-4283-a28e-9e202e29c24c None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:02.181551 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04e32b7-2917-4283-a28e-9e202e29c24c None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:02.181894 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04e32b7-2917-4283-a28e-9e202e29c24c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:02.197204 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 448/883] 10.222.0.102 () {58 vars in 1028 bytes} [Mon Aug 1 15:26:02 2022] POST /identity/v3/auth/tokens => generated 1254 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 01 15:26:02.210947 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc4f1b5-4d74-4291-a830-cc3cd410d5b3 None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:02.211238 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc4f1b5-4d74-4291-a830-cc3cd410d5b3 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:02.211513 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc4f1b5-4d74-4291-a830-cc3cd410d5b3 None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:02.216601 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 449/884] 10.222.0.102 () {54 vars in 931 bytes} [Mon Aug 1 15:26:02 2022] GET /identity => generated 271 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 01 15:26:02.217808 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47947130-a750-4d32-a54b-074ed7b2e04c None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:02.218153 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47947130-a750-4d32-a54b-074ed7b2e04c None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:02.218430 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47947130-a750-4d32-a54b-074ed7b2e04c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:02.236694 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-47947130-a750-4d32-a54b-074ed7b2e04c None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:26:02.237922 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-47947130-a750-4d32-a54b-074ed7b2e04c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:26:02.259389 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04e32b7-2917-4283-a28e-9e202e29c24c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:26:02.260876 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04e32b7-2917-4283-a28e-9e202e29c24c None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:26:02.314157 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 450/885] 10.222.0.102 () {58 vars in 1028 bytes} [Mon Aug 1 15:26:02 2022] POST /identity/v3/auth/tokens => generated 1254 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 15:26:02.315092 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47947130-a750-4d32-a54b-074ed7b2e04c None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:26:02.324335 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:26:02.377923 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 436/886] 10.222.0.102 () {58 vars in 1287 bytes} [Mon Aug 1 15:26:02 2022] GET /identity/v3/auth/tokens => generated 1254 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 01 15:26:02.379171 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04e32b7-2917-4283-a28e-9e202e29c24c None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:26:02.401751 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:26:02.426299 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47947130-a750-4d32-a54b-074ed7b2e04c None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:26:02.462389 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee02c72-6971-42b1-88f5-947b690e2c9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:26:02.462999 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee02c72-6971-42b1-88f5-947b690e2c9f None admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:02.463272 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee02c72-6971-42b1-88f5-947b690e2c9f None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:02.463539 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee02c72-6971-42b1-88f5-947b690e2c9f None admin] PATH_INFO: `/v3/services` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:02.464232 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee02c72-6971-42b1-88f5-947b690e2c9f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:26:02.465614 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee02c72-6971-42b1-88f5-947b690e2c9f None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:26:02.486935 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04e32b7-2917-4283-a28e-9e202e29c24c None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:26:02.521342 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a6780a-44c3-44fb-823b-e60993d8e193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:26:02.521974 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a6780a-44c3-44fb-823b-e60993d8e193 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:02.522248 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a6780a-44c3-44fb-823b-e60993d8e193 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:02.522514 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a6780a-44c3-44fb-823b-e60993d8e193 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:02.523286 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a6780a-44c3-44fb-823b-e60993d8e193 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:26:02.524620 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a6780a-44c3-44fb-823b-e60993d8e193 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:26:02.533184 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-54a6780a-44c3-44fb-823b-e60993d8e193 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 01 15:26:02.533184 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:26:02.533184 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 01 15:26:02.533184 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 01 15:26:02.533184 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 01 15:26:02.533184 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 01 15:26:02.533184 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 01 15:26:02.533184 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 15:26:02.533184 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 01 15:26:02.533184 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 01 15:26:02.533184 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 15:26:02.533184 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 01 15:26:02.533184 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:26:02.533184 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:26:02.533184 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:26:02.533184 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:26:02.533184 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:26:02.534174 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:26:02.534174 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:26:02.534174 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:26:02.534174 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:26:02.534174 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:26:02.534174 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:26:02.534174 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 01 15:26:02.534174 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 01 15:26:02.534174 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 01 15:26:02.534174 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 01 15:26:02.534174 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:26:02.534174 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:26:02.534174 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:26:02.534174 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:26:02.534174 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:26:02.534174 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:26:02.535064 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:26:02.535064 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 01 15:26:02.535064 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:26:02.535064 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:26:02.535064 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:26:02.535064 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:26:02.535064 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:26:02.535064 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:26:02.535064 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:26:02.535064 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:26:02.535064 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 01 15:26:02.535064 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 15:26:02.535064 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 01 15:26:02.535064 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 01 15:26:02.535064 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 437/887] 10.222.0.102 () {56 vars in 1131 bytes} [Mon Aug 1 15:26:02 2022] GET /identity/v3/services/object-store => generated 93 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:26:02.535862 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a6780a-44c3-44fb-823b-e60993d8e193 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:26:02.549469 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 451/888] 10.222.0.102 () {60 vars in 1146 bytes} [Mon Aug 1 15:26:02 2022] POST /identity/v3/services => generated 270 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:26:02.550438 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee02c72-6971-42b1-88f5-947b690e2c9f None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:26:02.563530 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:26:02.681811 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a6780a-44c3-44fb-823b-e60993d8e193 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:26:02.705312 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee02c72-6971-42b1-88f5-947b690e2c9f None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:26:02.724450 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8894e5-2c90-4f62-9235-9c041307f077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:26:02.725470 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8894e5-2c90-4f62-9235-9c041307f077 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:02.725893 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8894e5-2c90-4f62-9235-9c041307f077 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:02.726352 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8894e5-2c90-4f62-9235-9c041307f077 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:02.737829 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8894e5-2c90-4f62-9235-9c041307f077 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:26:02.739627 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8894e5-2c90-4f62-9235-9c041307f077 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:26:02.742594 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:26:02.749548 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964bddc3-875c-47d6-912d-0487329e962a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:26:02.750192 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964bddc3-875c-47d6-912d-0487329e962a None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:02.750475 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964bddc3-875c-47d6-912d-0487329e962a None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:02.750752 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964bddc3-875c-47d6-912d-0487329e962a None admin] PATH_INFO: `/v3/services` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:02.751448 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964bddc3-875c-47d6-912d-0487329e962a None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:26:02.751755 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964bddc3-875c-47d6-912d-0487329e962a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:26:02.753178 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964bddc3-875c-47d6-912d-0487329e962a None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:26:02.759730 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 452/889] 10.222.0.102 () {56 vars in 1127 bytes} [Mon Aug 1 15:26:02 2022] GET /identity/v3/services?name=object-store => generated 130 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:26:02.761066 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-cf8894e5-2c90-4f62-9235-9c041307f077 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:26:02.761066 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:26:02.761066 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:26:02.761066 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:26:02.761066 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:26:02.761066 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:26:02.761066 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:26:02.761066 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:26:02.761066 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:26:02.761066 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:26:02.761066 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:26:02.761066 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:26:02.761066 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:26:02.761066 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:26:02.761066 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:26:02.762206 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:26:02.762206 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:26:02.762206 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:26:02.762206 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:26:02.762206 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:26:02.762206 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:26:02.762206 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:26:02.762206 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:26:02.762206 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 01 15:26:02.762206 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:26:02.762206 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:26:02.762206 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:26:02.762206 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:26:02.762206 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:26:02.762206 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:26:02.762206 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:26:02.762206 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:26:02.763131 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:26:02.763131 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:26:02.763131 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:26:02.763131 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 01 15:26:02.765798 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964bddc3-875c-47d6-912d-0487329e962a None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:26:02.766946 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 438/890] 10.222.0.102 () {56 vars in 1113 bytes} [Mon Aug 1 15:26:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:26:02.768123 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8894e5-2c90-4f62-9235-9c041307f077 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:26:02.845315 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:26:02.876544 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8894e5-2c90-4f62-9235-9c041307f077 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:26:02.899135 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964bddc3-875c-47d6-912d-0487329e962a None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:26:02.912002 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d2a2f3-d05b-42cd-9b89-c5ea12ba05fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:26:02.912626 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d2a2f3-d05b-42cd-9b89-c5ea12ba05fc None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:02.912994 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d2a2f3-d05b-42cd-9b89-c5ea12ba05fc None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:02.913192 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d2a2f3-d05b-42cd-9b89-c5ea12ba05fc None admin] PATH_INFO: `/v3/domains` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:02.913919 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d2a2f3-d05b-42cd-9b89-c5ea12ba05fc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:26:02.914221 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d2a2f3-d05b-42cd-9b89-c5ea12ba05fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:26:02.915586 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d2a2f3-d05b-42cd-9b89-c5ea12ba05fc None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:26:02.928270 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 439/891] 10.222.0.102 () {56 vars in 1114 bytes} [Mon Aug 1 15:26:02 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:26:02.935491 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d2a2f3-d05b-42cd-9b89-c5ea12ba05fc None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:26:02.940207 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ac6d9a-6fc8-4425-b2b5-647d7e950dea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:26:02.940824 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ac6d9a-6fc8-4425-b2b5-647d7e950dea None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:02.941133 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ac6d9a-6fc8-4425-b2b5-647d7e950dea None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:02.941408 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ac6d9a-6fc8-4425-b2b5-647d7e950dea None admin] PATH_INFO: `/v3/services` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:02.942083 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ac6d9a-6fc8-4425-b2b5-647d7e950dea None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:26:02.942385 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ac6d9a-6fc8-4425-b2b5-647d7e950dea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:26:02.943760 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ac6d9a-6fc8-4425-b2b5-647d7e950dea None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:26:02.950289 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 453/892] 10.222.0.102 () {56 vars in 1127 bytes} [Mon Aug 1 15:26:02 2022] GET /identity/v3/services?type=object-store => generated 130 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:26:03.053607 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d2a2f3-d05b-42cd-9b89-c5ea12ba05fc None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:26:03.087571 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:26:03.094235 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a729f03-e13e-4f64-a18d-f1e29b97fca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:26:03.099167 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a729f03-e13e-4f64-a18d-f1e29b97fca2 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:03.099167 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a729f03-e13e-4f64-a18d-f1e29b97fca2 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:03.099167 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a729f03-e13e-4f64-a18d-f1e29b97fca2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:03.103986 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a729f03-e13e-4f64-a18d-f1e29b97fca2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:26:03.105485 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a729f03-e13e-4f64-a18d-f1e29b97fca2 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:26:03.117879 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-2a729f03-e13e-4f64-a18d-f1e29b97fca2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 15:26:03.117879 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:26:03.117879 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:26:03.117879 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:26:03.117879 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:26:03.117879 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:26:03.117879 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:26:03.117879 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:26:03.117879 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:26:03.117879 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:26:03.117879 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:26:03.117879 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:26:03.117879 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 15:26:03.117879 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 15:26:03.117879 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 15:26:03.118825 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 15:26:03.118825 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:26:03.118825 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:26:03.118825 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:26:03.118825 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:26:03.118825 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:26:03.118825 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:26:03.118825 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:26:03.118825 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 01 15:26:03.118825 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:26:03.118825 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:26:03.118825 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:26:03.118825 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:26:03.118825 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:26:03.118825 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:26:03.118825 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:26:03.118825 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:26:03.119756 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 15:26:03.119756 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 15:26:03.119756 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 15:26:03.119756 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 15:26:03.119756 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 15:26:03.119756 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 15:26:03.119756 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 15:26:03.119756 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 01 15:26:03.123754 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 440/893] 10.222.0.102 () {56 vars in 1116 bytes} [Mon Aug 1 15:26:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:26:03.125133 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ac6d9a-6fc8-4425-b2b5-647d7e950dea None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:26:03.191678 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:26:03.235655 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ac6d9a-6fc8-4425-b2b5-647d7e950dea None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:26:03.271298 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92429ea9-e3ab-4105-b0a2-3cd62976d5b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:26:03.271999 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92429ea9-e3ab-4105-b0a2-3cd62976d5b7 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:03.272286 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92429ea9-e3ab-4105-b0a2-3cd62976d5b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:03.272562 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92429ea9-e3ab-4105-b0a2-3cd62976d5b7 None admin] PATH_INFO: `/v3/projects` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:03.273381 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92429ea9-e3ab-4105-b0a2-3cd62976d5b7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:26:03.273693 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92429ea9-e3ab-4105-b0a2-3cd62976d5b7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:26:03.275138 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92429ea9-e3ab-4105-b0a2-3cd62976d5b7 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:26:03.288456 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 454/894] 10.222.0.102 () {56 vars in 1153 bytes} [Mon Aug 1 15:26:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:26:03.294754 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a729f03-e13e-4f64-a18d-f1e29b97fca2 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:26:03.410928 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a729f03-e13e-4f64-a18d-f1e29b97fca2 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:26:03.447630 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cf8c4d-a71b-40ce-8af6-48331f3ff33f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:26:03.448174 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cf8c4d-a71b-40ce-8af6-48331f3ff33f None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:03.448458 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cf8c4d-a71b-40ce-8af6-48331f3ff33f None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:03.448729 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cf8c4d-a71b-40ce-8af6-48331f3ff33f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:03.449553 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cf8c4d-a71b-40ce-8af6-48331f3ff33f None admin] RBAC: Adding query filter params (role.id=b6e2017e93264842a2466736b83e4250, scope.project.id=2eb32fbe631843d8be84d41f8ba88d6e, user.id=ae8514df55144c9086ed98ba44efbbd4) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:26:03.449863 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cf8c4d-a71b-40ce-8af6-48331f3ff33f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:26:03.451555 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cf8c4d-a71b-40ce-8af6-48331f3ff33f None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:26:03.457635 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 441/895] 10.222.0.102 () {56 vars in 1379 bytes} [Mon Aug 1 15:26:03 2022] GET /identity/v3/role_assignments?user.id=ae8514df55144c9086ed98ba44efbbd4&scope.project.id=2eb32fbe631843d8be84d41f8ba88d6e&role.id=b6e2017e93264842a2466736b83e4250 => generated 260 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:26:03.660265 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d5c07c-60f3-4040-b17d-cd58b7e7b112 None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:03.660634 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d5c07c-60f3-4040-b17d-cd58b7e7b112 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:03.660835 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d5c07c-60f3-4040-b17d-cd58b7e7b112 None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:03.662477 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 455/896] 10.222.0.102 () {54 vars in 931 bytes} [Mon Aug 1 15:26:03 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 15:26:03.667784 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec1abbb-48ef-49b2-bfae-bf7938d9661e None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:03.668080 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec1abbb-48ef-49b2-bfae-bf7938d9661e None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:03.668363 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec1abbb-48ef-49b2-bfae-bf7938d9661e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:03.687918 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-7ec1abbb-48ef-49b2-bfae-bf7938d9661e None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:26:03.689149 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-7ec1abbb-48ef-49b2-bfae-bf7938d9661e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:26:03.745668 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:26:03.764402 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 442/897] 10.222.0.102 () {58 vars in 1028 bytes} [Mon Aug 1 15:26:03 2022] POST /identity/v3/auth/tokens => generated 1364 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 15:26:03.787306 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d5c07c-60f3-4040-b17d-cd58b7e7b112 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:26:03.897802 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d5c07c-60f3-4040-b17d-cd58b7e7b112 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:26:03.919511 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:26:03.934070 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24609347-c68e-460e-b1de-4a6eed62e598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:26:03.934724 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24609347-c68e-460e-b1de-4a6eed62e598 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:03.935290 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24609347-c68e-460e-b1de-4a6eed62e598 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:03.935290 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24609347-c68e-460e-b1de-4a6eed62e598 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:03.935920 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24609347-c68e-460e-b1de-4a6eed62e598 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:26:03.937371 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24609347-c68e-460e-b1de-4a6eed62e598 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:26:03.947001 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-24609347-c68e-460e-b1de-4a6eed62e598 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 01 15:26:03.947001 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:26:03.947001 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 01 15:26:03.947001 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 01 15:26:03.947001 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 01 15:26:03.947001 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 01 15:26:03.947001 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 01 15:26:03.947001 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 15:26:03.947001 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 01 15:26:03.947001 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 01 15:26:03.947001 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 15:26:03.947001 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 01 15:26:03.947001 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:26:03.947001 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:26:03.947001 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:26:03.947001 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:26:03.947001 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:26:03.948160 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:26:03.948160 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:26:03.948160 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:26:03.948160 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:26:03.948160 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:26:03.948160 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:26:03.948160 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 01 15:26:03.948160 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 01 15:26:03.948160 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 01 15:26:03.948160 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 01 15:26:03.948160 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:26:03.948160 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:26:03.948160 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:26:03.948160 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:26:03.948160 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:26:03.948160 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:26:03.949275 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:26:03.949275 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 01 15:26:03.949275 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:26:03.949275 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:26:03.949275 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:26:03.949275 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:26:03.949275 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:26:03.949275 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:26:03.949275 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:26:03.949275 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:26:03.949275 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 01 15:26:03.949275 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 15:26:03.949275 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 01 15:26:03.949275 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 01 15:26:03.949275 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 456/898] 10.222.0.102 () {56 vars in 1119 bytes} [Mon Aug 1 15:26:03 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:26:03.958083 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec1abbb-48ef-49b2-bfae-bf7938d9661e None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:26:04.061609 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec1abbb-48ef-49b2-bfae-bf7938d9661e None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:26:04.099045 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7e5a2a-320c-4264-aefb-7b34674104bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:26:04.099748 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7e5a2a-320c-4264-aefb-7b34674104bd None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:04.100037 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7e5a2a-320c-4264-aefb-7b34674104bd None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:04.100343 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7e5a2a-320c-4264-aefb-7b34674104bd None admin] PATH_INFO: `/v3/services` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:04.101134 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7e5a2a-320c-4264-aefb-7b34674104bd None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:26:04.101446 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7e5a2a-320c-4264-aefb-7b34674104bd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:26:04.102850 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7e5a2a-320c-4264-aefb-7b34674104bd None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:26:04.108488 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 443/899] 10.222.0.102 () {56 vars in 1119 bytes} [Mon Aug 1 15:26:03 2022] GET /identity/v3/services?name=volumev3 => generated 126 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:26:04.114203 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24609347-c68e-460e-b1de-4a6eed62e598 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:26:04.225100 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24609347-c68e-460e-b1de-4a6eed62e598 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:26:04.260757 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8814be33-9296-4aaf-ac6d-f6704cba7f12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:26:04.261415 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8814be33-9296-4aaf-ac6d-f6704cba7f12 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:04.261834 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8814be33-9296-4aaf-ac6d-f6704cba7f12 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:04.262169 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8814be33-9296-4aaf-ac6d-f6704cba7f12 None admin] PATH_INFO: `/v3/services` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:04.262786 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8814be33-9296-4aaf-ac6d-f6704cba7f12 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:26:04.263088 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8814be33-9296-4aaf-ac6d-f6704cba7f12 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:26:04.264540 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8814be33-9296-4aaf-ac6d-f6704cba7f12 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:26:04.269986 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 457/900] 10.222.0.102 () {56 vars in 1119 bytes} [Mon Aug 1 15:26:04 2022] GET /identity/v3/services?type=volumev3 => generated 364 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:26:04.276479 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7e5a2a-320c-4264-aefb-7b34674104bd None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:26:04.332414 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:26:04.386867 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7e5a2a-320c-4264-aefb-7b34674104bd None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:26:04.422327 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324395b6-12a9-40ae-84ab-0a2f7d847aec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:26:04.422945 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324395b6-12a9-40ae-84ab-0a2f7d847aec None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:04.423217 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324395b6-12a9-40ae-84ab-0a2f7d847aec None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:04.423536 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324395b6-12a9-40ae-84ab-0a2f7d847aec None admin] PATH_INFO: `/v3/endpoints` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:04.424285 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324395b6-12a9-40ae-84ab-0a2f7d847aec None admin] RBAC: Adding query filter params (interface=public, service_id=739e7597755d4b31ab7bed49ea9f4d7c, region_id=RegionOne) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:26:04.424633 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324395b6-12a9-40ae-84ab-0a2f7d847aec None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:26:04.426027 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324395b6-12a9-40ae-84ab-0a2f7d847aec None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:26:04.432170 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 444/901] 10.222.0.102 () {56 vars in 1256 bytes} [Mon Aug 1 15:26:04 2022] GET /identity/v3/endpoints?service_id=739e7597755d4b31ab7bed49ea9f4d7c&interface=public®ion_id=RegionOne => generated 195 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:26:04.437412 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8814be33-9296-4aaf-ac6d-f6704cba7f12 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:26:04.492437 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:26:04.546968 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8814be33-9296-4aaf-ac6d-f6704cba7f12 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:26:04.583517 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ac1bbb-c622-44f7-aa86-7c0b27628aa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:26:04.584058 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ac1bbb-c622-44f7-aa86-7c0b27628aa6 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:04.584339 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ac1bbb-c622-44f7-aa86-7c0b27628aa6 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:04.584611 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ac1bbb-c622-44f7-aa86-7c0b27628aa6 None admin] PATH_INFO: `/v3/services` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:04.585383 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ac1bbb-c622-44f7-aa86-7c0b27628aa6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:26:04.587419 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ac1bbb-c622-44f7-aa86-7c0b27628aa6 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:26:04.593521 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 458/902] 10.222.0.102 () {56 vars in 1092 bytes} [Mon Aug 1 15:26:04 2022] GET /identity/v3/services => generated 1274 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:26:04.790931 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f47039-f76c-4530-b8e4-0e5ecbb5af0c None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:04.791245 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f47039-f76c-4530-b8e4-0e5ecbb5af0c None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:04.791472 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f47039-f76c-4530-b8e4-0e5ecbb5af0c None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:04.793139 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 445/903] 10.222.0.102 () {54 vars in 931 bytes} [Mon Aug 1 15:26:04 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 15:26:04.798355 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1304b15d-b8e1-484e-a26c-06aaef41fdf7 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:04.798645 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1304b15d-b8e1-484e-a26c-06aaef41fdf7 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:04.798924 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1304b15d-b8e1-484e-a26c-06aaef41fdf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:04.819106 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-1304b15d-b8e1-484e-a26c-06aaef41fdf7 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:26:04.820366 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-1304b15d-b8e1-484e-a26c-06aaef41fdf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:26:04.895527 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 459/904] 10.222.0.102 () {58 vars in 1028 bytes} [Mon Aug 1 15:26:04 2022] POST /identity/v3/auth/tokens => generated 1364 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 15:26:04.918828 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f47039-f76c-4530-b8e4-0e5ecbb5af0c None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:26:05.026223 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f47039-f76c-4530-b8e4-0e5ecbb5af0c None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:26:05.041251 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:26:05.062846 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacacd1d-9ff4-4452-be1e-6a37294c49b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:26:05.068442 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacacd1d-9ff4-4452-be1e-6a37294c49b2 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:05.068442 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacacd1d-9ff4-4452-be1e-6a37294c49b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:05.068442 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacacd1d-9ff4-4452-be1e-6a37294c49b2 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:05.068442 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacacd1d-9ff4-4452-be1e-6a37294c49b2 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:26:05.068442 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacacd1d-9ff4-4452-be1e-6a37294c49b2 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:26:05.075411 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-dacacd1d-9ff4-4452-be1e-6a37294c49b2 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 01 15:26:05.075411 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:26:05.075411 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 01 15:26:05.075411 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 01 15:26:05.075411 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 01 15:26:05.075411 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 01 15:26:05.075411 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 01 15:26:05.075411 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 15:26:05.075411 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 01 15:26:05.075411 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 01 15:26:05.075411 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 15:26:05.075411 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 01 15:26:05.075411 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:26:05.075411 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:26:05.075411 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:26:05.075411 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:26:05.076583 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:26:05.076583 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:26:05.076583 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:26:05.076583 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:26:05.076583 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:26:05.076583 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:26:05.076583 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:26:05.076583 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 01 15:26:05.076583 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 01 15:26:05.076583 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 01 15:26:05.076583 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 01 15:26:05.076583 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:26:05.076583 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:26:05.076583 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:26:05.076583 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:26:05.076583 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:26:05.077463 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:26:05.077463 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:26:05.077463 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 01 15:26:05.077463 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:26:05.077463 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:26:05.077463 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:26:05.077463 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:26:05.077463 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:26:05.077463 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:26:05.077463 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:26:05.077463 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:26:05.077463 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 01 15:26:05.077463 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 15:26:05.077463 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 01 15:26:05.077463 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 01 15:26:05.081089 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 446/905] 10.222.0.102 () {56 vars in 1137 bytes} [Mon Aug 1 15:26:04 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:26:05.083198 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1304b15d-b8e1-484e-a26c-06aaef41fdf7 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:26:05.128820 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:26:05.131886 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fafdd7-3895-44b3-aef6-863e1d58dfe4 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:05.132172 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fafdd7-3895-44b3-aef6-863e1d58dfe4 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:05.132568 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fafdd7-3895-44b3-aef6-863e1d58dfe4 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:05.134220 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 447/906] 10.222.0.102 () {54 vars in 931 bytes} [Mon Aug 1 15:26:05 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 01 15:26:05.139281 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2eebf3-7229-4d02-8fdd-50c1612c65b5 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:05.140968 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2eebf3-7229-4d02-8fdd-50c1612c65b5 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:05.140968 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2eebf3-7229-4d02-8fdd-50c1612c65b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:05.161856 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-ba2eebf3-7229-4d02-8fdd-50c1612c65b5 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:26:05.164242 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-ba2eebf3-7229-4d02-8fdd-50c1612c65b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:26:05.203160 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1304b15d-b8e1-484e-a26c-06aaef41fdf7 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:26:05.247584 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 448/907] 10.222.0.102 () {58 vars in 1028 bytes} [Mon Aug 1 15:26:05 2022] POST /identity/v3/auth/tokens => generated 1364 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 01 15:26:05.250834 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc238c79-c2ea-4254-bb83-eb84ab2e3403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:26:05.251684 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc238c79-c2ea-4254-bb83-eb84ab2e3403 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:05.252164 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc238c79-c2ea-4254-bb83-eb84ab2e3403 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:05.252662 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc238c79-c2ea-4254-bb83-eb84ab2e3403 None admin] PATH_INFO: `/v3/services` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:05.253626 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc238c79-c2ea-4254-bb83-eb84ab2e3403 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:26:05.254178 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc238c79-c2ea-4254-bb83-eb84ab2e3403 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:26:05.255889 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc238c79-c2ea-4254-bb83-eb84ab2e3403 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:26:05.261993 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 460/908] 10.222.0.102 () {56 vars in 1131 bytes} [Mon Aug 1 15:26:05 2022] GET /identity/v3/services?name=compute_legacy => generated 132 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:26:05.268043 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2eebf3-7229-4d02-8fdd-50c1612c65b5 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:26:05.277193 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc238c79-c2ea-4254-bb83-eb84ab2e3403 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:26:05.385924 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2eebf3-7229-4d02-8fdd-50c1612c65b5 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:26:05.395123 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:26:05.416435 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc238c79-c2ea-4254-bb83-eb84ab2e3403 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:26:05.424328 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a88f4b0-8902-492e-8e62-2d864e229a9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:26:05.424886 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:26:05.426197 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a88f4b0-8902-492e-8e62-2d864e229a9b None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:05.426743 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a88f4b0-8902-492e-8e62-2d864e229a9b None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:05.427272 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a88f4b0-8902-492e-8e62-2d864e229a9b None admin] PATH_INFO: `/v3/services` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:05.428209 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a88f4b0-8902-492e-8e62-2d864e229a9b None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:26:05.428761 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a88f4b0-8902-492e-8e62-2d864e229a9b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:26:05.430515 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a88f4b0-8902-492e-8e62-2d864e229a9b None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:26:05.441201 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 449/909] 10.222.0.102 () {56 vars in 1131 bytes} [Mon Aug 1 15:26:05 2022] GET /identity/v3/services?type=compute_legacy => generated 388 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:26:05.443484 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a88f4b0-8902-492e-8e62-2d864e229a9b None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:26:05.456488 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd435146-9701-4b0f-bbd7-6c7eb548feef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:26:05.457138 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd435146-9701-4b0f-bbd7-6c7eb548feef None admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:05.457420 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd435146-9701-4b0f-bbd7-6c7eb548feef None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:05.457697 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd435146-9701-4b0f-bbd7-6c7eb548feef None admin] PATH_INFO: `/v3/services` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:05.458773 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd435146-9701-4b0f-bbd7-6c7eb548feef None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:26:05.461134 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd435146-9701-4b0f-bbd7-6c7eb548feef None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:26:05.537056 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 461/910] 10.222.0.102 () {60 vars in 1146 bytes} [Mon Aug 1 15:26:05 2022] POST /identity/v3/services => generated 242 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:26:05.564817 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a88f4b0-8902-492e-8e62-2d864e229a9b None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:26:05.599453 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f71c09-d5e8-4b6c-88ef-4d49bb13f1d1 None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:05.599818 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f71c09-d5e8-4b6c-88ef-4d49bb13f1d1 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:05.600015 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f71c09-d5e8-4b6c-88ef-4d49bb13f1d1 None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:05.605132 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 462/911] 10.222.0.102 () {54 vars in 931 bytes} [Mon Aug 1 15:26:05 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 01 15:26:05.608111 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec07c9e8-03c1-4139-8369-ec489c04e00b None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:05.608410 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec07c9e8-03c1-4139-8369-ec489c04e00b None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:05.608670 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec07c9e8-03c1-4139-8369-ec489c04e00b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:05.616246 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d29714c-52f2-4f5c-8007-b577ef808751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:26:05.617537 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d29714c-52f2-4f5c-8007-b577ef808751 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:05.617826 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d29714c-52f2-4f5c-8007-b577ef808751 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:05.618101 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d29714c-52f2-4f5c-8007-b577ef808751 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:05.618979 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d29714c-52f2-4f5c-8007-b577ef808751 None admin] RBAC: Adding query filter params (interface=public, service_id=5fb1b297ff514fe4b0e8c1832d04076f, region_id=RegionOne) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:26:05.619292 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d29714c-52f2-4f5c-8007-b577ef808751 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:26:05.620706 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d29714c-52f2-4f5c-8007-b577ef808751 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:26:05.632820 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 450/912] 10.222.0.102 () {56 vars in 1256 bytes} [Mon Aug 1 15:26:05 2022] GET /identity/v3/endpoints?service_id=5fb1b297ff514fe4b0e8c1832d04076f&interface=public®ion_id=RegionOne => generated 195 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:26:05.640654 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d29714c-52f2-4f5c-8007-b577ef808751 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:26:05.640840 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-ec07c9e8-03c1-4139-8369-ec489c04e00b None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:26:05.642231 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-ec07c9e8-03c1-4139-8369-ec489c04e00b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:26:05.682377 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:26:05.731665 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 463/913] 10.222.0.102 () {58 vars in 1028 bytes} [Mon Aug 1 15:26:05 2022] POST /identity/v3/auth/tokens => generated 1466 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 15:26:05.750615 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec07c9e8-03c1-4139-8369-ec489c04e00b None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:26:05.770124 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d29714c-52f2-4f5c-8007-b577ef808751 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:26:05.819711 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349f72f4-ea20-46ba-8fba-29da62f17859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:26:05.821354 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349f72f4-ea20-46ba-8fba-29da62f17859 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:05.821848 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349f72f4-ea20-46ba-8fba-29da62f17859 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:05.822624 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349f72f4-ea20-46ba-8fba-29da62f17859 None admin] PATH_INFO: `/v3/services` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:05.823756 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349f72f4-ea20-46ba-8fba-29da62f17859 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:26:05.826086 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349f72f4-ea20-46ba-8fba-29da62f17859 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:26:05.835232 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 451/914] 10.222.0.102 () {56 vars in 1092 bytes} [Mon Aug 1 15:26:05 2022] GET /identity/v3/services => generated 1504 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 15:26:05.874181 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:26:05.883845 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec07c9e8-03c1-4139-8369-ec489c04e00b None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:26:05.923733 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05af585-d622-45c6-a466-f71b3e1b065b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:26:05.924399 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05af585-d622-45c6-a466-f71b3e1b065b None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:05.924680 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05af585-d622-45c6-a466-f71b3e1b065b None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:05.924990 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05af585-d622-45c6-a466-f71b3e1b065b None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:05.937771 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05af585-d622-45c6-a466-f71b3e1b065b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:26:05.943078 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-b05af585-d622-45c6-a466-f71b3e1b065b None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 01 15:26:05.943078 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:26:05.943078 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:26:05.943078 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:26:05.943078 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:26:05.943078 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:26:05.943078 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:26:05.943078 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:26:05.943078 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:26:05.943078 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:26:05.943078 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:26:05.943078 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:26:05.943078 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:26:05.943078 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:26:05.943078 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:26:05.943078 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:26:05.944054 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:26:05.944054 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:26:05.944054 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:26:05.944054 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:26:05.944054 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:26:05.944054 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:26:05.944054 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:26:05.944054 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:26:05.944054 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:26:05.944054 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:26:05.944054 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:26:05.944054 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 01 15:26:05.944054 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:26:05.944054 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:26:05.944054 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:26:05.944054 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:26:05.944992 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:26:05.944992 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:26:05.944992 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:26:05.944992 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:26:05.944992 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:26:05.944992 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:26:05.944992 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:26:05.944992 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:26:05.944992 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:26:05.944992 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:26:05.944992 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 01 15:26:05.944992 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 01 15:26:05.944992 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 464/915] 10.222.0.102 () {56 vars in 1125 bytes} [Mon Aug 1 15:26:05 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 15:26:05.953086 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349f72f4-ea20-46ba-8fba-29da62f17859 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:26:06.058582 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:26:06.066478 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349f72f4-ea20-46ba-8fba-29da62f17859 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:26:06.102640 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601ef456-ae68-4fd7-b626-8128e2d1c90a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:26:06.103281 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601ef456-ae68-4fd7-b626-8128e2d1c90a None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:06.103587 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601ef456-ae68-4fd7-b626-8128e2d1c90a None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:06.103862 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601ef456-ae68-4fd7-b626-8128e2d1c90a None admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:06.104583 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601ef456-ae68-4fd7-b626-8128e2d1c90a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:26:06.104902 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601ef456-ae68-4fd7-b626-8128e2d1c90a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:26:06.106282 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601ef456-ae68-4fd7-b626-8128e2d1c90a None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:26:06.115243 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 452/916] 10.222.0.102 () {56 vars in 1120 bytes} [Mon Aug 1 15:26:05 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 340 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:26:06.120967 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05af585-d622-45c6-a466-f71b3e1b065b None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:26:06.232479 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05af585-d622-45c6-a466-f71b3e1b065b None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:26:06.269369 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9b40fe-2d7a-4164-9779-d0601735571a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:26:06.270013 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9b40fe-2d7a-4164-9779-d0601735571a None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:06.270291 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9b40fe-2d7a-4164-9779-d0601735571a None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:06.270560 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9b40fe-2d7a-4164-9779-d0601735571a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:06.281562 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9b40fe-2d7a-4164-9779-d0601735571a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:26:06.283091 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9b40fe-2d7a-4164-9779-d0601735571a None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:26:06.299186 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-9f9b40fe-2d7a-4164-9779-d0601735571a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:26:06.299186 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:26:06.299186 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:26:06.299186 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:26:06.299186 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:26:06.299186 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:26:06.299186 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:26:06.299186 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:26:06.299186 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:26:06.299186 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:26:06.299186 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:26:06.299186 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:26:06.299186 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:26:06.299186 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:26:06.299186 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:26:06.300125 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:26:06.300125 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:26:06.300125 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:26:06.300125 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:26:06.300125 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:26:06.300125 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:26:06.300125 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:26:06.300125 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:26:06.300125 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 01 15:26:06.300125 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:26:06.300125 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:26:06.300125 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:26:06.300125 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:26:06.300125 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:26:06.300125 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:26:06.300125 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:26:06.300125 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:26:06.301060 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:26:06.301060 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:26:06.301060 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:26:06.301060 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 01 15:26:06.301060 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 465/917] 10.222.0.102 () {56 vars in 1113 bytes} [Mon Aug 1 15:26:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:26:06.306481 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601ef456-ae68-4fd7-b626-8128e2d1c90a None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:26:06.413813 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601ef456-ae68-4fd7-b626-8128e2d1c90a None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:26:06.448666 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709686da-987e-4c31-9e16-7bc7518a18c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:26:06.449322 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709686da-987e-4c31-9e16-7bc7518a18c9 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:06.449639 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709686da-987e-4c31-9e16-7bc7518a18c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:06.449914 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709686da-987e-4c31-9e16-7bc7518a18c9 None admin] PATH_INFO: `/v3/domains` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:06.450608 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709686da-987e-4c31-9e16-7bc7518a18c9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:26:06.450910 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709686da-987e-4c31-9e16-7bc7518a18c9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:26:06.452540 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709686da-987e-4c31-9e16-7bc7518a18c9 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:26:06.465725 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 453/918] 10.222.0.102 () {56 vars in 1114 bytes} [Mon Aug 1 15:26:06 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:26:06.471265 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9b40fe-2d7a-4164-9779-d0601735571a None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:26:06.483407 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:26:06.578295 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9b40fe-2d7a-4164-9779-d0601735571a None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:26:06.614368 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92e1f11-c89d-432c-b811-94cf463b2cc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:26:06.615317 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92e1f11-c89d-432c-b811-94cf463b2cc9 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:06.615777 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92e1f11-c89d-432c-b811-94cf463b2cc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:06.616223 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92e1f11-c89d-432c-b811-94cf463b2cc9 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:06.625028 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92e1f11-c89d-432c-b811-94cf463b2cc9 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:26:06.626786 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92e1f11-c89d-432c-b811-94cf463b2cc9 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:26:06.639238 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-e92e1f11-c89d-432c-b811-94cf463b2cc9 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 01 15:26:06.639238 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:26:06.639238 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:26:06.639238 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:26:06.639238 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:26:06.639238 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:26:06.639238 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:26:06.639238 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:26:06.639238 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:26:06.639238 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:26:06.639238 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:26:06.639238 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:26:06.639238 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 15:26:06.639238 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 15:26:06.639238 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 15:26:06.639238 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 15:26:06.640244 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:26:06.640244 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:26:06.640244 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 15:26:06.640244 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 15:26:06.640244 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 15:26:06.640244 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 15:26:06.640244 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:26:06.640244 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:26:06.640244 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:26:06.640244 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:26:06.640244 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:26:06.640244 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 01 15:26:06.640244 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:26:06.640244 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:26:06.640244 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:26:06.640244 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:26:06.640244 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:26:06.640244 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:26:06.641229 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:26:06.641229 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:26:06.641229 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 15:26:06.641229 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 15:26:06.641229 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 15:26:06.641229 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 15:26:06.641229 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 15:26:06.641229 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 15:26:06.641229 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 01 15:26:06.641229 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 01 15:26:06.643548 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 466/919] 10.222.0.102 () {56 vars in 1122 bytes} [Mon Aug 1 15:26:06 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:26:06.650005 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709686da-987e-4c31-9e16-7bc7518a18c9 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:26:06.669364 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:26:06.710086 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5d63eb-4088-468b-90d7-41de22baf9df None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:06.710408 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5d63eb-4088-468b-90d7-41de22baf9df None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:06.710684 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5d63eb-4088-468b-90d7-41de22baf9df None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:06.712341 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 467/920] 10.222.0.102 () {54 vars in 931 bytes} [Mon Aug 1 15:26:06 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 15:26:06.718007 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63209610-9ea3-4e8b-b94f-e4429601c51f None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:06.718286 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63209610-9ea3-4e8b-b94f-e4429601c51f None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:06.718561 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63209610-9ea3-4e8b-b94f-e4429601c51f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:06.739187 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-63209610-9ea3-4e8b-b94f-e4429601c51f None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:26:06.740376 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-63209610-9ea3-4e8b-b94f-e4429601c51f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:26:06.758828 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709686da-987e-4c31-9e16-7bc7518a18c9 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:26:06.794599 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c300b762-771c-40cd-9cea-195a7e8d02fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:26:06.795540 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c300b762-771c-40cd-9cea-195a7e8d02fd None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:06.795959 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c300b762-771c-40cd-9cea-195a7e8d02fd None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:06.796468 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c300b762-771c-40cd-9cea-195a7e8d02fd None admin] PATH_INFO: `/v3/users` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:06.797563 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c300b762-771c-40cd-9cea-195a7e8d02fd None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:26:06.798107 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c300b762-771c-40cd-9cea-195a7e8d02fd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:26:06.799711 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c300b762-771c-40cd-9cea-195a7e8d02fd None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:26:06.813723 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:26:06.819206 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 468/921] 10.222.0.102 () {58 vars in 1028 bytes} [Mon Aug 1 15:26:06 2022] POST /identity/v3/auth/tokens => generated 1466 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 01 15:26:06.825822 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 454/922] 10.222.0.102 () {56 vars in 1154 bytes} [Mon Aug 1 15:26:06 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 386 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:26:06.830360 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63209610-9ea3-4e8b-b94f-e4429601c51f None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:26:06.841558 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c300b762-771c-40cd-9cea-195a7e8d02fd None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:26:06.938816 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63209610-9ea3-4e8b-b94f-e4429601c51f None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:26:06.939839 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:26:06.965329 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c300b762-771c-40cd-9cea-195a7e8d02fd None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:26:06.985875 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73526052-6cb5-41f1-9d35-57dbf1abbb00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:26:06.986548 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73526052-6cb5-41f1-9d35-57dbf1abbb00 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:06.986839 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73526052-6cb5-41f1-9d35-57dbf1abbb00 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:06.987093 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73526052-6cb5-41f1-9d35-57dbf1abbb00 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:07.001385 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73526052-6cb5-41f1-9d35-57dbf1abbb00 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:26:07.002831 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73526052-6cb5-41f1-9d35-57dbf1abbb00 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:26:07.003946 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ca4d43-8454-4b87-845d-1aabbcd7ef21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:26:07.004811 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ca4d43-8454-4b87-845d-1aabbcd7ef21 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:07.005408 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ca4d43-8454-4b87-845d-1aabbcd7ef21 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:07.005878 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ca4d43-8454-4b87-845d-1aabbcd7ef21 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:07.006713 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ca4d43-8454-4b87-845d-1aabbcd7ef21 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:26:07.008888 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ca4d43-8454-4b87-845d-1aabbcd7ef21 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:26:07.018595 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-d6ca4d43-8454-4b87-845d-1aabbcd7ef21 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 01 15:26:07.018595 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:26:07.018595 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 01 15:26:07.018595 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 01 15:26:07.018595 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 01 15:26:07.018595 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 01 15:26:07.018595 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 01 15:26:07.018595 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 15:26:07.018595 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 01 15:26:07.018595 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 01 15:26:07.018595 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 15:26:07.018595 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 01 15:26:07.018595 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:26:07.018595 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:26:07.018595 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:26:07.018595 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:26:07.018595 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:26:07.019614 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:26:07.019614 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:26:07.019614 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:26:07.019614 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:26:07.019614 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:26:07.019614 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:26:07.019614 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 01 15:26:07.019614 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 01 15:26:07.019614 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 01 15:26:07.019614 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 01 15:26:07.019614 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:26:07.019614 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:26:07.019614 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:26:07.019614 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:26:07.019614 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:26:07.019614 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:26:07.020473 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:26:07.020473 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 01 15:26:07.020473 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:26:07.020473 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:26:07.020473 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:26:07.020473 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:26:07.020473 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:26:07.020473 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:26:07.020473 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:26:07.020473 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:26:07.020473 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 01 15:26:07.020473 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 15:26:07.020473 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 01 15:26:07.020473 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 01 15:26:07.021239 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-73526052-6cb5-41f1-9d35-57dbf1abbb00 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:26:07.021239 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:26:07.021239 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:26:07.021239 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:26:07.021239 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:26:07.021239 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:26:07.021239 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:26:07.021239 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:26:07.021239 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:26:07.021239 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:26:07.021239 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:26:07.021239 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:26:07.021239 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:26:07.021239 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:26:07.021239 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:26:07.022048 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:26:07.022048 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:26:07.022048 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:26:07.022048 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:26:07.022048 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:26:07.022048 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:26:07.022048 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:26:07.022048 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:26:07.022048 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 01 15:26:07.022048 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:26:07.022048 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:26:07.022048 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:26:07.022048 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:26:07.022048 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:26:07.022048 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:26:07.022048 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:26:07.022048 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:26:07.022990 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:26:07.022990 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:26:07.022990 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:26:07.022990 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 01 15:26:07.022990 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 469/923] 10.222.0.102 () {56 vars in 1113 bytes} [Mon Aug 1 15:26:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 15:26:07.028759 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 455/924] 10.222.0.102 () {56 vars in 1119 bytes} [Mon Aug 1 15:26:06 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 15:26:07.028982 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73526052-6cb5-41f1-9d35-57dbf1abbb00 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:26:07.029987 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ca4d43-8454-4b87-845d-1aabbcd7ef21 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:26:07.086107 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:26:07.148409 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ca4d43-8454-4b87-845d-1aabbcd7ef21 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:26:07.152889 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73526052-6cb5-41f1-9d35-57dbf1abbb00 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:26:07.192750 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f996af63-6178-406c-8bb0-66230b1bcc8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:26:07.193097 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6270bb-92dc-44fc-a931-7ea00867b57f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:26:07.193672 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f996af63-6178-406c-8bb0-66230b1bcc8d None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:07.194042 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f996af63-6178-406c-8bb0-66230b1bcc8d None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:07.194295 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6270bb-92dc-44fc-a931-7ea00867b57f None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:07.194491 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f996af63-6178-406c-8bb0-66230b1bcc8d None admin] PATH_INFO: `/v3/services` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:07.194918 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6270bb-92dc-44fc-a931-7ea00867b57f None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:07.195332 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6270bb-92dc-44fc-a931-7ea00867b57f None admin] PATH_INFO: `/v3/domains` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:07.195529 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f996af63-6178-406c-8bb0-66230b1bcc8d None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:26:07.195933 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f996af63-6178-406c-8bb0-66230b1bcc8d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:26:07.196476 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6270bb-92dc-44fc-a931-7ea00867b57f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:26:07.196944 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6270bb-92dc-44fc-a931-7ea00867b57f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:26:07.197603 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f996af63-6178-406c-8bb0-66230b1bcc8d None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:26:07.198619 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6270bb-92dc-44fc-a931-7ea00867b57f None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:26:07.207341 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:26:07.207851 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 470/925] 10.222.0.102 () {56 vars in 1119 bytes} [Mon Aug 1 15:26:07 2022] GET /identity/v3/services?name=volumev3 => generated 126 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:26:07.209407 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f996af63-6178-406c-8bb0-66230b1bcc8d None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:26:07.215496 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 456/926] 10.222.0.102 () {56 vars in 1114 bytes} [Mon Aug 1 15:26:07 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:26:07.221708 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6270bb-92dc-44fc-a931-7ea00867b57f None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:26:07.319322 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f996af63-6178-406c-8bb0-66230b1bcc8d None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:26:07.336463 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:26:07.353656 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6270bb-92dc-44fc-a931-7ea00867b57f None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:26:07.358415 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53430e2-6a06-4ab9-b786-de9eac198183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:26:07.359253 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53430e2-6a06-4ab9-b786-de9eac198183 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:07.359762 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53430e2-6a06-4ab9-b786-de9eac198183 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:07.360229 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53430e2-6a06-4ab9-b786-de9eac198183 None admin] PATH_INFO: `/v3/services` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:07.361121 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53430e2-6a06-4ab9-b786-de9eac198183 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:26:07.361617 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53430e2-6a06-4ab9-b786-de9eac198183 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:26:07.363230 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53430e2-6a06-4ab9-b786-de9eac198183 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:26:07.373246 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 471/927] 10.222.0.102 () {56 vars in 1119 bytes} [Mon Aug 1 15:26:07 2022] GET /identity/v3/services?type=volumev3 => generated 364 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:26:07.375398 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53430e2-6a06-4ab9-b786-de9eac198183 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:26:07.393663 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd58e2e-2768-45cc-a434-3987b0e8c876 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:26:07.394316 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd58e2e-2768-45cc-a434-3987b0e8c876 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:07.394599 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd58e2e-2768-45cc-a434-3987b0e8c876 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:07.394868 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd58e2e-2768-45cc-a434-3987b0e8c876 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:07.404306 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd58e2e-2768-45cc-a434-3987b0e8c876 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:26:07.406061 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd58e2e-2768-45cc-a434-3987b0e8c876 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:26:07.422415 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-6cd58e2e-2768-45cc-a434-3987b0e8c876 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 15:26:07.422415 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:26:07.422415 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:26:07.422415 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:26:07.422415 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:26:07.422415 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:26:07.422415 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:26:07.422415 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:26:07.422415 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:26:07.422415 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:26:07.422415 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:26:07.422415 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:26:07.422415 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 15:26:07.422415 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 15:26:07.422415 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 15:26:07.423352 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 15:26:07.423352 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:26:07.423352 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:26:07.423352 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:26:07.423352 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:26:07.423352 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:26:07.423352 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:26:07.423352 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:26:07.423352 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 01 15:26:07.423352 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:26:07.423352 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:26:07.423352 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:26:07.423352 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:26:07.423352 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:26:07.423352 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:26:07.423352 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:26:07.423352 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:26:07.424257 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 15:26:07.424257 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 15:26:07.424257 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 15:26:07.424257 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 15:26:07.424257 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 15:26:07.424257 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 15:26:07.424257 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 15:26:07.424257 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 01 15:26:07.428876 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 457/928] 10.222.0.102 () {56 vars in 1116 bytes} [Mon Aug 1 15:26:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:26:07.429735 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd58e2e-2768-45cc-a434-3987b0e8c876 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:26:07.498338 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:26:07.506199 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53430e2-6a06-4ab9-b786-de9eac198183 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:26:07.544763 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd58e2e-2768-45cc-a434-3987b0e8c876 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:26:07.551394 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3892f6a-acf6-483d-b51f-853d41d1d7cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:26:07.552025 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3892f6a-acf6-483d-b51f-853d41d1d7cf None admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:07.552302 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3892f6a-acf6-483d-b51f-853d41d1d7cf None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:07.552586 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3892f6a-acf6-483d-b51f-853d41d1d7cf None admin] PATH_INFO: `/v3/endpoints` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:07.553313 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3892f6a-acf6-483d-b51f-853d41d1d7cf None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:26:07.555267 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3892f6a-acf6-483d-b51f-853d41d1d7cf None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:26:07.584464 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a86a9ad-7dd4-43ee-8f28-9912ca93ae54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:26:07.586143 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a86a9ad-7dd4-43ee-8f28-9912ca93ae54 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:07.586926 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a86a9ad-7dd4-43ee-8f28-9912ca93ae54 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:07.587473 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a86a9ad-7dd4-43ee-8f28-9912ca93ae54 None admin] PATH_INFO: `/v3/projects` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:07.588420 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a86a9ad-7dd4-43ee-8f28-9912ca93ae54 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:26:07.588977 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a86a9ad-7dd4-43ee-8f28-9912ca93ae54 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:26:07.590638 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a86a9ad-7dd4-43ee-8f28-9912ca93ae54 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:26:07.605869 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 458/929] 10.222.0.102 () {56 vars in 1153 bytes} [Mon Aug 1 15:26:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:26:07.611436 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a86a9ad-7dd4-43ee-8f28-9912ca93ae54 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:26:07.645332 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 472/930] 10.222.0.102 () {60 vars in 1149 bytes} [Mon Aug 1 15:26:07 2022] POST /identity/v3/endpoints => generated 348 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:26:07.647952 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96388693-4e96-4c5b-bdc2-5a7b7e1a795a None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:07.648897 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96388693-4e96-4c5b-bdc2-5a7b7e1a795a None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:07.649316 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96388693-4e96-4c5b-bdc2-5a7b7e1a795a None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:07.652099 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 473/931] 10.222.0.102 () {54 vars in 931 bytes} [Mon Aug 1 15:26:07 2022] GET /identity => generated 271 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 15:26:07.664969 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200ba2cd-01b8-4d7c-b73b-0958143ad3ee None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:07.665383 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200ba2cd-01b8-4d7c-b73b-0958143ad3ee None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:07.665787 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200ba2cd-01b8-4d7c-b73b-0958143ad3ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:07.701679 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-200ba2cd-01b8-4d7c-b73b-0958143ad3ee None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:26:07.703593 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-200ba2cd-01b8-4d7c-b73b-0958143ad3ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:26:07.748119 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:26:07.765688 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a86a9ad-7dd4-43ee-8f28-9912ca93ae54 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:26:07.787698 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:26:07.814803 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c55326-9f3c-483b-b892-0eefa7abea3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:26:07.815484 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c55326-9f3c-483b-b892-0eefa7abea3c None admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:07.815783 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c55326-9f3c-483b-b892-0eefa7abea3c None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:07.816579 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c55326-9f3c-483b-b892-0eefa7abea3c None admin] PATH_INFO: `/v3/projects/2eb32fbe631843d8be84d41f8ba88d6e/users/ae8514df55144c9086ed98ba44efbbd4/roles/b6e2017e93264842a2466736b83e4250` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:07.818890 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c55326-9f3c-483b-b892-0eefa7abea3c None admin] RBAC: Authorizing `identity:create_grant(project_id=2eb32fbe631843d8be84d41f8ba88d6e, user_id=ae8514df55144c9086ed98ba44efbbd4, role_id=b6e2017e93264842a2466736b83e4250)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:26:07.821004 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c55326-9f3c-483b-b892-0eefa7abea3c None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:26:07.823415 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 474/932] 10.222.0.102 () {58 vars in 1028 bytes} [Mon Aug 1 15:26:07 2022] POST /identity/v3/auth/tokens => generated 1466 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 01 15:26:07.842943 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200ba2cd-01b8-4d7c-b73b-0958143ad3ee None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:26:07.915543 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 459/933] 10.222.0.102 () {58 vars in 1444 bytes} [Mon Aug 1 15:26:07 2022] PUT /identity/v3/projects/2eb32fbe631843d8be84d41f8ba88d6e/users/ae8514df55144c9086ed98ba44efbbd4/roles/b6e2017e93264842a2466736b83e4250 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 15:26:07.957516 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200ba2cd-01b8-4d7c-b73b-0958143ad3ee None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:26:07.995974 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9b7609-b0fe-4dcf-ae40-cea219d8c997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:26:07.996759 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9b7609-b0fe-4dcf-ae40-cea219d8c997 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:07.997094 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9b7609-b0fe-4dcf-ae40-cea219d8c997 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:07.997369 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9b7609-b0fe-4dcf-ae40-cea219d8c997 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:07.998077 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9b7609-b0fe-4dcf-ae40-cea219d8c997 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:26:07.999528 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9b7609-b0fe-4dcf-ae40-cea219d8c997 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:26:08.010224 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-0e9b7609-b0fe-4dcf-ae40-cea219d8c997 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 01 15:26:08.010224 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:26:08.010224 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 01 15:26:08.010224 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 01 15:26:08.010224 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 01 15:26:08.010224 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 01 15:26:08.010224 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 01 15:26:08.010224 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 15:26:08.010224 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 01 15:26:08.010224 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 01 15:26:08.010224 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 15:26:08.010224 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 01 15:26:08.010224 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:26:08.010224 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:26:08.010224 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:26:08.010224 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:26:08.010224 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:26:08.011365 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:26:08.011365 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:26:08.011365 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:26:08.011365 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:26:08.011365 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:26:08.011365 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:26:08.011365 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 01 15:26:08.011365 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 01 15:26:08.011365 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 01 15:26:08.011365 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 01 15:26:08.011365 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:26:08.011365 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:26:08.011365 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:26:08.011365 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:26:08.011365 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:26:08.011365 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:26:08.012191 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:26:08.012191 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 01 15:26:08.012191 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:26:08.012191 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:26:08.012191 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:26:08.012191 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:26:08.012191 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:26:08.012191 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:26:08.012191 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:26:08.012191 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:26:08.012191 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 01 15:26:08.012191 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 15:26:08.012191 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 01 15:26:08.012191 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 01 15:26:08.016585 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 475/934] 10.222.0.102 () {56 vars in 1131 bytes} [Mon Aug 1 15:26:07 2022] GET /identity/v3/services/object-store => generated 93 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 15:26:08.018027 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c55326-9f3c-483b-b892-0eefa7abea3c None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:26:08.058115 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e1a670-50e1-4790-9194-a9311e0e4768 None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:08.058435 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e1a670-50e1-4790-9194-a9311e0e4768 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:08.058653 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e1a670-50e1-4790-9194-a9311e0e4768 None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:08.060185 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 476/935] 10.222.0.102 () {54 vars in 931 bytes} [Mon Aug 1 15:26:08 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 01 15:26:08.065892 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b1ff34-445e-4122-ac38-7d0e79239434 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:08.066496 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b1ff34-445e-4122-ac38-7d0e79239434 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:08.066979 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b1ff34-445e-4122-ac38-7d0e79239434 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:08.088620 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-e2b1ff34-445e-4122-ac38-7d0e79239434 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:26:08.090189 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-e2b1ff34-445e-4122-ac38-7d0e79239434 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:26:08.110710 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:26:08.155462 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c55326-9f3c-483b-b892-0eefa7abea3c None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:26:08.174077 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 477/936] 10.222.0.102 () {58 vars in 1028 bytes} [Mon Aug 1 15:26:08 2022] POST /identity/v3/auth/tokens => generated 1466 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 01 15:26:08.192744 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb183d3-9174-4050-9b9b-ff80394ffcb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:26:08.193403 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb183d3-9174-4050-9b9b-ff80394ffcb1 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:08.193686 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb183d3-9174-4050-9b9b-ff80394ffcb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:08.193964 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb183d3-9174-4050-9b9b-ff80394ffcb1 None admin] PATH_INFO: `/v3/services` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:08.194651 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb183d3-9174-4050-9b9b-ff80394ffcb1 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:26:08.195639 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb183d3-9174-4050-9b9b-ff80394ffcb1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:26:08.197118 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb183d3-9174-4050-9b9b-ff80394ffcb1 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:26:08.198570 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b1ff34-445e-4122-ac38-7d0e79239434 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:26:08.203012 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 460/937] 10.222.0.102 () {56 vars in 1127 bytes} [Mon Aug 1 15:26:08 2022] GET /identity/v3/services?name=object-store => generated 130 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:26:08.209661 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb183d3-9174-4050-9b9b-ff80394ffcb1 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:26:08.255894 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:26:08.303877 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b1ff34-445e-4122-ac38-7d0e79239434 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:26:08.324627 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb183d3-9174-4050-9b9b-ff80394ffcb1 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:26:08.339967 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9f2a8b-99b5-49da-a974-8e415ec95e6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:26:08.340608 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9f2a8b-99b5-49da-a974-8e415ec95e6d None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:08.340900 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9f2a8b-99b5-49da-a974-8e415ec95e6d None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:08.341174 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9f2a8b-99b5-49da-a974-8e415ec95e6d None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:08.341799 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9f2a8b-99b5-49da-a974-8e415ec95e6d None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:26:08.343175 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9f2a8b-99b5-49da-a974-8e415ec95e6d None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:26:08.352668 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-ef9f2a8b-99b5-49da-a974-8e415ec95e6d None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 01 15:26:08.352668 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:26:08.352668 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 01 15:26:08.352668 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 01 15:26:08.352668 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 01 15:26:08.352668 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 01 15:26:08.352668 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 01 15:26:08.352668 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 15:26:08.352668 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 01 15:26:08.352668 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 01 15:26:08.352668 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 15:26:08.352668 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 01 15:26:08.352668 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:26:08.352668 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:26:08.352668 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:26:08.352668 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:26:08.353630 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:26:08.353630 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:26:08.353630 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:26:08.353630 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:26:08.353630 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:26:08.353630 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:26:08.353630 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:26:08.353630 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 01 15:26:08.353630 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 01 15:26:08.353630 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 01 15:26:08.353630 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 01 15:26:08.353630 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:26:08.353630 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:26:08.353630 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:26:08.353630 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:26:08.353630 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:26:08.355014 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:26:08.355014 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:26:08.355014 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 01 15:26:08.355014 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:26:08.355014 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:26:08.355014 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:26:08.355014 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:26:08.355014 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:26:08.355014 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:26:08.355014 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:26:08.355014 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:26:08.355014 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 01 15:26:08.355014 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 15:26:08.355014 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 01 15:26:08.355014 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 01 15:26:08.355014 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 478/938] 10.222.0.102 () {56 vars in 1137 bytes} [Mon Aug 1 15:26:08 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 15:26:08.360055 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9f2a8b-99b5-49da-a974-8e415ec95e6d None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:26:08.362452 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b26f407-3503-4f83-914f-cedb6451d3a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:26:08.363181 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b26f407-3503-4f83-914f-cedb6451d3a8 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:08.363465 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b26f407-3503-4f83-914f-cedb6451d3a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:08.363864 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b26f407-3503-4f83-914f-cedb6451d3a8 None admin] PATH_INFO: `/v3/services` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:08.364559 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b26f407-3503-4f83-914f-cedb6451d3a8 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:26:08.364879 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b26f407-3503-4f83-914f-cedb6451d3a8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:26:08.366379 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b26f407-3503-4f83-914f-cedb6451d3a8 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:26:08.377539 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 461/939] 10.222.0.102 () {56 vars in 1127 bytes} [Mon Aug 1 15:26:08 2022] GET /identity/v3/services?type=object-store => generated 358 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:26:08.378444 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b26f407-3503-4f83-914f-cedb6451d3a8 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:26:08.380865 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:26:08.469417 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9f2a8b-99b5-49da-a974-8e415ec95e6d None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:26:08.490824 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b26f407-3503-4f83-914f-cedb6451d3a8 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:26:08.493211 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:26:08.507155 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b85d79c-ad65-49ac-af71-bb067aa7bffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:26:08.507939 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b85d79c-ad65-49ac-af71-bb067aa7bffa None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:08.508368 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b85d79c-ad65-49ac-af71-bb067aa7bffa None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:08.508740 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b85d79c-ad65-49ac-af71-bb067aa7bffa None admin] PATH_INFO: `/v3/services` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:08.509540 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b85d79c-ad65-49ac-af71-bb067aa7bffa None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:26:08.509940 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b85d79c-ad65-49ac-af71-bb067aa7bffa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:26:08.511412 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b85d79c-ad65-49ac-af71-bb067aa7bffa None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:26:08.517298 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 479/940] 10.222.0.102 () {56 vars in 1131 bytes} [Mon Aug 1 15:26:08 2022] GET /identity/v3/services?name=compute_legacy => generated 132 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:26:08.522300 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b85d79c-ad65-49ac-af71-bb067aa7bffa None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:26:08.534980 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0e732f-82d6-4bef-aa0d-403ce6de39c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:26:08.535614 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0e732f-82d6-4bef-aa0d-403ce6de39c6 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:08.535889 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0e732f-82d6-4bef-aa0d-403ce6de39c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:08.536206 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0e732f-82d6-4bef-aa0d-403ce6de39c6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:08.536994 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0e732f-82d6-4bef-aa0d-403ce6de39c6 None admin] RBAC: Adding query filter params (interface=public, service_id=2b1dfe2f8b474b478d5eda5bdc5c6f6e, region_id=RegionOne) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:26:08.537351 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0e732f-82d6-4bef-aa0d-403ce6de39c6 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:26:08.539489 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0e732f-82d6-4bef-aa0d-403ce6de39c6 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:26:08.548888 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 462/941] 10.222.0.102 () {56 vars in 1256 bytes} [Mon Aug 1 15:26:08 2022] GET /identity/v3/endpoints?service_id=2b1dfe2f8b474b478d5eda5bdc5c6f6e&interface=public®ion_id=RegionOne => generated 195 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:26:08.551052 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0e732f-82d6-4bef-aa0d-403ce6de39c6 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:26:08.639949 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:26:08.663284 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b85d79c-ad65-49ac-af71-bb067aa7bffa None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:26:08.681982 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0e732f-82d6-4bef-aa0d-403ce6de39c6 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:26:08.709337 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbdf5b2-ba09-4c6a-a41a-71d05edef23c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:26:08.710109 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbdf5b2-ba09-4c6a-a41a-71d05edef23c None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:08.710416 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbdf5b2-ba09-4c6a-a41a-71d05edef23c None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:08.710686 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbdf5b2-ba09-4c6a-a41a-71d05edef23c None admin] PATH_INFO: `/v3/services` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:08.711359 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbdf5b2-ba09-4c6a-a41a-71d05edef23c None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:26:08.711657 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbdf5b2-ba09-4c6a-a41a-71d05edef23c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:26:08.713062 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbdf5b2-ba09-4c6a-a41a-71d05edef23c None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:26:08.721011 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 480/942] 10.222.0.102 () {56 vars in 1131 bytes} [Mon Aug 1 15:26:08 2022] GET /identity/v3/services?type=compute_legacy => generated 388 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:26:08.726261 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbdf5b2-ba09-4c6a-a41a-71d05edef23c None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:26:08.736130 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e7c8d0-d308-4afa-8940-2c90ddbeec8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:26:08.736878 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e7c8d0-d308-4afa-8940-2c90ddbeec8b None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:08.737181 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e7c8d0-d308-4afa-8940-2c90ddbeec8b None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:08.737502 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e7c8d0-d308-4afa-8940-2c90ddbeec8b None admin] PATH_INFO: `/v3/services` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:08.738739 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e7c8d0-d308-4afa-8940-2c90ddbeec8b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:26:08.740768 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e7c8d0-d308-4afa-8940-2c90ddbeec8b None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:26:08.756953 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 463/943] 10.222.0.102 () {56 vars in 1092 bytes} [Mon Aug 1 15:26:08 2022] GET /identity/v3/services => generated 1504 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 15:26:08.845058 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbdf5b2-ba09-4c6a-a41a-71d05edef23c None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:26:08.885848 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6d1a29-af9d-4fb6-a853-5a442eda2a3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:26:08.886870 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6d1a29-af9d-4fb6-a853-5a442eda2a3d None admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:08.887351 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6d1a29-af9d-4fb6-a853-5a442eda2a3d None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:08.887826 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6d1a29-af9d-4fb6-a853-5a442eda2a3d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:08.888802 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6d1a29-af9d-4fb6-a853-5a442eda2a3d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:26:08.890566 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6d1a29-af9d-4fb6-a853-5a442eda2a3d None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:26:08.997093 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 481/944] 10.222.0.102 () {60 vars in 1149 bytes} [Mon Aug 1 15:26:08 2022] POST /identity/v3/endpoints => generated 349 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:26:09.821545 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0111dbd3-1d5c-4b63-9be7-60f793f26a3d None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:09.822065 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0111dbd3-1d5c-4b63-9be7-60f793f26a3d None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:09.822065 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0111dbd3-1d5c-4b63-9be7-60f793f26a3d None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:09.823668 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 464/945] 10.222.0.102 () {54 vars in 931 bytes} [Mon Aug 1 15:26:09 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 15:26:09.829089 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3135cf50-31a5-4c8e-9520-4141dc78567d None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:09.829488 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3135cf50-31a5-4c8e-9520-4141dc78567d None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:09.829657 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3135cf50-31a5-4c8e-9520-4141dc78567d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:09.835961 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:26:09.847634 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-3135cf50-31a5-4c8e-9520-4141dc78567d None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:26:09.848967 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-3135cf50-31a5-4c8e-9520-4141dc78567d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:26:09.928456 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 482/946] 10.222.0.102 () {58 vars in 1028 bytes} [Mon Aug 1 15:26:09 2022] POST /identity/v3/auth/tokens => generated 1466 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 15:26:09.951753 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0111dbd3-1d5c-4b63-9be7-60f793f26a3d None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:26:09.992782 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:26:10.014693 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a742579-0479-4b7d-9e0a-98f1a88387ee None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:10.015333 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a742579-0479-4b7d-9e0a-98f1a88387ee None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:10.015810 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a742579-0479-4b7d-9e0a-98f1a88387ee None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:10.018438 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 483/947] 10.222.0.102 () {54 vars in 931 bytes} [Mon Aug 1 15:26:10 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 15:26:10.023319 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8dde8d-a6a0-4a7f-8988-47288adcd3f3 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:10.023469 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8dde8d-a6a0-4a7f-8988-47288adcd3f3 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:10.023654 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8dde8d-a6a0-4a7f-8988-47288adcd3f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:10.042666 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-2c8dde8d-a6a0-4a7f-8988-47288adcd3f3 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:26:10.044251 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-2c8dde8d-a6a0-4a7f-8988-47288adcd3f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:26:10.070281 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0111dbd3-1d5c-4b63-9be7-60f793f26a3d None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:26:10.107525 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55863c1f-d07a-46c2-8db1-1a5a1ad89467 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:26:10.108466 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55863c1f-d07a-46c2-8db1-1a5a1ad89467 None admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:10.108975 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55863c1f-d07a-46c2-8db1-1a5a1ad89467 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:10.109433 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55863c1f-d07a-46c2-8db1-1a5a1ad89467 None admin] PATH_INFO: `/v3/projects` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:10.110284 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55863c1f-d07a-46c2-8db1-1a5a1ad89467 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:26:10.111917 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55863c1f-d07a-46c2-8db1-1a5a1ad89467 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:26:10.114744 dv-cinder-843277-7-smb devstack@keystone.service[80353]: WARNING keystone.server.flask.common [None req-55863c1f-d07a-46c2-8db1-1a5a1ad89467 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 01 15:26:10.129684 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 484/948] 10.222.0.102 () {58 vars in 1028 bytes} [Mon Aug 1 15:26:10 2022] POST /identity/v3/auth/tokens => generated 1466 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 01 15:26:10.152519 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8dde8d-a6a0-4a7f-8988-47288adcd3f3 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:26:10.159504 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.sql.core [None req-55863c1f-d07a-46c2-8db1-1a5a1ad89467 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 01 15:26:10.159504 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 01 15:26:10.159504 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [parameters: {'id': '7bfb6b71ea5b43cab05da2f9ed394e93', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 01 15:26:10.159504 dv-cinder-843277-7-smb devstack@keystone.service[80353]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80353) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 01 15:26:10.167873 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-55863c1f-d07a-46c2-8db1-1a5a1ad89467 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 7bfb6b71ea5b43cab05da2f9ed394e93.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 7bfb6b71ea5b43cab05da2f9ed394e93. Aug 01 15:26:10.167873 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:26:10.167873 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 01 15:26:10.167873 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 01 15:26:10.167873 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 01 15:26:10.167873 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 01 15:26:10.167873 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 01 15:26:10.167873 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application result = self._query(query) Aug 01 15:26:10.167873 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 01 15:26:10.167873 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application conn.query(q) Aug 01 15:26:10.167873 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 01 15:26:10.167873 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 01 15:26:10.167873 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 01 15:26:10.168807 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application result.read() Aug 01 15:26:10.168807 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 01 15:26:10.168807 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 01 15:26:10.168807 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 01 15:26:10.168807 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 01 15:26:10.168807 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 01 15:26:10.168807 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 01 15:26:10.168807 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 01 15:26:10.168807 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 01 15:26:10.168807 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 01 15:26:10.168807 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 01 15:26:10.168807 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 01 15:26:10.168807 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 01 15:26:10.168807 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:26:10.168807 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 01 15:26:10.168807 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 01 15:26:10.168807 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 01 15:26:10.168807 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 01 15:26:10.170399 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 01 15:26:10.170399 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application next(self.gen) Aug 01 15:26:10.170399 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 01 15:26:10.170399 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application yield resource Aug 01 15:26:10.170399 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 01 15:26:10.170399 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application next(self.gen) Aug 01 15:26:10.170399 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 01 15:26:10.170399 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application self.session.rollback() Aug 01 15:26:10.170399 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 01 15:26:10.170399 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application self.force_reraise() Aug 01 15:26:10.170399 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 01 15:26:10.170399 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise self.value Aug 01 15:26:10.170399 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 01 15:26:10.170399 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 01 15:26:10.170399 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 01 15:26:10.170399 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application session.commit() Aug 01 15:26:10.170399 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 01 15:26:10.171661 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 01 15:26:10.171661 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 01 15:26:10.171661 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application self._prepare_impl() Aug 01 15:26:10.171661 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 01 15:26:10.171661 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application self.session.flush() Aug 01 15:26:10.171661 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 01 15:26:10.171661 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application self._flush(objects) Aug 01 15:26:10.171661 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 01 15:26:10.171661 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 01 15:26:10.171661 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 01 15:26:10.171661 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application compat.raise_( Aug 01 15:26:10.171661 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 01 15:26:10.171661 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception Aug 01 15:26:10.171661 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 01 15:26:10.171661 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application flush_context.execute() Aug 01 15:26:10.171661 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 01 15:26:10.171661 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rec.execute(self) Aug 01 15:26:10.172573 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 01 15:26:10.172573 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 01 15:26:10.172573 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 01 15:26:10.172573 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 01 15:26:10.172573 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 01 15:26:10.172573 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 01 15:26:10.172573 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 01 15:26:10.172573 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 01 15:26:10.172573 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 01 15:26:10.172573 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 01 15:26:10.172573 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 01 15:26:10.172573 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 01 15:26:10.172573 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 01 15:26:10.172573 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 01 15:26:10.172573 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 01 15:26:10.178955 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 01 15:26:10.178955 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 01 15:26:10.178955 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception Aug 01 15:26:10.178955 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 01 15:26:10.178955 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 01 15:26:10.178955 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 01 15:26:10.178955 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 01 15:26:10.178955 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 01 15:26:10.178955 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application result = self._query(query) Aug 01 15:26:10.178955 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 01 15:26:10.178955 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application conn.query(q) Aug 01 15:26:10.178955 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 01 15:26:10.178955 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 01 15:26:10.178955 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 01 15:26:10.178955 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application result.read() Aug 01 15:26:10.178955 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 01 15:26:10.178955 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 01 15:26:10.181737 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 01 15:26:10.181737 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 01 15:26:10.181737 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 01 15:26:10.181737 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 01 15:26:10.181737 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 01 15:26:10.181737 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 01 15:26:10.181737 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 01 15:26:10.181737 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 01 15:26:10.181737 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [parameters: {'id': '7bfb6b71ea5b43cab05da2f9ed394e93', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 01 15:26:10.181737 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 01 15:26:10.181737 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 01 15:26:10.181737 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 15:26:10.181737 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 01 15:26:10.181737 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:26:10.181737 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 01 15:26:10.183620 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 01 15:26:10.183620 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 01 15:26:10.183620 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 01 15:26:10.183620 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 01 15:26:10.183620 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 01 15:26:10.183620 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 15:26:10.183620 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 01 15:26:10.183620 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:26:10.183620 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:26:10.183620 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:26:10.183620 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:26:10.183620 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:26:10.183620 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:26:10.183620 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:26:10.183620 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:26:10.183620 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:26:10.183620 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:26:10.186844 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:26:10.186844 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 01 15:26:10.186844 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 01 15:26:10.186844 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:26:10.186844 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:26:10.186844 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 01 15:26:10.186844 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 01 15:26:10.186844 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 7bfb6b71ea5b43cab05da2f9ed394e93. Aug 01 15:26:10.186844 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 01 15:26:10.186844 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 465/949] 10.222.0.102 () {60 vars in 1145 bytes} [Mon Aug 1 15:26:09 2022] POST /identity/v3/projects => generated 262 bytes in 218 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:26:10.188311 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55863c1f-d07a-46c2-8db1-1a5a1ad89467 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:26:10.237928 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:26:10.293020 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8dde8d-a6a0-4a7f-8988-47288adcd3f3 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:26:10.294500 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:26:10.314074 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55863c1f-d07a-46c2-8db1-1a5a1ad89467 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:26:10.341918 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b231436-3bf3-468d-ac58-ed67bc311b7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:26:10.343001 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b231436-3bf3-468d-ac58-ed67bc311b7f None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:10.343418 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b231436-3bf3-468d-ac58-ed67bc311b7f None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:10.343785 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b231436-3bf3-468d-ac58-ed67bc311b7f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:10.357327 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b231436-3bf3-468d-ac58-ed67bc311b7f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:26:10.358168 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779e676f-fb15-45e7-82af-3245f55eb716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:26:10.358980 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779e676f-fb15-45e7-82af-3245f55eb716 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:10.359425 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779e676f-fb15-45e7-82af-3245f55eb716 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:10.359849 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779e676f-fb15-45e7-82af-3245f55eb716 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:10.363329 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-6b231436-3bf3-468d-ac58-ed67bc311b7f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 01 15:26:10.363329 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:26:10.363329 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:26:10.363329 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:26:10.363329 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:26:10.363329 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:26:10.363329 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:26:10.363329 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:26:10.363329 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:26:10.363329 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:26:10.363329 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:26:10.363329 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:26:10.363329 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:26:10.363329 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:26:10.363329 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:26:10.363329 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:26:10.364449 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:26:10.364449 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:26:10.364449 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:26:10.364449 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:26:10.364449 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:26:10.364449 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:26:10.364449 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:26:10.364449 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:26:10.364449 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:26:10.364449 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:26:10.364449 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:26:10.364449 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 01 15:26:10.364449 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:26:10.364449 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:26:10.364449 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:26:10.364449 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:26:10.365518 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:26:10.365518 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:26:10.365518 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:26:10.365518 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:26:10.365518 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:26:10.365518 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:26:10.365518 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:26:10.365518 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:26:10.365518 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:26:10.365518 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:26:10.365518 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 01 15:26:10.365518 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 01 15:26:10.372990 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 485/950] 10.222.0.102 () {56 vars in 1125 bytes} [Mon Aug 1 15:26:10 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 15:26:10.373864 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779e676f-fb15-45e7-82af-3245f55eb716 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:26:10.373985 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b231436-3bf3-468d-ac58-ed67bc311b7f None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:26:10.375839 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779e676f-fb15-45e7-82af-3245f55eb716 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:26:10.391111 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-779e676f-fb15-45e7-82af-3245f55eb716 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 15:26:10.391111 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:26:10.391111 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:26:10.391111 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:26:10.391111 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:26:10.391111 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:26:10.391111 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:26:10.391111 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:26:10.391111 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:26:10.391111 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:26:10.391111 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:26:10.391111 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:26:10.391111 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 15:26:10.391111 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 15:26:10.391111 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 15:26:10.392208 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 15:26:10.392208 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:26:10.392208 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:26:10.392208 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:26:10.392208 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:26:10.392208 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:26:10.392208 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:26:10.392208 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:26:10.392208 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 01 15:26:10.392208 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:26:10.392208 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:26:10.392208 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:26:10.392208 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:26:10.392208 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:26:10.392208 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:26:10.392208 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:26:10.392208 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:26:10.393662 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 15:26:10.393662 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 15:26:10.393662 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 15:26:10.393662 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 15:26:10.393662 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 15:26:10.393662 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 15:26:10.393662 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 15:26:10.393662 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 01 15:26:10.396230 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 466/951] 10.222.0.102 () {56 vars in 1116 bytes} [Mon Aug 1 15:26:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 15:26:10.401681 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779e676f-fb15-45e7-82af-3245f55eb716 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:26:10.487579 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b231436-3bf3-468d-ac58-ed67bc311b7f None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:26:10.507705 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:26:10.511654 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779e676f-fb15-45e7-82af-3245f55eb716 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:26:10.525965 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01559a0f-631b-467f-827b-60dd9251249c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:26:10.526898 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01559a0f-631b-467f-827b-60dd9251249c None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:10.527340 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01559a0f-631b-467f-827b-60dd9251249c None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:10.527759 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01559a0f-631b-467f-827b-60dd9251249c None admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:10.528628 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01559a0f-631b-467f-827b-60dd9251249c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:26:10.529114 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01559a0f-631b-467f-827b-60dd9251249c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:26:10.530823 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01559a0f-631b-467f-827b-60dd9251249c None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:26:10.545450 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 486/952] 10.222.0.102 () {56 vars in 1120 bytes} [Mon Aug 1 15:26:10 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 340 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:26:10.546689 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01559a0f-631b-467f-827b-60dd9251249c None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:26:10.550159 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59072eaa-d690-41a3-b029-97e59d46c819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:26:10.551636 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59072eaa-d690-41a3-b029-97e59d46c819 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:10.551636 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59072eaa-d690-41a3-b029-97e59d46c819 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:10.551636 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59072eaa-d690-41a3-b029-97e59d46c819 None admin] PATH_INFO: `/v3/projects` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:10.552654 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59072eaa-d690-41a3-b029-97e59d46c819 None admin] RBAC: Adding query filter params (name=service) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:26:10.553104 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59072eaa-d690-41a3-b029-97e59d46c819 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:26:10.555409 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59072eaa-d690-41a3-b029-97e59d46c819 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:26:10.585050 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 467/953] 10.222.0.102 () {56 vars in 1117 bytes} [Mon Aug 1 15:26:10 2022] GET /identity/v3/projects?name=service => generated 413 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:26:10.660890 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01559a0f-631b-467f-827b-60dd9251249c None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:26:10.699559 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23518a74-fea4-4212-b012-d99c3144311a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:26:10.707854 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23518a74-fea4-4212-b012-d99c3144311a None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:10.707854 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23518a74-fea4-4212-b012-d99c3144311a None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:10.707854 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23518a74-fea4-4212-b012-d99c3144311a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:10.714685 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23518a74-fea4-4212-b012-d99c3144311a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:26:10.716171 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23518a74-fea4-4212-b012-d99c3144311a None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:26:10.732370 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-23518a74-fea4-4212-b012-d99c3144311a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:26:10.732370 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:26:10.732370 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:26:10.732370 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:26:10.732370 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:26:10.732370 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:26:10.732370 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:26:10.732370 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:26:10.732370 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:26:10.732370 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:26:10.732370 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:26:10.732370 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:26:10.732370 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:26:10.732370 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:26:10.732370 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:26:10.733566 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:26:10.733566 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:26:10.733566 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:26:10.733566 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:26:10.733566 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:26:10.733566 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:26:10.733566 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:26:10.733566 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:26:10.733566 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 01 15:26:10.733566 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:26:10.733566 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:26:10.733566 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:26:10.733566 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:26:10.733566 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:26:10.733566 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:26:10.733566 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:26:10.733566 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:26:10.734490 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:26:10.734490 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:26:10.734490 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:26:10.734490 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 01 15:26:10.734490 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 487/954] 10.222.0.102 () {56 vars in 1113 bytes} [Mon Aug 1 15:26:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:26:10.739405 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59072eaa-d690-41a3-b029-97e59d46c819 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:26:10.750685 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:26:10.849333 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59072eaa-d690-41a3-b029-97e59d46c819 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:26:10.864337 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7937a9-c584-46fa-ae66-aabd2197aa84 None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:10.864874 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7937a9-c584-46fa-ae66-aabd2197aa84 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:10.864993 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7937a9-c584-46fa-ae66-aabd2197aa84 None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:10.866248 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 488/955] 10.222.0.102 () {54 vars in 931 bytes} [Mon Aug 1 15:26:10 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 01 15:26:10.871745 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3f033f-7336-4a71-a6d9-eee81a415b61 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:10.872027 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3f033f-7336-4a71-a6d9-eee81a415b61 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:10.872295 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3f033f-7336-4a71-a6d9-eee81a415b61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:10.893462 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-5c3f033f-7336-4a71-a6d9-eee81a415b61 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:26:10.894803 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-5c3f033f-7336-4a71-a6d9-eee81a415b61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:26:10.901951 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697e290d-bc18-4f4c-a305-f56c2e7f4d0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:26:10.902770 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697e290d-bc18-4f4c-a305-f56c2e7f4d0f None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:10.903045 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697e290d-bc18-4f4c-a305-f56c2e7f4d0f None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:10.903311 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697e290d-bc18-4f4c-a305-f56c2e7f4d0f None admin] PATH_INFO: `/v3/domains` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:10.904011 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697e290d-bc18-4f4c-a305-f56c2e7f4d0f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:26:10.904300 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697e290d-bc18-4f4c-a305-f56c2e7f4d0f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:26:10.905710 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697e290d-bc18-4f4c-a305-f56c2e7f4d0f None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:26:10.918694 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 468/956] 10.222.0.102 () {56 vars in 1114 bytes} [Mon Aug 1 15:26:10 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:26:10.924703 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697e290d-bc18-4f4c-a305-f56c2e7f4d0f None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:26:10.935181 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:26:11.000930 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 489/957] 10.222.0.102 () {58 vars in 1028 bytes} [Mon Aug 1 15:26:10 2022] POST /identity/v3/auth/tokens => generated 1466 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 01 15:26:11.017151 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:26:11.022747 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3f033f-7336-4a71-a6d9-eee81a415b61 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:26:11.059281 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697e290d-bc18-4f4c-a305-f56c2e7f4d0f None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:26:11.095865 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff85440c-051c-4a87-9cb8-337acdd9cf0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:26:11.096509 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff85440c-051c-4a87-9cb8-337acdd9cf0c None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:11.096785 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff85440c-051c-4a87-9cb8-337acdd9cf0c None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:11.097095 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff85440c-051c-4a87-9cb8-337acdd9cf0c None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:11.105224 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff85440c-051c-4a87-9cb8-337acdd9cf0c None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:26:11.106660 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff85440c-051c-4a87-9cb8-337acdd9cf0c None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:26:11.118143 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-ff85440c-051c-4a87-9cb8-337acdd9cf0c None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 01 15:26:11.118143 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:26:11.118143 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:26:11.118143 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:26:11.118143 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:26:11.118143 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:26:11.118143 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:26:11.118143 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:26:11.118143 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:26:11.118143 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:26:11.118143 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:26:11.118143 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:26:11.118143 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 15:26:11.118143 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 15:26:11.118143 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 15:26:11.118143 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 15:26:11.119286 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:26:11.119286 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:26:11.119286 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 15:26:11.119286 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 15:26:11.119286 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 15:26:11.119286 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 15:26:11.119286 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:26:11.119286 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:26:11.119286 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:26:11.119286 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:26:11.119286 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:26:11.119286 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 01 15:26:11.119286 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:26:11.119286 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:26:11.119286 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:26:11.119286 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:26:11.119286 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:26:11.119286 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:26:11.120456 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:26:11.120456 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:26:11.120456 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 15:26:11.120456 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 15:26:11.120456 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 15:26:11.120456 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 15:26:11.120456 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 15:26:11.120456 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 15:26:11.120456 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 01 15:26:11.120456 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 01 15:26:11.120456 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 469/958] 10.222.0.102 () {56 vars in 1122 bytes} [Mon Aug 1 15:26:10 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 15:26:11.121192 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb08deda-be51-4e37-b754-9e101aeda8d7 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:11.121192 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb08deda-be51-4e37-b754-9e101aeda8d7 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:11.121862 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb08deda-be51-4e37-b754-9e101aeda8d7 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:11.122826 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 470/959] 10.222.0.102 () {54 vars in 931 bytes} [Mon Aug 1 15:26:11 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 15:26:11.125277 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb08deda-be51-4e37-b754-9e101aeda8d7 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:26:11.140808 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3f033f-7336-4a71-a6d9-eee81a415b61 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:26:11.183113 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de0aa11-3fa4-4344-8620-95e517586d56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:26:11.183778 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de0aa11-3fa4-4344-8620-95e517586d56 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:11.184070 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de0aa11-3fa4-4344-8620-95e517586d56 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:11.184435 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de0aa11-3fa4-4344-8620-95e517586d56 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:11.185082 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de0aa11-3fa4-4344-8620-95e517586d56 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:26:11.187303 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de0aa11-3fa4-4344-8620-95e517586d56 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:26:11.198343 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-4de0aa11-3fa4-4344-8620-95e517586d56 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 01 15:26:11.198343 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:26:11.198343 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 01 15:26:11.198343 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 01 15:26:11.198343 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 01 15:26:11.198343 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 01 15:26:11.198343 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 01 15:26:11.198343 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 15:26:11.198343 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 01 15:26:11.198343 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 01 15:26:11.198343 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 15:26:11.198343 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 01 15:26:11.198343 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:26:11.198343 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:26:11.198343 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:26:11.198343 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:26:11.198343 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:26:11.199447 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:26:11.199447 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:26:11.199447 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:26:11.199447 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:26:11.199447 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:26:11.199447 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:26:11.199447 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 01 15:26:11.199447 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 01 15:26:11.199447 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 01 15:26:11.199447 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 01 15:26:11.199447 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:26:11.199447 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:26:11.199447 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:26:11.199447 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:26:11.199447 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:26:11.199447 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:26:11.200388 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:26:11.200388 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 01 15:26:11.200388 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:26:11.200388 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:26:11.200388 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:26:11.200388 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:26:11.200388 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:26:11.200388 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:26:11.200388 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:26:11.200388 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:26:11.200388 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 01 15:26:11.200388 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 15:26:11.200388 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 01 15:26:11.200388 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 01 15:26:11.200388 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 490/960] 10.222.0.102 () {56 vars in 1131 bytes} [Mon Aug 1 15:26:11 2022] GET /identity/v3/services/object-store => generated 93 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 15:26:11.201634 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e92ff0-937e-4985-9848-19d8f3b18993 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:11.201634 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e92ff0-937e-4985-9848-19d8f3b18993 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:11.201881 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e92ff0-937e-4985-9848-19d8f3b18993 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:11.220795 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-25e92ff0-937e-4985-9848-19d8f3b18993 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:26:11.222243 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-25e92ff0-937e-4985-9848-19d8f3b18993 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:26:11.245046 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:26:11.246300 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb08deda-be51-4e37-b754-9e101aeda8d7 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:26:11.274005 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:26:11.282815 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f433b3-71f0-451e-abd2-e81039c32fef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:26:11.283508 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f433b3-71f0-451e-abd2-e81039c32fef None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:11.283855 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f433b3-71f0-451e-abd2-e81039c32fef None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:11.284191 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f433b3-71f0-451e-abd2-e81039c32fef None admin] PATH_INFO: `/v3/users` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:11.285077 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f433b3-71f0-451e-abd2-e81039c32fef None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:26:11.285456 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f433b3-71f0-451e-abd2-e81039c32fef None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:26:11.287193 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f433b3-71f0-451e-abd2-e81039c32fef None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:26:11.293500 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 491/961] 10.222.0.102 () {58 vars in 1028 bytes} [Mon Aug 1 15:26:11 2022] POST /identity/v3/auth/tokens => generated 1466 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 15:26:11.301855 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e92ff0-937e-4985-9848-19d8f3b18993 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:26:11.314844 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 471/962] 10.222.0.102 () {56 vars in 1154 bytes} [Mon Aug 1 15:26:11 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 386 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:26:11.316048 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f433b3-71f0-451e-abd2-e81039c32fef None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:26:11.429819 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e92ff0-937e-4985-9848-19d8f3b18993 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:26:11.440339 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f433b3-71f0-451e-abd2-e81039c32fef None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:26:11.468322 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cf28b1-83ff-416f-88fe-ebec376f3696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:26:11.469041 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cf28b1-83ff-416f-88fe-ebec376f3696 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:11.469307 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cf28b1-83ff-416f-88fe-ebec376f3696 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:11.469517 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cf28b1-83ff-416f-88fe-ebec376f3696 None admin] PATH_INFO: `/v3/services` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:11.470189 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cf28b1-83ff-416f-88fe-ebec376f3696 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:26:11.470503 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cf28b1-83ff-416f-88fe-ebec376f3696 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:26:11.472011 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cf28b1-83ff-416f-88fe-ebec376f3696 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:26:11.481983 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd89ae1-1efc-496c-8472-ff6081f0778f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:26:11.482245 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 492/963] 10.222.0.102 () {56 vars in 1127 bytes} [Mon Aug 1 15:26:11 2022] GET /identity/v3/services?name=object-store => generated 130 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:26:11.482351 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd89ae1-1efc-496c-8472-ff6081f0778f None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:11.482444 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cf28b1-83ff-416f-88fe-ebec376f3696 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:26:11.482536 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd89ae1-1efc-496c-8472-ff6081f0778f None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:11.482536 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd89ae1-1efc-496c-8472-ff6081f0778f None admin] PATH_INFO: `/v3/services/compute` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:11.482536 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd89ae1-1efc-496c-8472-ff6081f0778f None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:26:11.482536 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd89ae1-1efc-496c-8472-ff6081f0778f None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:26:11.492648 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-dfd89ae1-1efc-496c-8472-ff6081f0778f None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 01 15:26:11.492648 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:26:11.492648 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 01 15:26:11.492648 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 01 15:26:11.492648 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 01 15:26:11.492648 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 01 15:26:11.492648 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 01 15:26:11.492648 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 15:26:11.492648 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 01 15:26:11.492648 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 01 15:26:11.492648 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 15:26:11.492648 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 01 15:26:11.492648 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:26:11.492648 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:26:11.492648 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:26:11.492648 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:26:11.492648 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:26:11.493795 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:26:11.493795 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:26:11.493795 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:26:11.493795 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:26:11.493795 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:26:11.493795 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:26:11.493795 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 01 15:26:11.493795 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 01 15:26:11.493795 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 01 15:26:11.493795 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 01 15:26:11.493795 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:26:11.493795 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:26:11.493795 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:26:11.493795 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:26:11.493795 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:26:11.493795 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:26:11.497838 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:26:11.497838 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 01 15:26:11.497838 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:26:11.497838 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:26:11.497838 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:26:11.497838 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:26:11.497838 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:26:11.497838 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:26:11.497838 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:26:11.497838 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:26:11.497838 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 01 15:26:11.497838 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 15:26:11.497838 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 01 15:26:11.497838 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 01 15:26:11.497838 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 472/964] 10.222.0.102 () {56 vars in 1116 bytes} [Mon Aug 1 15:26:11 2022] GET /identity/v3/services/compute => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:26:11.498741 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd89ae1-1efc-496c-8472-ff6081f0778f None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:26:11.511600 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:26:11.545951 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:26:11.592372 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cf28b1-83ff-416f-88fe-ebec376f3696 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:26:11.597518 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd89ae1-1efc-496c-8472-ff6081f0778f None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:26:11.629166 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fac3ce-f585-424f-80e0-ae4925853835 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:26:11.630098 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fac3ce-f585-424f-80e0-ae4925853835 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:11.630592 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fac3ce-f585-424f-80e0-ae4925853835 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:11.631051 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fac3ce-f585-424f-80e0-ae4925853835 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:11.632827 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee030ed7-2fff-4ae9-b7e8-5a481b920a54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:26:11.633479 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee030ed7-2fff-4ae9-b7e8-5a481b920a54 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:11.633777 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee030ed7-2fff-4ae9-b7e8-5a481b920a54 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:11.634099 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee030ed7-2fff-4ae9-b7e8-5a481b920a54 None admin] PATH_INFO: `/v3/services` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:11.634782 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee030ed7-2fff-4ae9-b7e8-5a481b920a54 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:26:11.635090 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee030ed7-2fff-4ae9-b7e8-5a481b920a54 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:26:11.636463 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee030ed7-2fff-4ae9-b7e8-5a481b920a54 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:26:11.644891 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 473/965] 10.222.0.102 () {56 vars in 1127 bytes} [Mon Aug 1 15:26:11 2022] GET /identity/v3/services?type=object-store => generated 358 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:26:11.644891 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee030ed7-2fff-4ae9-b7e8-5a481b920a54 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:26:11.724617 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fac3ce-f585-424f-80e0-ae4925853835 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:26:11.726170 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fac3ce-f585-424f-80e0-ae4925853835 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:26:11.747969 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:26:11.759478 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee030ed7-2fff-4ae9-b7e8-5a481b920a54 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:26:11.774074 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:26:11.795247 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14e5d58-9720-45f9-8805-72a1ca992996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:26:11.795870 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14e5d58-9720-45f9-8805-72a1ca992996 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:11.796149 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14e5d58-9720-45f9-8805-72a1ca992996 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:11.796417 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14e5d58-9720-45f9-8805-72a1ca992996 None admin] PATH_INFO: `/v3/services` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:11.797133 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14e5d58-9720-45f9-8805-72a1ca992996 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:26:11.797537 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14e5d58-9720-45f9-8805-72a1ca992996 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:26:11.798962 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14e5d58-9720-45f9-8805-72a1ca992996 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:26:11.808869 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 474/966] 10.222.0.102 () {56 vars in 1117 bytes} [Mon Aug 1 15:26:11 2022] GET /identity/v3/services?name=compute => generated 125 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:26:11.808869 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14e5d58-9720-45f9-8805-72a1ca992996 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:26:11.839936 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 493/967] 10.222.0.102 () {58 vars in 1287 bytes} [Mon Aug 1 15:26:11 2022] GET /identity/v3/auth/tokens => generated 1466 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 01 15:26:11.840700 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fac3ce-f585-424f-80e0-ae4925853835 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:26:11.924916 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14e5d58-9720-45f9-8805-72a1ca992996 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:26:11.962161 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe97bf3-96e9-4447-b4a7-d2373d431167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:26:11.962787 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe97bf3-96e9-4447-b4a7-d2373d431167 None admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:11.963069 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe97bf3-96e9-4447-b4a7-d2373d431167 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:11.963342 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe97bf3-96e9-4447-b4a7-d2373d431167 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:11.964053 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe97bf3-96e9-4447-b4a7-d2373d431167 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:26:11.964549 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fac3ce-f585-424f-80e0-ae4925853835 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:26:11.965467 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe97bf3-96e9-4447-b4a7-d2373d431167 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:26:11.987509 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:26:11.998885 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46cf4aa-e02b-4a3b-9426-15e97498bf25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:26:11.999490 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46cf4aa-e02b-4a3b-9426-15e97498bf25 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:11.999761 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46cf4aa-e02b-4a3b-9426-15e97498bf25 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:12.000026 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46cf4aa-e02b-4a3b-9426-15e97498bf25 None admin] PATH_INFO: `/v3/services` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:12.000711 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46cf4aa-e02b-4a3b-9426-15e97498bf25 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:26:12.001042 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46cf4aa-e02b-4a3b-9426-15e97498bf25 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:26:12.002397 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46cf4aa-e02b-4a3b-9426-15e97498bf25 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:26:12.006852 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 494/968] 10.222.0.102 () {56 vars in 1117 bytes} [Mon Aug 1 15:26:11 2022] GET /identity/v3/services?type=compute => generated 125 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:26:12.008101 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46cf4aa-e02b-4a3b-9426-15e97498bf25 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:26:12.045452 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 475/969] 10.222.0.102 () {60 vars in 1149 bytes} [Mon Aug 1 15:26:11 2022] POST /identity/v3/endpoints => generated 351 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:26:12.133929 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46cf4aa-e02b-4a3b-9426-15e97498bf25 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:26:12.181441 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aba2490-eaca-4a3e-8af8-95efe8472059 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:26:12.182404 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aba2490-eaca-4a3e-8af8-95efe8472059 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:12.182681 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aba2490-eaca-4a3e-8af8-95efe8472059 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:12.182951 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aba2490-eaca-4a3e-8af8-95efe8472059 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:12.196125 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aba2490-eaca-4a3e-8af8-95efe8472059 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:26:12.197637 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aba2490-eaca-4a3e-8af8-95efe8472059 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:26:12.215396 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-5aba2490-eaca-4a3e-8af8-95efe8472059 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:26:12.215396 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:26:12.215396 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:26:12.215396 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:26:12.215396 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:26:12.215396 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:26:12.215396 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:26:12.215396 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:26:12.215396 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:26:12.215396 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:26:12.215396 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:26:12.215396 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:26:12.215396 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:26:12.215396 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:26:12.215396 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:26:12.216411 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:26:12.216411 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:26:12.216411 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:26:12.216411 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:26:12.216411 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:26:12.216411 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:26:12.216411 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:26:12.216411 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:26:12.216411 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 01 15:26:12.216411 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:26:12.216411 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:26:12.216411 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:26:12.216411 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:26:12.216411 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:26:12.216411 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:26:12.216411 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:26:12.216411 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:26:12.217991 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:26:12.217991 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:26:12.217991 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:26:12.217991 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 01 15:26:12.217991 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 495/970] 10.222.0.102 () {56 vars in 1113 bytes} [Mon Aug 1 15:26:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:26:12.222375 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe97bf3-96e9-4447-b4a7-d2373d431167 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:26:12.256733 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:26:12.330494 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe97bf3-96e9-4447-b4a7-d2373d431167 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:26:12.367647 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95383793-5776-4c32-8a19-ab8053e9c21e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:26:12.368274 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95383793-5776-4c32-8a19-ab8053e9c21e None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:12.368553 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95383793-5776-4c32-8a19-ab8053e9c21e None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:12.368825 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95383793-5776-4c32-8a19-ab8053e9c21e None admin] PATH_INFO: `/v3/domains` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:12.369541 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95383793-5776-4c32-8a19-ab8053e9c21e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:26:12.369903 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95383793-5776-4c32-8a19-ab8053e9c21e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:26:12.371279 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95383793-5776-4c32-8a19-ab8053e9c21e None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:26:12.384800 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 476/971] 10.222.0.102 () {56 vars in 1114 bytes} [Mon Aug 1 15:26:12 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:26:12.390491 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aba2490-eaca-4a3e-8af8-95efe8472059 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:26:12.423774 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:26:12.497653 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aba2490-eaca-4a3e-8af8-95efe8472059 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:26:12.535618 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b753c94b-4207-4f74-91da-c96b5bd3ecf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:26:12.536492 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b753c94b-4207-4f74-91da-c96b5bd3ecf0 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:12.537019 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b753c94b-4207-4f74-91da-c96b5bd3ecf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:12.537537 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b753c94b-4207-4f74-91da-c96b5bd3ecf0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:12.544877 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b753c94b-4207-4f74-91da-c96b5bd3ecf0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:26:12.546551 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b753c94b-4207-4f74-91da-c96b5bd3ecf0 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:26:12.558837 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-b753c94b-4207-4f74-91da-c96b5bd3ecf0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 15:26:12.558837 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:26:12.558837 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:26:12.558837 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:26:12.558837 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:26:12.558837 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:26:12.558837 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:26:12.558837 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:26:12.558837 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:26:12.558837 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:26:12.558837 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:26:12.558837 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:26:12.558837 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 15:26:12.558837 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 15:26:12.558837 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 15:26:12.559933 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 15:26:12.559933 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:26:12.559933 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:26:12.559933 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:26:12.559933 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:26:12.559933 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:26:12.559933 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:26:12.559933 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:26:12.559933 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 01 15:26:12.559933 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:26:12.559933 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:26:12.559933 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:26:12.559933 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:26:12.559933 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:26:12.559933 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:26:12.559933 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:26:12.559933 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:26:12.561090 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 15:26:12.561090 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 15:26:12.561090 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 15:26:12.561090 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 15:26:12.561090 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 15:26:12.561090 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 15:26:12.561090 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 15:26:12.561090 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 01 15:26:12.563194 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 496/972] 10.222.0.102 () {56 vars in 1116 bytes} [Mon Aug 1 15:26:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:26:12.569137 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95383793-5776-4c32-8a19-ab8053e9c21e None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:26:12.673093 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:26:12.683129 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95383793-5776-4c32-8a19-ab8053e9c21e None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:26:12.719649 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dd364f-f2fd-45b4-8e77-b7692e91a1bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:26:12.720279 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dd364f-f2fd-45b4-8e77-b7692e91a1bc None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:12.724386 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dd364f-f2fd-45b4-8e77-b7692e91a1bc None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:12.724386 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dd364f-f2fd-45b4-8e77-b7692e91a1bc None admin] PATH_INFO: `/v3/projects` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:12.724386 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32dd364f-f2fd-45b4-8e77-b7692e91a1bc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:26:12.724386 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32dd364f-f2fd-45b4-8e77-b7692e91a1bc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:26:12.724386 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32dd364f-f2fd-45b4-8e77-b7692e91a1bc None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:26:12.739958 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 477/973] 10.222.0.102 () {56 vars in 1153 bytes} [Mon Aug 1 15:26:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:26:12.745937 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b753c94b-4207-4f74-91da-c96b5bd3ecf0 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:26:12.780241 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120ade0a-926d-4b74-8e65-44f995be585d None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:12.780627 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120ade0a-926d-4b74-8e65-44f995be585d None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:12.781033 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120ade0a-926d-4b74-8e65-44f995be585d None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:12.783158 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 478/974] 10.222.0.102 () {54 vars in 931 bytes} [Mon Aug 1 15:26:12 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 15:26:12.789837 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275a0a82-8256-4226-8bea-30d63170c7bd None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:12.790134 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275a0a82-8256-4226-8bea-30d63170c7bd None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:12.790482 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275a0a82-8256-4226-8bea-30d63170c7bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:12.811059 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-275a0a82-8256-4226-8bea-30d63170c7bd None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:26:12.812835 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-275a0a82-8256-4226-8bea-30d63170c7bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:26:12.862570 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:26:12.873526 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b753c94b-4207-4f74-91da-c96b5bd3ecf0 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:26:12.908886 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 479/975] 10.222.0.102 () {58 vars in 1028 bytes} [Mon Aug 1 15:26:12 2022] POST /identity/v3/auth/tokens => generated 1466 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 15:26:12.923778 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf6f769-0b02-475f-b6ed-a5efb5fcfafd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:26:12.924686 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf6f769-0b02-475f-b6ed-a5efb5fcfafd None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:12.925208 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf6f769-0b02-475f-b6ed-a5efb5fcfafd None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:12.925709 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf6f769-0b02-475f-b6ed-a5efb5fcfafd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:12.926708 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf6f769-0b02-475f-b6ed-a5efb5fcfafd None admin] RBAC: Adding query filter params (role.id=b6e2017e93264842a2466736b83e4250, scope.project.id=2eb32fbe631843d8be84d41f8ba88d6e, user.id=ae8514df55144c9086ed98ba44efbbd4) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:26:12.927255 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf6f769-0b02-475f-b6ed-a5efb5fcfafd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:26:12.929300 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275a0a82-8256-4226-8bea-30d63170c7bd None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:26:12.929747 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf6f769-0b02-475f-b6ed-a5efb5fcfafd None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:26:12.936909 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 497/976] 10.222.0.102 () {56 vars in 1379 bytes} [Mon Aug 1 15:26:12 2022] GET /identity/v3/role_assignments?user.id=ae8514df55144c9086ed98ba44efbbd4&scope.project.id=2eb32fbe631843d8be84d41f8ba88d6e&role.id=b6e2017e93264842a2466736b83e4250 => generated 610 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:26:13.046479 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275a0a82-8256-4226-8bea-30d63170c7bd None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:26:13.050187 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:26:13.086189 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f721b47-8266-43e5-9754-b6d795c0428b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:26:13.095208 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f721b47-8266-43e5-9754-b6d795c0428b None admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:13.095208 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f721b47-8266-43e5-9754-b6d795c0428b None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:13.095208 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f721b47-8266-43e5-9754-b6d795c0428b None admin] PATH_INFO: `/v3/users` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:13.095208 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f721b47-8266-43e5-9754-b6d795c0428b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:26:13.095208 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f721b47-8266-43e5-9754-b6d795c0428b None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:26:13.137168 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.sql.core [None req-2f721b47-8266-43e5-9754-b6d795c0428b None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 01 15:26:13.137168 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 01 15:26:13.137168 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [parameters: {'user_id': 'bcc9c9dbd3d645af87ee28abb7b4078a', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 01 15:26:13.137168 dv-cinder-843277-7-smb devstack@keystone.service[80353]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80353) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 01 15:26:13.144180 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-2f721b47-8266-43e5-9754-b6d795c0428b None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 01 15:26:13.144180 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:26:13.144180 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 01 15:26:13.144180 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 01 15:26:13.144180 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 01 15:26:13.144180 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 01 15:26:13.144180 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 01 15:26:13.144180 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application result = self._query(query) Aug 01 15:26:13.144180 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 01 15:26:13.144180 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application conn.query(q) Aug 01 15:26:13.144180 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 01 15:26:13.144180 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 01 15:26:13.144180 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 01 15:26:13.144180 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application result.read() Aug 01 15:26:13.144180 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 01 15:26:13.145169 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 01 15:26:13.145169 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 01 15:26:13.145169 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 01 15:26:13.145169 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 01 15:26:13.145169 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 01 15:26:13.145169 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 01 15:26:13.145169 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 01 15:26:13.145169 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 01 15:26:13.145169 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 01 15:26:13.145169 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 01 15:26:13.145169 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 01 15:26:13.145169 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:26:13.145169 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 01 15:26:13.145169 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 01 15:26:13.145169 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 01 15:26:13.145169 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 01 15:26:13.145169 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 01 15:26:13.145169 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application next(self.gen) Aug 01 15:26:13.146692 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 01 15:26:13.146692 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application yield resource Aug 01 15:26:13.146692 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 01 15:26:13.146692 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application next(self.gen) Aug 01 15:26:13.146692 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 01 15:26:13.146692 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application self.session.rollback() Aug 01 15:26:13.146692 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 01 15:26:13.146692 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application self.force_reraise() Aug 01 15:26:13.146692 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 01 15:26:13.146692 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise self.value Aug 01 15:26:13.146692 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 01 15:26:13.146692 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 01 15:26:13.146692 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 01 15:26:13.146692 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application session.commit() Aug 01 15:26:13.146692 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 01 15:26:13.146692 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 01 15:26:13.146692 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 01 15:26:13.147604 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application self._prepare_impl() Aug 01 15:26:13.147604 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 01 15:26:13.147604 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application self.session.flush() Aug 01 15:26:13.147604 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 01 15:26:13.147604 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application self._flush(objects) Aug 01 15:26:13.147604 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 01 15:26:13.147604 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 01 15:26:13.147604 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 01 15:26:13.147604 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application compat.raise_( Aug 01 15:26:13.147604 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 01 15:26:13.147604 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception Aug 01 15:26:13.147604 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 01 15:26:13.147604 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application flush_context.execute() Aug 01 15:26:13.147604 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 01 15:26:13.147604 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rec.execute(self) Aug 01 15:26:13.147604 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 01 15:26:13.147604 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 01 15:26:13.148592 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 01 15:26:13.148592 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 01 15:26:13.148592 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 01 15:26:13.148592 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 01 15:26:13.148592 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 01 15:26:13.148592 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 01 15:26:13.148592 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 01 15:26:13.148592 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 01 15:26:13.148592 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 01 15:26:13.148592 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 01 15:26:13.148592 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 01 15:26:13.148592 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 01 15:26:13.148592 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 01 15:26:13.148592 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 01 15:26:13.148592 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 01 15:26:13.148592 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception Aug 01 15:26:13.149542 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 01 15:26:13.149542 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 01 15:26:13.149542 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 01 15:26:13.149542 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 01 15:26:13.149542 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 01 15:26:13.149542 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application result = self._query(query) Aug 01 15:26:13.149542 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 01 15:26:13.149542 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application conn.query(q) Aug 01 15:26:13.149542 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 01 15:26:13.149542 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 01 15:26:13.149542 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 01 15:26:13.149542 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application result.read() Aug 01 15:26:13.149542 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 01 15:26:13.149542 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 01 15:26:13.149542 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 01 15:26:13.149542 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 01 15:26:13.151762 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 01 15:26:13.151762 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 01 15:26:13.151762 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 01 15:26:13.151762 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 01 15:26:13.151762 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 01 15:26:13.151762 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 01 15:26:13.151762 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [parameters: {'user_id': 'bcc9c9dbd3d645af87ee28abb7b4078a', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 01 15:26:13.151762 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 01 15:26:13.151762 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 01 15:26:13.151762 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 15:26:13.151762 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 01 15:26:13.151762 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:26:13.151762 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:26:13.151762 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:26:13.151762 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:26:13.153606 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:26:13.153606 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:26:13.153606 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:26:13.153606 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:26:13.153606 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:26:13.153606 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:26:13.153606 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:26:13.153606 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 01 15:26:13.153606 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 01 15:26:13.153606 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:26:13.153606 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:26:13.153606 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 15:26:13.153606 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 15:26:13.153606 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 15:26:13.153606 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 15:26:13.153606 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 01 15:26:13.153606 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 01 15:26:13.155711 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 01 15:26:13.155711 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 01 15:26:13.155711 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 01 15:26:13.155711 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 01 15:26:13.155711 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 01 15:26:13.155711 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 01 15:26:13.155711 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 480/977] 10.222.0.102 () {60 vars in 1136 bytes} [Mon Aug 1 15:26:12 2022] POST /identity/v3/users => generated 160 bytes in 217 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:26:13.156618 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf6f769-0b02-475f-b6ed-a5efb5fcfafd None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:26:13.268405 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf6f769-0b02-475f-b6ed-a5efb5fcfafd None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:26:13.302642 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c983f14-2a92-422f-ac9a-50d46986a3c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:26:13.303197 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c983f14-2a92-422f-ac9a-50d46986a3c0 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:13.303469 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c983f14-2a92-422f-ac9a-50d46986a3c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:13.303735 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c983f14-2a92-422f-ac9a-50d46986a3c0 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:13.316425 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c983f14-2a92-422f-ac9a-50d46986a3c0 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:26:13.317914 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c983f14-2a92-422f-ac9a-50d46986a3c0 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:26:13.332740 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-7c983f14-2a92-422f-ac9a-50d46986a3c0 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 01 15:26:13.332740 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:26:13.332740 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:26:13.332740 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:26:13.332740 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:26:13.332740 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:26:13.332740 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:26:13.332740 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:26:13.332740 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:26:13.332740 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:26:13.332740 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:26:13.332740 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:26:13.332740 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 15:26:13.332740 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 15:26:13.332740 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 15:26:13.332740 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 15:26:13.333908 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:26:13.333908 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:26:13.333908 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 15:26:13.333908 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 15:26:13.333908 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 15:26:13.333908 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 15:26:13.333908 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:26:13.333908 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:26:13.333908 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:26:13.333908 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:26:13.333908 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:26:13.333908 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 01 15:26:13.333908 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:26:13.333908 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:26:13.333908 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:26:13.333908 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:26:13.333908 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:26:13.333908 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:26:13.334863 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:26:13.334863 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:26:13.334863 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 15:26:13.334863 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 15:26:13.334863 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 15:26:13.334863 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 15:26:13.334863 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 15:26:13.334863 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 15:26:13.334863 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 01 15:26:13.334863 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 01 15:26:13.335771 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 498/978] 10.222.0.102 () {56 vars in 1104 bytes} [Mon Aug 1 15:26:13 2022] GET /identity/v3/users/cinder => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:26:13.344670 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f721b47-8266-43e5-9754-b6d795c0428b None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:26:13.458372 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f721b47-8266-43e5-9754-b6d795c0428b None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:26:13.496055 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9fdcb3-81b2-4f6c-93cd-fd42dc5aba76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:26:13.496978 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9fdcb3-81b2-4f6c-93cd-fd42dc5aba76 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:13.497419 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9fdcb3-81b2-4f6c-93cd-fd42dc5aba76 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:13.497866 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9fdcb3-81b2-4f6c-93cd-fd42dc5aba76 None admin] PATH_INFO: `/v3/users` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:13.498798 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9fdcb3-81b2-4f6c-93cd-fd42dc5aba76 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:26:13.499247 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9fdcb3-81b2-4f6c-93cd-fd42dc5aba76 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:26:13.501070 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9fdcb3-81b2-4f6c-93cd-fd42dc5aba76 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:26:13.540466 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 481/979] 10.222.0.102 () {56 vars in 1106 bytes} [Mon Aug 1 15:26:13 2022] GET /identity/v3/users?name=cinder => generated 356 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:26:14.083826 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccbea90-680b-46d7-af9e-b711ceb3fe6b None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:14.084201 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccbea90-680b-46d7-af9e-b711ceb3fe6b None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:14.084401 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccbea90-680b-46d7-af9e-b711ceb3fe6b None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:14.085940 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 499/980] 10.222.0.102 () {54 vars in 931 bytes} [Mon Aug 1 15:26:14 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 15:26:14.091021 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a241efb-cc60-4809-9785-978bd418c18b None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:14.091477 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a241efb-cc60-4809-9785-978bd418c18b None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:14.091594 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a241efb-cc60-4809-9785-978bd418c18b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:14.098004 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:26:14.113130 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-0a241efb-cc60-4809-9785-978bd418c18b None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:26:14.114669 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-0a241efb-cc60-4809-9785-978bd418c18b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:26:14.185618 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 482/981] 10.222.0.102 () {58 vars in 1028 bytes} [Mon Aug 1 15:26:14 2022] POST /identity/v3/auth/tokens => generated 1466 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 15:26:14.208558 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccbea90-680b-46d7-af9e-b711ceb3fe6b None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:26:14.228325 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:26:14.313352 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccbea90-680b-46d7-af9e-b711ceb3fe6b None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:26:14.348669 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6c22a7-7b4c-4068-9ab1-84fb8fb47dcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:26:14.349454 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6c22a7-7b4c-4068-9ab1-84fb8fb47dcd None admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:14.349826 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6c22a7-7b4c-4068-9ab1-84fb8fb47dcd None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:14.350192 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6c22a7-7b4c-4068-9ab1-84fb8fb47dcd None admin] PATH_INFO: `/v3/services` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:14.351045 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6c22a7-7b4c-4068-9ab1-84fb8fb47dcd None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:26:14.352510 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6c22a7-7b4c-4068-9ab1-84fb8fb47dcd None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:26:14.360411 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cf7017-76e2-4b10-99fc-3455d8ec6edd None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:14.360695 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cf7017-76e2-4b10-99fc-3455d8ec6edd None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:14.361041 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cf7017-76e2-4b10-99fc-3455d8ec6edd None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:14.362426 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 483/982] 10.222.0.102 () {54 vars in 931 bytes} [Mon Aug 1 15:26:14 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 01 15:26:14.367284 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c381fe9-9757-4c7c-9442-f7ffb90a3253 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:14.372149 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c381fe9-9757-4c7c-9442-f7ffb90a3253 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:14.372149 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c381fe9-9757-4c7c-9442-f7ffb90a3253 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:14.386500 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-6c381fe9-9757-4c7c-9442-f7ffb90a3253 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:26:14.389350 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-6c381fe9-9757-4c7c-9442-f7ffb90a3253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:26:14.406156 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 500/983] 10.222.0.102 () {60 vars in 1146 bytes} [Mon Aug 1 15:26:14 2022] POST /identity/v3/services => generated 243 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:26:14.475065 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 484/984] 10.222.0.102 () {58 vars in 1028 bytes} [Mon Aug 1 15:26:14 2022] POST /identity/v3/auth/tokens => generated 1562 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 01 15:26:14.498255 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6c22a7-7b4c-4068-9ab1-84fb8fb47dcd None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:26:14.581676 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:26:14.607029 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6c22a7-7b4c-4068-9ab1-84fb8fb47dcd None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:26:14.641618 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b84023a-5e89-461a-bcc7-f6e864b23b12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:26:14.642410 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b84023a-5e89-461a-bcc7-f6e864b23b12 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:14.642792 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b84023a-5e89-461a-bcc7-f6e864b23b12 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:14.643183 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b84023a-5e89-461a-bcc7-f6e864b23b12 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:14.643912 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b84023a-5e89-461a-bcc7-f6e864b23b12 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:26:14.645750 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b84023a-5e89-461a-bcc7-f6e864b23b12 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:26:14.655908 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-2b84023a-5e89-461a-bcc7-f6e864b23b12 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 01 15:26:14.655908 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:26:14.655908 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 01 15:26:14.655908 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 01 15:26:14.655908 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 01 15:26:14.655908 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 01 15:26:14.655908 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 01 15:26:14.655908 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 15:26:14.655908 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 01 15:26:14.655908 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 01 15:26:14.655908 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 15:26:14.655908 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 01 15:26:14.655908 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:26:14.655908 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:26:14.655908 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:26:14.655908 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:26:14.655908 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:26:14.657164 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:26:14.657164 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:26:14.657164 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:26:14.657164 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:26:14.657164 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:26:14.657164 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:26:14.657164 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 01 15:26:14.657164 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 01 15:26:14.657164 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 01 15:26:14.657164 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 01 15:26:14.657164 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:26:14.657164 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:26:14.657164 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:26:14.657164 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:26:14.657164 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:26:14.657164 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:26:14.658295 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:26:14.658295 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 01 15:26:14.658295 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:26:14.658295 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:26:14.658295 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:26:14.658295 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:26:14.658295 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:26:14.658295 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:26:14.658295 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:26:14.658295 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:26:14.658295 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 01 15:26:14.658295 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 15:26:14.658295 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 01 15:26:14.658295 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 01 15:26:14.660199 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 501/985] 10.222.0.102 () {56 vars in 1131 bytes} [Mon Aug 1 15:26:14 2022] GET /identity/v3/services/object-store => generated 93 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:26:14.666602 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c381fe9-9757-4c7c-9442-f7ffb90a3253 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:26:14.727827 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:26:14.769768 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c381fe9-9757-4c7c-9442-f7ffb90a3253 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:26:14.805912 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adff07f9-f438-498e-93aa-43c395d31519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:26:14.806715 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adff07f9-f438-498e-93aa-43c395d31519 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:14.807090 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adff07f9-f438-498e-93aa-43c395d31519 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:14.807458 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adff07f9-f438-498e-93aa-43c395d31519 None admin] PATH_INFO: `/v3/services` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:14.808233 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adff07f9-f438-498e-93aa-43c395d31519 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:26:14.808637 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adff07f9-f438-498e-93aa-43c395d31519 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:26:14.810139 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adff07f9-f438-498e-93aa-43c395d31519 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:26:14.819751 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 485/986] 10.222.0.102 () {56 vars in 1127 bytes} [Mon Aug 1 15:26:14 2022] GET /identity/v3/services?name=object-store => generated 130 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:26:14.820994 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b84023a-5e89-461a-bcc7-f6e864b23b12 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:26:14.934667 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b84023a-5e89-461a-bcc7-f6e864b23b12 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:26:14.971520 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd27110-d2b6-49f0-a958-7e46d7120cf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:26:14.972291 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd27110-d2b6-49f0-a958-7e46d7120cf3 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:14.972676 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd27110-d2b6-49f0-a958-7e46d7120cf3 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:14.973079 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd27110-d2b6-49f0-a958-7e46d7120cf3 None admin] PATH_INFO: `/v3/services` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:14.973857 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd27110-d2b6-49f0-a958-7e46d7120cf3 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:26:14.974263 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd27110-d2b6-49f0-a958-7e46d7120cf3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:26:14.975730 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd27110-d2b6-49f0-a958-7e46d7120cf3 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:26:14.984957 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 502/987] 10.222.0.102 () {56 vars in 1127 bytes} [Mon Aug 1 15:26:14 2022] GET /identity/v3/services?type=object-store => generated 358 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:26:14.987003 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adff07f9-f438-498e-93aa-43c395d31519 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:26:15.051310 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b55073-74bb-4b32-ae9e-4c705e4357ce None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:15.051621 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b55073-74bb-4b32-ae9e-4c705e4357ce None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:15.051885 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b55073-74bb-4b32-ae9e-4c705e4357ce None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:15.053384 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 503/988] 10.222.0.102 () {54 vars in 931 bytes} [Mon Aug 1 15:26:15 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 15:26:15.058036 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7098c4e-abe2-4828-af87-22549a241f62 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:15.058313 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7098c4e-abe2-4828-af87-22549a241f62 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:15.058573 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7098c4e-abe2-4828-af87-22549a241f62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:15.065832 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:26:15.077612 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-b7098c4e-abe2-4828-af87-22549a241f62 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:26:15.078851 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-b7098c4e-abe2-4828-af87-22549a241f62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:26:15.092408 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adff07f9-f438-498e-93aa-43c395d31519 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:26:15.116590 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:26:15.128132 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b2f184-39b0-4f79-a596-77a7cc6e89d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:26:15.128935 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b2f184-39b0-4f79-a596-77a7cc6e89d6 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:15.129220 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b2f184-39b0-4f79-a596-77a7cc6e89d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:15.129495 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b2f184-39b0-4f79-a596-77a7cc6e89d6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:15.130258 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b2f184-39b0-4f79-a596-77a7cc6e89d6 None admin] RBAC: Adding query filter params (interface=admin, service_id=2b1dfe2f8b474b478d5eda5bdc5c6f6e, region_id=RegionOne) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:26:15.130570 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b2f184-39b0-4f79-a596-77a7cc6e89d6 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:26:15.131947 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b2f184-39b0-4f79-a596-77a7cc6e89d6 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:26:15.137997 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 486/989] 10.222.0.102 () {56 vars in 1254 bytes} [Mon Aug 1 15:26:14 2022] GET /identity/v3/endpoints?service_id=2b1dfe2f8b474b478d5eda5bdc5c6f6e&interface=admin®ion_id=RegionOne => generated 194 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:26:15.143425 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b2f184-39b0-4f79-a596-77a7cc6e89d6 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:26:15.160901 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 504/990] 10.222.0.102 () {58 vars in 1028 bytes} [Mon Aug 1 15:26:15 2022] POST /identity/v3/auth/tokens => generated 1562 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 15:26:15.179642 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7098c4e-abe2-4828-af87-22549a241f62 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:26:15.248446 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b2f184-39b0-4f79-a596-77a7cc6e89d6 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:26:15.283563 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b1f793-3332-40a3-aa30-a414aad1e9ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:26:15.284182 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b1f793-3332-40a3-aa30-a414aad1e9ad None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:15.284462 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b1f793-3332-40a3-aa30-a414aad1e9ad None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:15.284737 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b1f793-3332-40a3-aa30-a414aad1e9ad None admin] PATH_INFO: `/v3/services` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:15.285419 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b1f793-3332-40a3-aa30-a414aad1e9ad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:26:15.286776 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b1f793-3332-40a3-aa30-a414aad1e9ad None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:26:15.288869 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7098c4e-abe2-4828-af87-22549a241f62 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:26:15.300891 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 487/991] 10.222.0.102 () {56 vars in 1092 bytes} [Mon Aug 1 15:26:15 2022] GET /identity/v3/services => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 15:26:15.331344 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e02f56-5a04-4bb4-99ed-511f0e3e10bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:26:15.332003 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e02f56-5a04-4bb4-99ed-511f0e3e10bc None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:15.332284 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e02f56-5a04-4bb4-99ed-511f0e3e10bc None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:15.332560 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e02f56-5a04-4bb4-99ed-511f0e3e10bc None admin] PATH_INFO: `/v3/services/image` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:15.333232 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e02f56-5a04-4bb4-99ed-511f0e3e10bc None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:26:15.334637 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e02f56-5a04-4bb4-99ed-511f0e3e10bc None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:26:15.337534 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:26:15.345514 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-e0e02f56-5a04-4bb4-99ed-511f0e3e10bc None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 01 15:26:15.345514 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:26:15.345514 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 01 15:26:15.345514 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 01 15:26:15.345514 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 01 15:26:15.345514 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 01 15:26:15.345514 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 01 15:26:15.345514 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 15:26:15.345514 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 01 15:26:15.345514 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 01 15:26:15.345514 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 15:26:15.345514 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 01 15:26:15.345514 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:26:15.345514 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:26:15.345514 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:26:15.345514 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:26:15.345514 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:26:15.346642 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:26:15.346642 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:26:15.346642 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:26:15.346642 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:26:15.346642 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:26:15.346642 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:26:15.346642 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 01 15:26:15.346642 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 01 15:26:15.346642 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 01 15:26:15.346642 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 01 15:26:15.346642 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:26:15.346642 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:26:15.346642 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:26:15.346642 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:26:15.346642 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:26:15.346642 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:26:15.347522 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:26:15.347522 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 01 15:26:15.347522 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:26:15.347522 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:26:15.347522 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:26:15.347522 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:26:15.347522 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:26:15.347522 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:26:15.347522 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:26:15.347522 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:26:15.347522 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 01 15:26:15.347522 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 15:26:15.347522 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 01 15:26:15.347522 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 01 15:26:15.347522 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 505/992] 10.222.0.102 () {56 vars in 1110 bytes} [Mon Aug 1 15:26:15 2022] GET /identity/v3/services/image => generated 86 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 15:26:15.354096 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b1f793-3332-40a3-aa30-a414aad1e9ad None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:26:15.410608 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:26:15.465126 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b1f793-3332-40a3-aa30-a414aad1e9ad None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:26:15.505480 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57e6116-7e6a-4a14-89be-392af8832cc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:26:15.506029 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57e6116-7e6a-4a14-89be-392af8832cc4 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:15.506308 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57e6116-7e6a-4a14-89be-392af8832cc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:15.506579 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57e6116-7e6a-4a14-89be-392af8832cc4 None admin] PATH_INFO: `/v3/services` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:15.507321 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57e6116-7e6a-4a14-89be-392af8832cc4 None admin] RBAC: Adding query filter params (name=image) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:26:15.508121 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57e6116-7e6a-4a14-89be-392af8832cc4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:26:15.509519 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57e6116-7e6a-4a14-89be-392af8832cc4 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:26:15.514653 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 488/993] 10.222.0.102 () {56 vars in 1113 bytes} [Mon Aug 1 15:26:15 2022] GET /identity/v3/services?name=image => generated 123 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:26:15.520200 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e02f56-5a04-4bb4-99ed-511f0e3e10bc None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:26:15.625430 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e02f56-5a04-4bb4-99ed-511f0e3e10bc None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:26:15.660536 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5be2796-75cd-4d21-97ad-f9ef4dccbb3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:26:15.661417 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5be2796-75cd-4d21-97ad-f9ef4dccbb3b None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:15.661828 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5be2796-75cd-4d21-97ad-f9ef4dccbb3b None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:15.662106 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5be2796-75cd-4d21-97ad-f9ef4dccbb3b None admin] PATH_INFO: `/v3/services` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:15.662792 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5be2796-75cd-4d21-97ad-f9ef4dccbb3b None admin] RBAC: Adding query filter params (type=image) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:26:15.663098 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5be2796-75cd-4d21-97ad-f9ef4dccbb3b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:26:15.665564 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5be2796-75cd-4d21-97ad-f9ef4dccbb3b None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:26:15.676927 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 506/994] 10.222.0.102 () {56 vars in 1113 bytes} [Mon Aug 1 15:26:15 2022] GET /identity/v3/services?type=image => generated 123 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:26:16.463022 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296208a4-330f-46d4-b63d-5a0ef6e51152 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:16.463575 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296208a4-330f-46d4-b63d-5a0ef6e51152 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:16.463575 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296208a4-330f-46d4-b63d-5a0ef6e51152 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:16.464980 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 489/995] 10.222.0.102 () {54 vars in 931 bytes} [Mon Aug 1 15:26:16 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 15:26:16.469943 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc428c6-2de2-48c0-9790-e69fb401338c None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:16.470333 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc428c6-2de2-48c0-9790-e69fb401338c None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:16.470504 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc428c6-2de2-48c0-9790-e69fb401338c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:16.488463 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-0dc428c6-2de2-48c0-9790-e69fb401338c None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:26:16.489704 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-0dc428c6-2de2-48c0-9790-e69fb401338c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:26:16.547832 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:26:16.558339 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 507/996] 10.222.0.102 () {58 vars in 1028 bytes} [Mon Aug 1 15:26:16 2022] POST /identity/v3/auth/tokens => generated 1562 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 15:26:16.581044 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296208a4-330f-46d4-b63d-5a0ef6e51152 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:26:16.681872 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296208a4-330f-46d4-b63d-5a0ef6e51152 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:26:16.696384 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:26:16.717302 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83da580-480c-4472-896b-d6db4f39fadf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:26:16.717930 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83da580-480c-4472-896b-d6db4f39fadf None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:16.718252 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83da580-480c-4472-896b-d6db4f39fadf None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:16.718531 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83da580-480c-4472-896b-d6db4f39fadf None admin] PATH_INFO: `/v3/services/compute` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:16.719159 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83da580-480c-4472-896b-d6db4f39fadf None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:26:16.720590 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83da580-480c-4472-896b-d6db4f39fadf None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:26:16.730421 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-d83da580-480c-4472-896b-d6db4f39fadf None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 01 15:26:16.730421 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:26:16.730421 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 01 15:26:16.730421 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 01 15:26:16.730421 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 01 15:26:16.730421 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 01 15:26:16.730421 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 01 15:26:16.730421 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 15:26:16.730421 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 01 15:26:16.730421 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 01 15:26:16.730421 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 15:26:16.730421 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 01 15:26:16.730421 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:26:16.730421 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:26:16.730421 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:26:16.730421 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:26:16.730421 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:26:16.731431 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:26:16.731431 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:26:16.731431 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:26:16.731431 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:26:16.731431 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:26:16.731431 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:26:16.731431 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 01 15:26:16.731431 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 01 15:26:16.731431 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 01 15:26:16.731431 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 01 15:26:16.731431 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:26:16.731431 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:26:16.731431 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:26:16.731431 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:26:16.731431 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:26:16.731431 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:26:16.732280 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:26:16.732280 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 01 15:26:16.732280 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:26:16.732280 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:26:16.732280 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:26:16.732280 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:26:16.732280 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:26:16.732280 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:26:16.732280 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:26:16.732280 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:26:16.732280 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 01 15:26:16.732280 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 15:26:16.732280 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 01 15:26:16.732280 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 01 15:26:16.735751 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 490/997] 10.222.0.102 () {56 vars in 1116 bytes} [Mon Aug 1 15:26:16 2022] GET /identity/v3/services/compute => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:26:16.737621 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc428c6-2de2-48c0-9790-e69fb401338c None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:26:16.842121 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc428c6-2de2-48c0-9790-e69fb401338c None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:26:16.881430 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d8feaf-866d-4a20-8f4e-926614b40e5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:26:16.883080 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d8feaf-866d-4a20-8f4e-926614b40e5b None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:16.883547 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d8feaf-866d-4a20-8f4e-926614b40e5b None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:16.883995 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d8feaf-866d-4a20-8f4e-926614b40e5b None admin] PATH_INFO: `/v3/services` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:16.884878 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d8feaf-866d-4a20-8f4e-926614b40e5b None admin] RBAC: Adding query filter params (name=compute) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:26:16.885355 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d8feaf-866d-4a20-8f4e-926614b40e5b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:26:16.886972 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d8feaf-866d-4a20-8f4e-926614b40e5b None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:26:16.898204 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 508/998] 10.222.0.102 () {56 vars in 1117 bytes} [Mon Aug 1 15:26:16 2022] GET /identity/v3/services?name=compute => generated 125 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:26:16.899353 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83da580-480c-4472-896b-d6db4f39fadf None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:26:17.002174 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83da580-480c-4472-896b-d6db4f39fadf None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:26:17.035699 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b4d4df-8d0c-4765-90b4-feaa1f3185d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:26:17.036315 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b4d4df-8d0c-4765-90b4-feaa1f3185d5 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:17.036594 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b4d4df-8d0c-4765-90b4-feaa1f3185d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:17.036878 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b4d4df-8d0c-4765-90b4-feaa1f3185d5 None admin] PATH_INFO: `/v3/services` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:17.037557 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b4d4df-8d0c-4765-90b4-feaa1f3185d5 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:26:17.037859 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b4d4df-8d0c-4765-90b4-feaa1f3185d5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:26:17.039273 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b4d4df-8d0c-4765-90b4-feaa1f3185d5 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:26:17.049096 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 491/999] 10.222.0.102 () {56 vars in 1117 bytes} [Mon Aug 1 15:26:16 2022] GET /identity/v3/services?type=compute => generated 354 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:26:17.050029 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d8feaf-866d-4a20-8f4e-926614b40e5b None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:26:17.108469 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:26:17.153598 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d8feaf-866d-4a20-8f4e-926614b40e5b None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:26:17.187221 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dfd0bb-0418-4594-ae01-a20667e72800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:26:17.187839 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dfd0bb-0418-4594-ae01-a20667e72800 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:17.188116 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dfd0bb-0418-4594-ae01-a20667e72800 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:17.188386 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dfd0bb-0418-4594-ae01-a20667e72800 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:17.189171 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dfd0bb-0418-4594-ae01-a20667e72800 None admin] RBAC: Adding query filter params (interface=public, service_id=f0d01d400f4f4789894528fb1bd8f41b, region_id=RegionOne) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:26:17.189480 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dfd0bb-0418-4594-ae01-a20667e72800 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:26:17.190858 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dfd0bb-0418-4594-ae01-a20667e72800 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:26:17.200693 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 509/1000] 10.222.0.102 () {56 vars in 1256 bytes} [Mon Aug 1 15:26:17 2022] GET /identity/v3/endpoints?service_id=f0d01d400f4f4789894528fb1bd8f41b&interface=public®ion_id=RegionOne => generated 195 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:26:17.202022 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b4d4df-8d0c-4765-90b4-feaa1f3185d5 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:26:17.247680 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:26:17.306369 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b4d4df-8d0c-4765-90b4-feaa1f3185d5 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:26:17.330620 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312f9cbe-8caf-4295-9408-f2230ebc9250 None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:17.330925 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312f9cbe-8caf-4295-9408-f2230ebc9250 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:17.331180 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312f9cbe-8caf-4295-9408-f2230ebc9250 None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:17.332534 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 510/1001] 10.222.0.102 () {54 vars in 931 bytes} [Mon Aug 1 15:26:17 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 15:26:17.337460 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36702bf-245b-45c7-813a-c42bfaf85975 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:17.337743 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36702bf-245b-45c7-813a-c42bfaf85975 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:17.338015 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36702bf-245b-45c7-813a-c42bfaf85975 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:17.343507 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d05661b-e6aa-435d-a531-acca5f1becad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:26:17.344132 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d05661b-e6aa-435d-a531-acca5f1becad None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:17.344411 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d05661b-e6aa-435d-a531-acca5f1becad None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:17.344684 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d05661b-e6aa-435d-a531-acca5f1becad None admin] PATH_INFO: `/v3/services` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:17.345389 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d05661b-e6aa-435d-a531-acca5f1becad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:26:17.346801 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d05661b-e6aa-435d-a531-acca5f1becad None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:26:17.353876 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 492/1002] 10.222.0.102 () {56 vars in 1092 bytes} [Mon Aug 1 15:26:17 2022] GET /identity/v3/services => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 15:26:17.365744 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-b36702bf-245b-45c7-813a-c42bfaf85975 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:26:17.367662 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-b36702bf-245b-45c7-813a-c42bfaf85975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:26:17.443409 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 511/1003] 10.222.0.102 () {58 vars in 1028 bytes} [Mon Aug 1 15:26:17 2022] POST /identity/v3/auth/tokens => generated 1562 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 15:26:17.466858 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d05661b-e6aa-435d-a531-acca5f1becad None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:26:17.574653 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d05661b-e6aa-435d-a531-acca5f1becad None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:26:17.582739 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:26:17.609981 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62595836-afcd-4fd7-9ebf-57a2107c4da2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:26:17.610921 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62595836-afcd-4fd7-9ebf-57a2107c4da2 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:17.611389 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62595836-afcd-4fd7-9ebf-57a2107c4da2 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:17.611982 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62595836-afcd-4fd7-9ebf-57a2107c4da2 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:17.612808 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62595836-afcd-4fd7-9ebf-57a2107c4da2 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:26:17.614424 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62595836-afcd-4fd7-9ebf-57a2107c4da2 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:26:17.624023 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-62595836-afcd-4fd7-9ebf-57a2107c4da2 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 01 15:26:17.624023 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:26:17.624023 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 01 15:26:17.624023 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 01 15:26:17.624023 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 01 15:26:17.624023 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 01 15:26:17.624023 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 01 15:26:17.624023 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 15:26:17.624023 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 01 15:26:17.624023 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 01 15:26:17.624023 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 15:26:17.624023 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 01 15:26:17.624023 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:26:17.624023 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:26:17.624023 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:26:17.624023 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:26:17.624023 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:26:17.625085 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:26:17.625085 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:26:17.625085 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:26:17.625085 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:26:17.625085 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:26:17.625085 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:26:17.625085 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 01 15:26:17.625085 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 01 15:26:17.625085 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 01 15:26:17.625085 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 01 15:26:17.625085 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:26:17.625085 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:26:17.625085 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:26:17.625085 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:26:17.625085 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:26:17.625085 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:26:17.625913 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:26:17.625913 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 01 15:26:17.625913 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:26:17.625913 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:26:17.625913 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:26:17.625913 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:26:17.625913 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:26:17.625913 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:26:17.625913 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:26:17.625913 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:26:17.625913 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 01 15:26:17.625913 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 15:26:17.625913 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 01 15:26:17.625913 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 01 15:26:17.626667 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 493/1004] 10.222.0.102 () {56 vars in 1131 bytes} [Mon Aug 1 15:26:17 2022] GET /identity/v3/services/object-store => generated 93 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:26:17.633799 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36702bf-245b-45c7-813a-c42bfaf85975 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:26:17.680772 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39981a73-099e-4ded-bfab-58e3ed95d1c4 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:17.681083 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39981a73-099e-4ded-bfab-58e3ed95d1c4 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:17.681362 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39981a73-099e-4ded-bfab-58e3ed95d1c4 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:17.683944 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 494/1005] 10.222.0.102 () {54 vars in 931 bytes} [Mon Aug 1 15:26:17 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 01 15:26:17.686308 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:26:17.687869 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aff5570-36c8-4709-b81d-43cc5095d671 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:17.688155 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aff5570-36c8-4709-b81d-43cc5095d671 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:17.688431 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aff5570-36c8-4709-b81d-43cc5095d671 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:17.706695 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-7aff5570-36c8-4709-b81d-43cc5095d671 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:26:17.707902 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-7aff5570-36c8-4709-b81d-43cc5095d671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:26:17.739613 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36702bf-245b-45c7-813a-c42bfaf85975 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:26:17.775704 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616b3858-374d-4e03-8817-79417292f161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:26:17.776323 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616b3858-374d-4e03-8817-79417292f161 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:17.776596 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616b3858-374d-4e03-8817-79417292f161 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:17.776884 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616b3858-374d-4e03-8817-79417292f161 None admin] PATH_INFO: `/v3/services` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:17.777549 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616b3858-374d-4e03-8817-79417292f161 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:26:17.777850 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616b3858-374d-4e03-8817-79417292f161 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:26:17.779207 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616b3858-374d-4e03-8817-79417292f161 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:26:17.789247 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 512/1006] 10.222.0.102 () {56 vars in 1127 bytes} [Mon Aug 1 15:26:17 2022] GET /identity/v3/services?name=object-store => generated 130 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:26:17.789383 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 495/1007] 10.222.0.102 () {58 vars in 1028 bytes} [Mon Aug 1 15:26:17 2022] POST /identity/v3/auth/tokens => generated 1562 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 01 15:26:17.790165 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616b3858-374d-4e03-8817-79417292f161 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:26:17.800132 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aff5570-36c8-4709-b81d-43cc5095d671 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:26:17.908424 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616b3858-374d-4e03-8817-79417292f161 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:26:17.910626 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:26:17.914562 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aff5570-36c8-4709-b81d-43cc5095d671 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:26:17.923661 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:26:17.944175 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd7561d-3713-4b3a-8e64-9394be84bf2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:26:17.945352 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd7561d-3713-4b3a-8e64-9394be84bf2e None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:17.945636 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd7561d-3713-4b3a-8e64-9394be84bf2e None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:17.945901 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd7561d-3713-4b3a-8e64-9394be84bf2e None admin] PATH_INFO: `/v3/services` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:17.946588 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd7561d-3713-4b3a-8e64-9394be84bf2e None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:26:17.946877 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd7561d-3713-4b3a-8e64-9394be84bf2e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:26:17.948246 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd7561d-3713-4b3a-8e64-9394be84bf2e None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:26:17.953540 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07050c75-623a-4c16-8e33-2b38ada35fc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:26:17.954162 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07050c75-623a-4c16-8e33-2b38ada35fc1 None admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:17.954439 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07050c75-623a-4c16-8e33-2b38ada35fc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:17.954796 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07050c75-623a-4c16-8e33-2b38ada35fc1 None admin] PATH_INFO: `/v3/services` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:17.955224 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 513/1008] 10.222.0.102 () {56 vars in 1127 bytes} [Mon Aug 1 15:26:17 2022] GET /identity/v3/services?type=object-store => generated 358 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:26:17.955411 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07050c75-623a-4c16-8e33-2b38ada35fc1 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:26:17.956760 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07050c75-623a-4c16-8e33-2b38ada35fc1 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:26:17.961269 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd7561d-3713-4b3a-8e64-9394be84bf2e None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:26:18.040573 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 496/1009] 10.222.0.102 () {60 vars in 1146 bytes} [Mon Aug 1 15:26:17 2022] POST /identity/v3/services => generated 243 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 15:26:18.068990 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd7561d-3713-4b3a-8e64-9394be84bf2e None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:26:18.115308 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee65ef25-2ea3-44f2-a399-bdbdcdfb8d45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:26:18.115937 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee65ef25-2ea3-44f2-a399-bdbdcdfb8d45 None admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:18.116215 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee65ef25-2ea3-44f2-a399-bdbdcdfb8d45 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:18.116505 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee65ef25-2ea3-44f2-a399-bdbdcdfb8d45 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:18.117275 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee65ef25-2ea3-44f2-a399-bdbdcdfb8d45 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:26:18.118677 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee65ef25-2ea3-44f2-a399-bdbdcdfb8d45 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:26:18.190771 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 514/1010] 10.222.0.102 () {60 vars in 1149 bytes} [Mon Aug 1 15:26:17 2022] POST /identity/v3/endpoints => generated 327 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:26:19.375237 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886adf42-c20d-499a-a0ff-f5b2d1a695e6 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:19.375758 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886adf42-c20d-499a-a0ff-f5b2d1a695e6 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:19.376156 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886adf42-c20d-499a-a0ff-f5b2d1a695e6 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:19.378656 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 497/1011] 10.222.0.102 () {54 vars in 931 bytes} [Mon Aug 1 15:26:19 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 15:26:19.385991 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518137e0-34e9-4408-b7a6-9c75aa214be1 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:19.386438 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518137e0-34e9-4408-b7a6-9c75aa214be1 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:19.386671 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518137e0-34e9-4408-b7a6-9c75aa214be1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:19.405569 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-518137e0-34e9-4408-b7a6-9c75aa214be1 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:26:19.406755 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-518137e0-34e9-4408-b7a6-9c75aa214be1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:26:19.435159 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:26:19.485013 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 515/1012] 10.222.0.102 () {58 vars in 1028 bytes} [Mon Aug 1 15:26:19 2022] POST /identity/v3/auth/tokens => generated 1806 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 15:26:19.505115 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886adf42-c20d-499a-a0ff-f5b2d1a695e6 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:26:19.607719 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886adf42-c20d-499a-a0ff-f5b2d1a695e6 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:26:19.641267 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e14bdf9-3a76-4329-8361-0de64d600c83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:26:19.641823 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e14bdf9-3a76-4329-8361-0de64d600c83 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:19.642100 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e14bdf9-3a76-4329-8361-0de64d600c83 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:19.642366 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e14bdf9-3a76-4329-8361-0de64d600c83 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:19.642987 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e14bdf9-3a76-4329-8361-0de64d600c83 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:26:19.644335 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e14bdf9-3a76-4329-8361-0de64d600c83 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:26:19.653948 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-9e14bdf9-3a76-4329-8361-0de64d600c83 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 01 15:26:19.653948 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:26:19.653948 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 01 15:26:19.653948 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 01 15:26:19.653948 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 01 15:26:19.653948 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 01 15:26:19.653948 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 01 15:26:19.653948 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 15:26:19.653948 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 01 15:26:19.653948 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 01 15:26:19.653948 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 15:26:19.653948 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 01 15:26:19.653948 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:26:19.653948 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:26:19.653948 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:26:19.653948 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:26:19.653948 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:26:19.655148 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:26:19.655148 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:26:19.655148 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:26:19.655148 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:26:19.655148 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:26:19.655148 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:26:19.655148 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 01 15:26:19.655148 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 01 15:26:19.655148 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 01 15:26:19.655148 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 01 15:26:19.655148 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:26:19.655148 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:26:19.655148 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:26:19.655148 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:26:19.655148 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:26:19.655148 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:26:19.655982 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:26:19.655982 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 01 15:26:19.655982 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:26:19.655982 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:26:19.655982 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:26:19.655982 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:26:19.655982 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:26:19.655982 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:26:19.655982 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:26:19.655982 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:26:19.655982 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 01 15:26:19.655982 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 15:26:19.655982 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 01 15:26:19.655982 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 01 15:26:19.663459 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 498/1013] 10.222.0.102 () {56 vars in 1116 bytes} [Mon Aug 1 15:26:19 2022] GET /identity/v3/services/compute => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:26:19.663608 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518137e0-34e9-4408-b7a6-9c75aa214be1 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:26:19.823299 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518137e0-34e9-4408-b7a6-9c75aa214be1 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:26:19.857843 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4cc934-21ab-4a90-9247-615755271f80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:26:19.858460 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4cc934-21ab-4a90-9247-615755271f80 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:19.858736 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4cc934-21ab-4a90-9247-615755271f80 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:19.859004 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4cc934-21ab-4a90-9247-615755271f80 None admin] PATH_INFO: `/v3/services` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:19.859674 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4cc934-21ab-4a90-9247-615755271f80 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:26:19.859972 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4cc934-21ab-4a90-9247-615755271f80 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:26:19.861384 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4cc934-21ab-4a90-9247-615755271f80 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:26:19.867069 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 516/1014] 10.222.0.102 () {56 vars in 1117 bytes} [Mon Aug 1 15:26:19 2022] GET /identity/v3/services?name=compute => generated 125 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:26:19.872524 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e14bdf9-3a76-4329-8361-0de64d600c83 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:26:19.905844 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:26:19.983265 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e14bdf9-3a76-4329-8361-0de64d600c83 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:26:20.017583 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fae434f-3d59-447e-a400-ba6e5346dab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:26:20.018198 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fae434f-3d59-447e-a400-ba6e5346dab7 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:20.018475 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fae434f-3d59-447e-a400-ba6e5346dab7 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:20.018743 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fae434f-3d59-447e-a400-ba6e5346dab7 None admin] PATH_INFO: `/v3/services` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:20.019415 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fae434f-3d59-447e-a400-ba6e5346dab7 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:26:20.019720 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fae434f-3d59-447e-a400-ba6e5346dab7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:26:20.021112 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fae434f-3d59-447e-a400-ba6e5346dab7 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:26:20.026422 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 499/1015] 10.222.0.102 () {56 vars in 1117 bytes} [Mon Aug 1 15:26:19 2022] GET /identity/v3/services?type=compute => generated 354 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:26:20.031958 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4cc934-21ab-4a90-9247-615755271f80 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:26:20.059335 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:26:20.113907 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3a569d-dfd4-45d8-8682-e56c36b41a03 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:20.114271 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3a569d-dfd4-45d8-8682-e56c36b41a03 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:20.114556 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3a569d-dfd4-45d8-8682-e56c36b41a03 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:20.116980 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 500/1016] 10.222.0.102 () {54 vars in 931 bytes} [Mon Aug 1 15:26:20 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 01 15:26:20.121672 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ed8518-28a6-4a99-8954-63980e59f990 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:20.121948 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ed8518-28a6-4a99-8954-63980e59f990 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:20.122213 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ed8518-28a6-4a99-8954-63980e59f990 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:20.141080 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-86ed8518-28a6-4a99-8954-63980e59f990 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:26:20.142269 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-86ed8518-28a6-4a99-8954-63980e59f990 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:26:20.156634 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4cc934-21ab-4a90-9247-615755271f80 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:26:20.193542 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfee6242-255d-47e7-abcc-2577b8639360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:26:20.194160 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfee6242-255d-47e7-abcc-2577b8639360 None admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:20.194540 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfee6242-255d-47e7-abcc-2577b8639360 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:20.195322 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfee6242-255d-47e7-abcc-2577b8639360 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:20.196047 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfee6242-255d-47e7-abcc-2577b8639360 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:26:20.197450 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfee6242-255d-47e7-abcc-2577b8639360 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:26:20.213483 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 501/1017] 10.222.0.102 () {58 vars in 1028 bytes} [Mon Aug 1 15:26:20 2022] POST /identity/v3/auth/tokens => generated 1806 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 01 15:26:20.236430 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ed8518-28a6-4a99-8954-63980e59f990 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:26:20.256576 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:26:20.314653 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 517/1018] 10.222.0.102 () {60 vars in 1149 bytes} [Mon Aug 1 15:26:20 2022] POST /identity/v3/endpoints => generated 336 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:26:20.315903 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f880bd19-2af4-4015-b239-327c8029fefc None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:20.316184 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f880bd19-2af4-4015-b239-327c8029fefc None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:20.316453 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f880bd19-2af4-4015-b239-327c8029fefc None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:20.317839 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 518/1019] 10.222.0.102 () {54 vars in 931 bytes} [Mon Aug 1 15:26:20 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 15:26:20.323676 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84529ec5-d48d-4f48-8a3d-0545bb32e17d None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:20.323981 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84529ec5-d48d-4f48-8a3d-0545bb32e17d None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:20.324388 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84529ec5-d48d-4f48-8a3d-0545bb32e17d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:20.340187 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ed8518-28a6-4a99-8954-63980e59f990 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:26:20.344982 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-84529ec5-d48d-4f48-8a3d-0545bb32e17d None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:26:20.346226 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-84529ec5-d48d-4f48-8a3d-0545bb32e17d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:26:20.391227 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5612f65f-213c-4698-a64a-158df0fe40fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:26:20.392034 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5612f65f-213c-4698-a64a-158df0fe40fb None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:20.392314 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5612f65f-213c-4698-a64a-158df0fe40fb None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:20.392583 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5612f65f-213c-4698-a64a-158df0fe40fb None admin] PATH_INFO: `/v3/services/image` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:20.393265 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5612f65f-213c-4698-a64a-158df0fe40fb None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:26:20.394744 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5612f65f-213c-4698-a64a-158df0fe40fb None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:26:20.405303 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-5612f65f-213c-4698-a64a-158df0fe40fb None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 01 15:26:20.405303 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:26:20.405303 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 01 15:26:20.405303 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 01 15:26:20.405303 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 01 15:26:20.405303 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 01 15:26:20.405303 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 01 15:26:20.405303 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 15:26:20.405303 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 01 15:26:20.405303 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 01 15:26:20.405303 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 15:26:20.405303 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 01 15:26:20.405303 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:26:20.405303 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:26:20.405303 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:26:20.405303 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:26:20.405303 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:26:20.406488 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:26:20.406488 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:26:20.406488 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:26:20.406488 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:26:20.406488 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:26:20.406488 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:26:20.406488 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 01 15:26:20.406488 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 01 15:26:20.406488 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 01 15:26:20.406488 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 01 15:26:20.406488 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:26:20.406488 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:26:20.406488 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:26:20.406488 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:26:20.406488 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:26:20.406488 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:26:20.407403 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:26:20.407403 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 01 15:26:20.407403 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:26:20.407403 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:26:20.407403 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:26:20.407403 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:26:20.407403 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:26:20.407403 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:26:20.407403 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:26:20.407403 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:26:20.407403 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 01 15:26:20.407403 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 15:26:20.407403 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 01 15:26:20.407403 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 01 15:26:20.407403 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 502/1020] 10.222.0.102 () {56 vars in 1110 bytes} [Mon Aug 1 15:26:20 2022] GET /identity/v3/services/image => generated 86 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 15:26:20.413198 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5612f65f-213c-4698-a64a-158df0fe40fb None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:26:20.425885 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 519/1021] 10.222.0.102 () {58 vars in 1028 bytes} [Mon Aug 1 15:26:20 2022] POST /identity/v3/auth/tokens => generated 1963 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 15:26:20.449519 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84529ec5-d48d-4f48-8a3d-0545bb32e17d None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:26:20.463134 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:26:20.512609 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:26:20.538992 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5612f65f-213c-4698-a64a-158df0fe40fb None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:26:20.572097 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84529ec5-d48d-4f48-8a3d-0545bb32e17d None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:26:20.576018 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a2bbfc-0557-49de-840f-5ec2f30530b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:26:20.576957 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a2bbfc-0557-49de-840f-5ec2f30530b2 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:20.577238 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a2bbfc-0557-49de-840f-5ec2f30530b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:20.577509 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a2bbfc-0557-49de-840f-5ec2f30530b2 None admin] PATH_INFO: `/v3/services` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:20.578622 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a2bbfc-0557-49de-840f-5ec2f30530b2 None admin] RBAC: Adding query filter params (name=image) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:26:20.578622 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a2bbfc-0557-49de-840f-5ec2f30530b2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:26:20.579890 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a2bbfc-0557-49de-840f-5ec2f30530b2 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:26:20.586438 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 503/1022] 10.222.0.102 () {56 vars in 1113 bytes} [Mon Aug 1 15:26:20 2022] GET /identity/v3/services?name=image => generated 123 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:26:20.596134 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a2bbfc-0557-49de-840f-5ec2f30530b2 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:26:20.612114 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ee0fa9-9462-423c-b7f6-ca725be75929 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:26:20.612757 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ee0fa9-9462-423c-b7f6-ca725be75929 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:20.613068 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ee0fa9-9462-423c-b7f6-ca725be75929 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:20.613340 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ee0fa9-9462-423c-b7f6-ca725be75929 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:20.614541 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ee0fa9-9462-423c-b7f6-ca725be75929 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:26:20.615979 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ee0fa9-9462-423c-b7f6-ca725be75929 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:26:20.617874 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 520/1023] 10.222.0.102 () {56 vars in 1113 bytes} [Mon Aug 1 15:26:20 2022] GET /identity/v3/domains/default => generated 200 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:26:20.623586 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ee0fa9-9462-423c-b7f6-ca725be75929 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:26:20.708957 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a2bbfc-0557-49de-840f-5ec2f30530b2 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:26:20.710039 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:26:20.733604 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ee0fa9-9462-423c-b7f6-ca725be75929 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:26:20.746609 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a3ed79-4017-43de-afb8-c8f17071ae85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:26:20.747229 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a3ed79-4017-43de-afb8-c8f17071ae85 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:20.747508 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a3ed79-4017-43de-afb8-c8f17071ae85 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:20.747877 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a3ed79-4017-43de-afb8-c8f17071ae85 None admin] PATH_INFO: `/v3/services` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:20.748566 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a3ed79-4017-43de-afb8-c8f17071ae85 None admin] RBAC: Adding query filter params (type=image) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:26:20.748867 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a3ed79-4017-43de-afb8-c8f17071ae85 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:26:20.750228 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a3ed79-4017-43de-afb8-c8f17071ae85 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:26:20.755350 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 504/1024] 10.222.0.102 () {56 vars in 1113 bytes} [Mon Aug 1 15:26:20 2022] GET /identity/v3/services?type=image => generated 352 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:26:20.761022 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a3ed79-4017-43de-afb8-c8f17071ae85 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:26:20.768718 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb574d1-12d4-4376-9a6a-79d635dd4006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:26:20.769365 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb574d1-12d4-4376-9a6a-79d635dd4006 None admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:20.769650 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb574d1-12d4-4376-9a6a-79d635dd4006 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:20.769926 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb574d1-12d4-4376-9a6a-79d635dd4006 None admin] PATH_INFO: `/v3/projects` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:20.770509 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:26:20.770625 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb574d1-12d4-4376-9a6a-79d635dd4006 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:26:20.772016 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb574d1-12d4-4376-9a6a-79d635dd4006 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:26:20.871451 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 521/1025] 10.222.0.102 () {60 vars in 1146 bytes} [Mon Aug 1 15:26:20 2022] POST /identity/v3/projects => generated 312 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 15:26:20.876580 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a3ed79-4017-43de-afb8-c8f17071ae85 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:26:20.916288 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cf4095-7a13-4847-a093-6a8de0f23ef3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:26:20.916947 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cf4095-7a13-4847-a093-6a8de0f23ef3 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:20.917227 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cf4095-7a13-4847-a093-6a8de0f23ef3 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:20.917495 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cf4095-7a13-4847-a093-6a8de0f23ef3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:20.918257 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cf4095-7a13-4847-a093-6a8de0f23ef3 None admin] RBAC: Adding query filter params (interface=public, service_id=f43509f01adb4d34bcc4caf5ee682d77, region_id=RegionOne) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:26:20.918563 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cf4095-7a13-4847-a093-6a8de0f23ef3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:26:20.919938 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cf4095-7a13-4847-a093-6a8de0f23ef3 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:26:20.925980 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 505/1026] 10.222.0.102 () {56 vars in 1256 bytes} [Mon Aug 1 15:26:20 2022] GET /identity/v3/endpoints?service_id=f43509f01adb4d34bcc4caf5ee682d77&interface=public®ion_id=RegionOne => generated 195 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:26:20.931813 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb574d1-12d4-4376-9a6a-79d635dd4006 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:26:21.041277 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb574d1-12d4-4376-9a6a-79d635dd4006 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:26:21.071744 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:26:21.078359 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40d4c29-27aa-4d61-b79b-2e4d251fdb07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:26:21.078979 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40d4c29-27aa-4d61-b79b-2e4d251fdb07 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:21.082407 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40d4c29-27aa-4d61-b79b-2e4d251fdb07 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:21.082407 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40d4c29-27aa-4d61-b79b-2e4d251fdb07 None admin] PATH_INFO: `/v3/services` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:21.082407 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40d4c29-27aa-4d61-b79b-2e4d251fdb07 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:26:21.082407 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40d4c29-27aa-4d61-b79b-2e4d251fdb07 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:26:21.089118 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 522/1027] 10.222.0.102 () {56 vars in 1092 bytes} [Mon Aug 1 15:26:20 2022] GET /identity/v3/services => generated 1966 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:26:22.461175 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb122959-781f-43ab-8b8d-db88b511d6b9 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:22.461698 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb122959-781f-43ab-8b8d-db88b511d6b9 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:22.461778 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb122959-781f-43ab-8b8d-db88b511d6b9 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:22.463249 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 506/1028] 10.222.0.102 () {54 vars in 931 bytes} [Mon Aug 1 15:26:22 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 15:26:22.468128 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60853655-70d3-41ea-8f36-0b8ec1ecbd55 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:22.468505 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60853655-70d3-41ea-8f36-0b8ec1ecbd55 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:22.468699 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60853655-70d3-41ea-8f36-0b8ec1ecbd55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:22.487545 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-60853655-70d3-41ea-8f36-0b8ec1ecbd55 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:26:22.488738 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-60853655-70d3-41ea-8f36-0b8ec1ecbd55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:26:22.557532 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 523/1029] 10.222.0.102 () {58 vars in 1028 bytes} [Mon Aug 1 15:26:22 2022] POST /identity/v3/auth/tokens => generated 1963 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 15:26:22.580354 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb122959-781f-43ab-8b8d-db88b511d6b9 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:26:22.651754 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:26:22.684135 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb122959-781f-43ab-8b8d-db88b511d6b9 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:26:22.718335 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f34f24-4ca7-4649-9746-a86be992db18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:26:22.718901 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f34f24-4ca7-4649-9746-a86be992db18 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:22.719178 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f34f24-4ca7-4649-9746-a86be992db18 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:22.719447 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f34f24-4ca7-4649-9746-a86be992db18 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:22.730923 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f34f24-4ca7-4649-9746-a86be992db18 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:26:22.735940 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-33f34f24-4ca7-4649-9746-a86be992db18 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 01 15:26:22.735940 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:26:22.735940 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:26:22.735940 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:26:22.735940 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:26:22.735940 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:26:22.735940 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:26:22.735940 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:26:22.735940 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:26:22.735940 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:26:22.735940 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:26:22.735940 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:26:22.735940 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:26:22.735940 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:26:22.735940 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:26:22.735940 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:26:22.737162 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:26:22.737162 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:26:22.737162 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:26:22.737162 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:26:22.737162 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:26:22.737162 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:26:22.737162 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:26:22.737162 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:26:22.737162 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:26:22.737162 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:26:22.737162 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:26:22.737162 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 01 15:26:22.737162 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:26:22.737162 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:26:22.737162 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:26:22.737162 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:26:22.738042 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:26:22.738042 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:26:22.738042 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:26:22.738042 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:26:22.738042 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:26:22.738042 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:26:22.738042 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:26:22.738042 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:26:22.738042 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:26:22.738042 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:26:22.738042 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 01 15:26:22.738042 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 01 15:26:22.741176 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 507/1030] 10.222.0.102 () {56 vars in 1125 bytes} [Mon Aug 1 15:26:22 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:26:22.743861 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60853655-70d3-41ea-8f36-0b8ec1ecbd55 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:26:22.846873 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60853655-70d3-41ea-8f36-0b8ec1ecbd55 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:26:22.875955 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:26:22.889152 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379ad0ff-bd92-48af-81ad-b73e7b9efdd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:26:22.890223 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379ad0ff-bd92-48af-81ad-b73e7b9efdd0 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:22.890223 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379ad0ff-bd92-48af-81ad-b73e7b9efdd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:22.890362 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379ad0ff-bd92-48af-81ad-b73e7b9efdd0 None admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:22.891032 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379ad0ff-bd92-48af-81ad-b73e7b9efdd0 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:26:22.891337 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379ad0ff-bd92-48af-81ad-b73e7b9efdd0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:26:22.892714 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379ad0ff-bd92-48af-81ad-b73e7b9efdd0 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:26:22.907280 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f34f24-4ca7-4649-9746-a86be992db18 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:26:22.908317 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 524/1031] 10.222.0.102 () {56 vars in 1120 bytes} [Mon Aug 1 15:26:22 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 340 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:26:22.941623 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3946c2e-1c3b-45a5-bac4-45e4bd34c462 None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:22.941910 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3946c2e-1c3b-45a5-bac4-45e4bd34c462 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:22.942187 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3946c2e-1c3b-45a5-bac4-45e4bd34c462 None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:22.943569 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 525/1032] 10.222.0.102 () {54 vars in 931 bytes} [Mon Aug 1 15:26:22 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 01 15:26:22.949918 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a05b86-cecb-43bb-a1a3-f69d6e0a137b None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:22.950203 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a05b86-cecb-43bb-a1a3-f69d6e0a137b None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:22.950945 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a05b86-cecb-43bb-a1a3-f69d6e0a137b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:22.970428 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-23a05b86-cecb-43bb-a1a3-f69d6e0a137b None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:26:22.971543 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-23a05b86-cecb-43bb-a1a3-f69d6e0a137b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:26:23.019881 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f34f24-4ca7-4649-9746-a86be992db18 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:26:23.045413 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 526/1033] 10.222.0.102 () {58 vars in 1028 bytes} [Mon Aug 1 15:26:22 2022] POST /identity/v3/auth/tokens => generated 1963 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 01 15:26:23.050265 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:26:23.055879 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c73168-7fff-4469-bfbe-9bdc4f00a31e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:26:23.056525 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c73168-7fff-4469-bfbe-9bdc4f00a31e None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:23.056806 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c73168-7fff-4469-bfbe-9bdc4f00a31e None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:23.057124 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c73168-7fff-4469-bfbe-9bdc4f00a31e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:23.068624 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c73168-7fff-4469-bfbe-9bdc4f00a31e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:26:23.069384 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a05b86-cecb-43bb-a1a3-f69d6e0a137b None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:26:23.070146 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c73168-7fff-4469-bfbe-9bdc4f00a31e None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:26:23.086488 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-a6c73168-7fff-4469-bfbe-9bdc4f00a31e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:26:23.086488 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:26:23.086488 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:26:23.086488 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:26:23.086488 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:26:23.086488 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:26:23.086488 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:26:23.086488 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:26:23.086488 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:26:23.086488 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:26:23.086488 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:26:23.086488 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:26:23.086488 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:26:23.086488 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:26:23.086488 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:26:23.087669 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:26:23.087669 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:26:23.087669 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:26:23.087669 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:26:23.087669 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:26:23.087669 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:26:23.087669 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:26:23.087669 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:26:23.087669 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 01 15:26:23.087669 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:26:23.087669 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:26:23.087669 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:26:23.087669 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:26:23.087669 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:26:23.087669 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:26:23.087669 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:26:23.087669 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:26:23.088687 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:26:23.088687 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:26:23.088687 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:26:23.088687 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 01 15:26:23.095552 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 508/1034] 10.222.0.102 () {56 vars in 1113 bytes} [Mon Aug 1 15:26:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 15:26:23.096787 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de5b24c-fe0a-46d7-8834-5806fbcc95fc None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:23.097109 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de5b24c-fe0a-46d7-8834-5806fbcc95fc None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:23.097378 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de5b24c-fe0a-46d7-8834-5806fbcc95fc None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:23.098743 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 509/1035] 10.222.0.102 () {54 vars in 931 bytes} [Mon Aug 1 15:26:23 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 15:26:23.099426 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de5b24c-fe0a-46d7-8834-5806fbcc95fc None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:26:23.178773 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a05b86-cecb-43bb-a1a3-f69d6e0a137b None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:26:23.195432 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:26:23.200536 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de5b24c-fe0a-46d7-8834-5806fbcc95fc None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:26:23.214540 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7403389c-74be-45df-99b4-a4d9d7a954b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:26:23.215180 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7403389c-74be-45df-99b4-a4d9d7a954b9 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:23.215467 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7403389c-74be-45df-99b4-a4d9d7a954b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:23.215734 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7403389c-74be-45df-99b4-a4d9d7a954b9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:23.217063 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7403389c-74be-45df-99b4-a4d9d7a954b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:26:23.218517 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7403389c-74be-45df-99b4-a4d9d7a954b9 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:26:23.220134 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 527/1036] 10.222.0.102 () {56 vars in 1113 bytes} [Mon Aug 1 15:26:23 2022] GET /identity/v3/domains/default => generated 200 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:26:23.221364 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91698c6a-6f3f-4b2d-bef0-14d8a520db22 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:23.221587 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91698c6a-6f3f-4b2d-bef0-14d8a520db22 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:23.221863 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91698c6a-6f3f-4b2d-bef0-14d8a520db22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:23.240045 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-91698c6a-6f3f-4b2d-bef0-14d8a520db22 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:26:23.241277 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-91698c6a-6f3f-4b2d-bef0-14d8a520db22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:26:23.251724 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1b9321-0b95-45c7-82a4-613fef71e28f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:26:23.252343 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1b9321-0b95-45c7-82a4-613fef71e28f None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:23.252621 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1b9321-0b95-45c7-82a4-613fef71e28f None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:23.252967 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1b9321-0b95-45c7-82a4-613fef71e28f None admin] PATH_INFO: `/v3/domains` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:23.253665 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1b9321-0b95-45c7-82a4-613fef71e28f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:26:23.253971 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1b9321-0b95-45c7-82a4-613fef71e28f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:26:23.255350 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1b9321-0b95-45c7-82a4-613fef71e28f None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:26:23.275699 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 510/1037] 10.222.0.102 () {56 vars in 1114 bytes} [Mon Aug 1 15:26:23 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:26:23.275699 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1b9321-0b95-45c7-82a4-613fef71e28f None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:26:23.317124 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 528/1038] 10.222.0.102 () {58 vars in 1028 bytes} [Mon Aug 1 15:26:23 2022] POST /identity/v3/auth/tokens => generated 1963 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 15:26:23.317968 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91698c6a-6f3f-4b2d-bef0-14d8a520db22 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:26:23.318104 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:26:23.377648 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1b9321-0b95-45c7-82a4-613fef71e28f None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:26:23.413823 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ba8ce4-4eaa-4251-929d-913f76f5fcc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:26:23.414433 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ba8ce4-4eaa-4251-929d-913f76f5fcc9 None admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:23.414708 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ba8ce4-4eaa-4251-929d-913f76f5fcc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:23.415007 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ba8ce4-4eaa-4251-929d-913f76f5fcc9 None admin] PATH_INFO: `/v3/users` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:23.415668 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ba8ce4-4eaa-4251-929d-913f76f5fcc9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:26:23.417116 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ba8ce4-4eaa-4251-929d-913f76f5fcc9 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:26:23.420567 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91698c6a-6f3f-4b2d-bef0-14d8a520db22 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:26:23.435776 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:26:23.455781 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dffbeee-1624-451e-b7af-883f76dbdd51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:26:23.456480 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dffbeee-1624-451e-b7af-883f76dbdd51 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:23.456757 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dffbeee-1624-451e-b7af-883f76dbdd51 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:23.457054 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dffbeee-1624-451e-b7af-883f76dbdd51 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:23.464408 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dffbeee-1624-451e-b7af-883f76dbdd51 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:26:23.466030 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dffbeee-1624-451e-b7af-883f76dbdd51 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:26:23.477575 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-4dffbeee-1624-451e-b7af-883f76dbdd51 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 01 15:26:23.477575 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:26:23.477575 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:26:23.477575 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:26:23.477575 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:26:23.477575 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:26:23.477575 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:26:23.477575 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:26:23.477575 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:26:23.477575 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:26:23.477575 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:26:23.477575 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:26:23.477575 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 15:26:23.477575 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 15:26:23.477575 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 15:26:23.477575 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 15:26:23.479112 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:26:23.479112 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:26:23.479112 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 15:26:23.479112 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 15:26:23.479112 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 15:26:23.479112 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 15:26:23.479112 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:26:23.479112 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:26:23.479112 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:26:23.479112 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:26:23.479112 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:26:23.479112 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 01 15:26:23.479112 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:26:23.479112 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:26:23.479112 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:26:23.479112 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:26:23.479112 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:26:23.479112 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:26:23.480148 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:26:23.480148 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:26:23.480148 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 15:26:23.480148 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 15:26:23.480148 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 15:26:23.480148 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 15:26:23.480148 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 15:26:23.480148 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 15:26:23.480148 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 01 15:26:23.480148 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 01 15:26:23.480148 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 529/1039] 10.222.0.102 () {56 vars in 1098 bytes} [Mon Aug 1 15:26:23 2022] GET /identity/v3/users/nova => generated 82 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:26:23.480148 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dffbeee-1624-451e-b7af-883f76dbdd51 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:26:23.490691 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 511/1040] 10.222.0.102 () {60 vars in 1137 bytes} [Mon Aug 1 15:26:23 2022] POST /identity/v3/users => generated 286 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:26:23.492041 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ba8ce4-4eaa-4251-929d-913f76f5fcc9 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:26:23.611064 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:26:23.615073 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ba8ce4-4eaa-4251-929d-913f76f5fcc9 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:26:23.620350 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dffbeee-1624-451e-b7af-883f76dbdd51 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:26:23.654820 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b23992f-2c71-453c-a576-7e2f17c90332 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:26:23.660476 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b23992f-2c71-453c-a576-7e2f17c90332 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:23.660476 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b23992f-2c71-453c-a576-7e2f17c90332 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:23.660476 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b23992f-2c71-453c-a576-7e2f17c90332 None admin] PATH_INFO: `/v3/users` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:23.660476 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b23992f-2c71-453c-a576-7e2f17c90332 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:26:23.660476 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b23992f-2c71-453c-a576-7e2f17c90332 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:26:23.660476 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b23992f-2c71-453c-a576-7e2f17c90332 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:26:23.661020 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c613b32-4205-40ee-8f81-2582bc7b740d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:26:23.661020 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c613b32-4205-40ee-8f81-2582bc7b740d None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:23.661020 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c613b32-4205-40ee-8f81-2582bc7b740d None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:23.661020 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c613b32-4205-40ee-8f81-2582bc7b740d None admin] PATH_INFO: `/v3/services/image` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:23.661317 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c613b32-4205-40ee-8f81-2582bc7b740d None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:26:23.662954 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c613b32-4205-40ee-8f81-2582bc7b740d None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:26:23.673277 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-3c613b32-4205-40ee-8f81-2582bc7b740d None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 01 15:26:23.673277 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:26:23.673277 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 01 15:26:23.673277 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 01 15:26:23.673277 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 01 15:26:23.673277 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 01 15:26:23.673277 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 01 15:26:23.673277 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 15:26:23.673277 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 01 15:26:23.673277 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 01 15:26:23.673277 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 15:26:23.673277 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 01 15:26:23.673277 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:26:23.673277 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:26:23.673277 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:26:23.673277 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:26:23.673277 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:26:23.674320 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:26:23.674320 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:26:23.674320 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:26:23.674320 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:26:23.674320 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:26:23.674320 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:26:23.674320 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 01 15:26:23.674320 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 01 15:26:23.674320 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 01 15:26:23.674320 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 01 15:26:23.674320 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:26:23.674320 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:26:23.674320 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:26:23.674320 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:26:23.674320 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:26:23.674320 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:26:23.675174 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:26:23.675174 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 01 15:26:23.675174 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:26:23.675174 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:26:23.675174 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:26:23.675174 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:26:23.675174 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:26:23.675174 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:26:23.675174 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:26:23.675174 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:26:23.675174 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 01 15:26:23.675174 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 15:26:23.675174 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 01 15:26:23.675174 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 01 15:26:23.675174 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 530/1041] 10.222.0.102 () {56 vars in 1110 bytes} [Mon Aug 1 15:26:23 2022] GET /identity/v3/services/image => generated 86 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:26:23.681103 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c613b32-4205-40ee-8f81-2582bc7b740d None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:26:23.681763 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 512/1042] 10.222.0.102 () {56 vars in 1138 bytes} [Mon Aug 1 15:26:23 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 370 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:26:23.687291 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b23992f-2c71-453c-a576-7e2f17c90332 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:26:23.733220 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:26:23.799703 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b23992f-2c71-453c-a576-7e2f17c90332 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:26:23.799904 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c613b32-4205-40ee-8f81-2582bc7b740d None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:26:23.835622 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7872d408-3128-437e-825b-3636a4c6c688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:26:23.836021 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8fd0fc-2337-432b-8f2b-4693c18f4ce2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:26:23.836232 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7872d408-3128-437e-825b-3636a4c6c688 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:23.836504 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7872d408-3128-437e-825b-3636a4c6c688 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:23.836675 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8fd0fc-2337-432b-8f2b-4693c18f4ce2 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:23.836769 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7872d408-3128-437e-825b-3636a4c6c688 None admin] PATH_INFO: `/v3/services` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:23.836949 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8fd0fc-2337-432b-8f2b-4693c18f4ce2 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:23.837220 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8fd0fc-2337-432b-8f2b-4693c18f4ce2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:23.837460 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7872d408-3128-437e-825b-3636a4c6c688 None admin] RBAC: Adding query filter params (name=image) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:26:23.837765 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7872d408-3128-437e-825b-3636a4c6c688 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:26:23.839131 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7872d408-3128-437e-825b-3636a4c6c688 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:26:23.844106 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 531/1043] 10.222.0.102 () {56 vars in 1113 bytes} [Mon Aug 1 15:26:23 2022] GET /identity/v3/services?name=image => generated 123 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:26:23.850408 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7872d408-3128-437e-825b-3636a4c6c688 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:26:23.866947 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:26:23.921580 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8fd0fc-2337-432b-8f2b-4693c18f4ce2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:26:23.923143 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8fd0fc-2337-432b-8f2b-4693c18f4ce2 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:26:23.962044 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7872d408-3128-437e-825b-3636a4c6c688 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:26:23.963720 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:26:23.998261 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca665bee-e680-46ec-83f9-735b35faf1b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:26:23.998887 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca665bee-e680-46ec-83f9-735b35faf1b9 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:23.999173 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca665bee-e680-46ec-83f9-735b35faf1b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:23.999448 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca665bee-e680-46ec-83f9-735b35faf1b9 None admin] PATH_INFO: `/v3/services` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:24.000124 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca665bee-e680-46ec-83f9-735b35faf1b9 None admin] RBAC: Adding query filter params (type=image) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:26:24.000447 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca665bee-e680-46ec-83f9-735b35faf1b9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:26:24.001864 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca665bee-e680-46ec-83f9-735b35faf1b9 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:26:24.011444 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 532/1044] 10.222.0.102 () {56 vars in 1113 bytes} [Mon Aug 1 15:26:23 2022] GET /identity/v3/services?type=image => generated 352 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:26:24.012424 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca665bee-e680-46ec-83f9-735b35faf1b9 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:26:24.036267 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 513/1045] 10.222.0.102 () {58 vars in 1287 bytes} [Mon Aug 1 15:26:23 2022] GET /identity/v3/auth/tokens => generated 1963 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 01 15:26:24.042997 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8fd0fc-2337-432b-8f2b-4693c18f4ce2 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:26:24.100661 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:26:24.126975 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca665bee-e680-46ec-83f9-735b35faf1b9 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:26:24.148199 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8fd0fc-2337-432b-8f2b-4693c18f4ce2 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:26:24.166859 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5bc173-0b26-46b6-ad78-643ccf8e0e21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:26:24.167484 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5bc173-0b26-46b6-ad78-643ccf8e0e21 None admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:24.167764 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5bc173-0b26-46b6-ad78-643ccf8e0e21 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:24.168036 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5bc173-0b26-46b6-ad78-643ccf8e0e21 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:24.168736 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5bc173-0b26-46b6-ad78-643ccf8e0e21 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:26:24.170143 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5bc173-0b26-46b6-ad78-643ccf8e0e21 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:26:24.183990 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef99ce3d-b0da-42a6-b22e-112c9c358feb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:26:24.184740 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef99ce3d-b0da-42a6-b22e-112c9c358feb None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:24.185062 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef99ce3d-b0da-42a6-b22e-112c9c358feb None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:24.185338 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef99ce3d-b0da-42a6-b22e-112c9c358feb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:24.196082 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef99ce3d-b0da-42a6-b22e-112c9c358feb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:26:24.197558 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef99ce3d-b0da-42a6-b22e-112c9c358feb None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:26:24.213121 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-ef99ce3d-b0da-42a6-b22e-112c9c358feb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:26:24.213121 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:26:24.213121 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:26:24.213121 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:26:24.213121 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:26:24.213121 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:26:24.213121 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:26:24.213121 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:26:24.213121 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:26:24.213121 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:26:24.213121 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:26:24.213121 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:26:24.213121 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:26:24.213121 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:26:24.213121 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:26:24.214236 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:26:24.214236 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:26:24.214236 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:26:24.214236 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:26:24.214236 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:26:24.214236 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:26:24.214236 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:26:24.214236 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:26:24.214236 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 01 15:26:24.214236 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:26:24.214236 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:26:24.214236 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:26:24.214236 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:26:24.214236 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:26:24.214236 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:26:24.214236 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:26:24.214236 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:26:24.215435 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:26:24.215435 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:26:24.215435 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:26:24.215435 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 01 15:26:24.218990 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 514/1046] 10.222.0.102 () {56 vars in 1113 bytes} [Mon Aug 1 15:26:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 15:26:24.219746 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef99ce3d-b0da-42a6-b22e-112c9c358feb None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:26:24.269432 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 533/1047] 10.222.0.102 () {60 vars in 1149 bytes} [Mon Aug 1 15:26:24 2022] POST /identity/v3/endpoints => generated 329 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:26:24.329192 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef99ce3d-b0da-42a6-b22e-112c9c358feb None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:26:24.340005 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:26:24.373754 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94e2f31-1dc3-48f0-a045-8d1c5338061a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:26:24.374706 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94e2f31-1dc3-48f0-a045-8d1c5338061a None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:24.375230 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94e2f31-1dc3-48f0-a045-8d1c5338061a None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:24.375601 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94e2f31-1dc3-48f0-a045-8d1c5338061a None admin] PATH_INFO: `/v3/domains` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:24.376691 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94e2f31-1dc3-48f0-a045-8d1c5338061a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:26:24.377132 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94e2f31-1dc3-48f0-a045-8d1c5338061a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:26:24.378653 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94e2f31-1dc3-48f0-a045-8d1c5338061a None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:26:24.396308 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 515/1048] 10.222.0.102 () {56 vars in 1114 bytes} [Mon Aug 1 15:26:24 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:26:24.397578 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5bc173-0b26-46b6-ad78-643ccf8e0e21 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:26:24.427060 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:26:24.506352 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5bc173-0b26-46b6-ad78-643ccf8e0e21 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:26:24.543531 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e587963a-e63e-4c63-b84e-28b2fd4a90ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:26:24.544099 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e587963a-e63e-4c63-b84e-28b2fd4a90ec None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:24.544374 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e587963a-e63e-4c63-b84e-28b2fd4a90ec None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:24.544642 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e587963a-e63e-4c63-b84e-28b2fd4a90ec None admin] PATH_INFO: `/v3/projects/service` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:24.551722 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e587963a-e63e-4c63-b84e-28b2fd4a90ec None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:26:24.553205 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e587963a-e63e-4c63-b84e-28b2fd4a90ec None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:26:24.565113 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-e587963a-e63e-4c63-b84e-28b2fd4a90ec None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 15:26:24.565113 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:26:24.565113 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:26:24.565113 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:26:24.565113 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:26:24.565113 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:26:24.565113 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:26:24.565113 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:26:24.565113 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:26:24.565113 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:26:24.565113 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:26:24.565113 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:26:24.565113 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 15:26:24.565113 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 15:26:24.565113 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 15:26:24.565990 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 15:26:24.565990 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:26:24.565990 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:26:24.565990 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:26:24.565990 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:26:24.565990 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:26:24.565990 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:26:24.565990 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:26:24.565990 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 01 15:26:24.565990 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:26:24.565990 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:26:24.565990 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:26:24.565990 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:26:24.565990 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:26:24.565990 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:26:24.565990 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:26:24.565990 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:26:24.566905 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 15:26:24.566905 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 15:26:24.566905 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 15:26:24.566905 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 15:26:24.566905 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 15:26:24.566905 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 15:26:24.566905 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 15:26:24.566905 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 01 15:26:24.566905 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 534/1049] 10.222.0.102 () {56 vars in 1116 bytes} [Mon Aug 1 15:26:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:26:24.574103 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94e2f31-1dc3-48f0-a045-8d1c5338061a None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:26:24.677164 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94e2f31-1dc3-48f0-a045-8d1c5338061a None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:26:24.714529 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014ead93-11ce-41cf-8da2-b03b6a44b859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:26:24.715196 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014ead93-11ce-41cf-8da2-b03b6a44b859 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:24.715468 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014ead93-11ce-41cf-8da2-b03b6a44b859 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:24.715711 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014ead93-11ce-41cf-8da2-b03b6a44b859 None admin] PATH_INFO: `/v3/projects` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:24.716466 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014ead93-11ce-41cf-8da2-b03b6a44b859 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:26:24.716768 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014ead93-11ce-41cf-8da2-b03b6a44b859 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:26:24.718231 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014ead93-11ce-41cf-8da2-b03b6a44b859 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:26:24.735323 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 516/1050] 10.222.0.102 () {56 vars in 1153 bytes} [Mon Aug 1 15:26:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:26:24.736886 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e587963a-e63e-4c63-b84e-28b2fd4a90ec None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:26:24.820948 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:26:24.839284 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e587963a-e63e-4c63-b84e-28b2fd4a90ec None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:26:24.880531 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7560a9d-c098-4b64-a49a-56b5a87ccbc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:26:24.881197 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7560a9d-c098-4b64-a49a-56b5a87ccbc5 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:24.881478 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7560a9d-c098-4b64-a49a-56b5a87ccbc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:24.881750 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7560a9d-c098-4b64-a49a-56b5a87ccbc5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:24.882578 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7560a9d-c098-4b64-a49a-56b5a87ccbc5 None admin] RBAC: Adding query filter params (role.id=b6e2017e93264842a2466736b83e4250, scope.project.id=2eb32fbe631843d8be84d41f8ba88d6e, user.id=77b43f1ee8cc4be3907a494abe90c1cc) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:26:24.882887 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7560a9d-c098-4b64-a49a-56b5a87ccbc5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:26:24.884602 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7560a9d-c098-4b64-a49a-56b5a87ccbc5 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:26:24.892618 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 535/1051] 10.222.0.102 () {56 vars in 1379 bytes} [Mon Aug 1 15:26:24 2022] GET /identity/v3/role_assignments?user.id=77b43f1ee8cc4be3907a494abe90c1cc&scope.project.id=2eb32fbe631843d8be84d41f8ba88d6e&role.id=b6e2017e93264842a2466736b83e4250 => generated 260 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:26:25.592994 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02174e78-02a2-4634-ab0d-7cecb158a7c3 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:25.593543 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02174e78-02a2-4634-ab0d-7cecb158a7c3 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:25.593543 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02174e78-02a2-4634-ab0d-7cecb158a7c3 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:25.594942 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 517/1052] 10.222.0.102 () {54 vars in 931 bytes} [Mon Aug 1 15:26:25 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 01 15:26:25.600105 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd441d43-46dd-42b9-99b8-aa99a70b8a1b None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:25.600508 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd441d43-46dd-42b9-99b8-aa99a70b8a1b None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:25.600684 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd441d43-46dd-42b9-99b8-aa99a70b8a1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:25.620922 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-cd441d43-46dd-42b9-99b8-aa99a70b8a1b None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:26:25.622122 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-cd441d43-46dd-42b9-99b8-aa99a70b8a1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:26:25.687664 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 536/1053] 10.222.0.102 () {58 vars in 1028 bytes} [Mon Aug 1 15:26:25 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 15:26:25.710500 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02174e78-02a2-4634-ab0d-7cecb158a7c3 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:26:25.737098 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:26:25.814216 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02174e78-02a2-4634-ab0d-7cecb158a7c3 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:26:25.848145 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fab889-e508-4cf3-a831-f2f30c4427f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:26:25.848704 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fab889-e508-4cf3-a831-f2f30c4427f9 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:25.849010 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fab889-e508-4cf3-a831-f2f30c4427f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:25.849282 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fab889-e508-4cf3-a831-f2f30c4427f9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:25.861053 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fab889-e508-4cf3-a831-f2f30c4427f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:26:25.865934 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-c4fab889-e508-4cf3-a831-f2f30c4427f9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 15:26:25.865934 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:26:25.865934 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:26:25.865934 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:26:25.865934 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:26:25.865934 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:26:25.865934 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:26:25.865934 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:26:25.865934 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:26:25.865934 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:26:25.865934 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:26:25.865934 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:26:25.865934 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:26:25.865934 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:26:25.865934 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:26:25.865934 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:26:25.866908 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:26:25.866908 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:26:25.866908 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:26:25.866908 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:26:25.866908 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:26:25.866908 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:26:25.866908 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:26:25.866908 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:26:25.866908 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:26:25.866908 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:26:25.866908 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:26:25.866908 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 01 15:26:25.866908 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:26:25.866908 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:26:25.866908 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:26:25.866908 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:26:25.867772 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:26:25.867772 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:26:25.867772 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:26:25.867772 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:26:25.867772 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:26:25.867772 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:26:25.867772 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:26:25.867772 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:26:25.867772 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:26:25.867772 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:26:25.867772 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 15:26:25.867772 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 01 15:26:25.872226 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 518/1054] 10.222.0.102 () {56 vars in 1101 bytes} [Mon Aug 1 15:26:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:26:25.876074 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd441d43-46dd-42b9-99b8-aa99a70b8a1b None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:26:25.956553 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:26:25.980403 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd441d43-46dd-42b9-99b8-aa99a70b8a1b None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:26:26.017529 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d31625d-c908-4235-b39b-89f48c689741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:26:26.018146 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d31625d-c908-4235-b39b-89f48c689741 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:26.018420 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d31625d-c908-4235-b39b-89f48c689741 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:26.018690 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d31625d-c908-4235-b39b-89f48c689741 None admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:26.019561 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d31625d-c908-4235-b39b-89f48c689741 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:26:26.019865 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d31625d-c908-4235-b39b-89f48c689741 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:26:26.021390 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d31625d-c908-4235-b39b-89f48c689741 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:26:26.034720 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 537/1055] 10.222.0.102 () {56 vars in 1104 bytes} [Mon Aug 1 15:26:25 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:26:26.035966 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fab889-e508-4cf3-a831-f2f30c4427f9 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:26:26.122252 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:26:26.138054 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fab889-e508-4cf3-a831-f2f30c4427f9 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:26:26.172386 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ac2190-cf0e-4968-b8c3-145d9a3245ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:26:26.173177 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ac2190-cf0e-4968-b8c3-145d9a3245ce None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:26.173454 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ac2190-cf0e-4968-b8c3-145d9a3245ce None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:26.173767 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ac2190-cf0e-4968-b8c3-145d9a3245ce None admin] PATH_INFO: `/v3/users/3e4a57f6b4f742a1b76a2f555ae58ad6` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:26.187083 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ac2190-cf0e-4968-b8c3-145d9a3245ce None admin] RBAC: Authorizing `identity:get_user(user_id=3e4a57f6b4f742a1b76a2f555ae58ad6)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:26:26.188537 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ac2190-cf0e-4968-b8c3-145d9a3245ce None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:26:26.195300 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 519/1056] 10.222.0.102 () {56 vars in 1182 bytes} [Mon Aug 1 15:26:26 2022] GET /identity/v3/users/3e4a57f6b4f742a1b76a2f555ae58ad6 => generated 286 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:26:26.196616 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d31625d-c908-4235-b39b-89f48c689741 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:26:26.297119 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d31625d-c908-4235-b39b-89f48c689741 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:26:26.318813 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2732afcb-eec3-4c52-ade8-b5a92fb216e6 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:26.319152 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2732afcb-eec3-4c52-ade8-b5a92fb216e6 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:26.319364 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2732afcb-eec3-4c52-ade8-b5a92fb216e6 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:26.321338 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 520/1057] 10.222.0.102 () {54 vars in 931 bytes} [Mon Aug 1 15:26:26 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 15:26:26.326128 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8b6461-8480-4148-99b2-2b6e1d182f7f None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:26.326666 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8b6461-8480-4148-99b2-2b6e1d182f7f None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:26.326940 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8b6461-8480-4148-99b2-2b6e1d182f7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:26.333516 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fa0fb2-0dc1-4d5d-8eca-bfaa2c41f034 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:26:26.334139 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fa0fb2-0dc1-4d5d-8eca-bfaa2c41f034 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:26.334421 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fa0fb2-0dc1-4d5d-8eca-bfaa2c41f034 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:26.334696 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fa0fb2-0dc1-4d5d-8eca-bfaa2c41f034 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:26.344308 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:26:26.345886 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-7e8b6461-8480-4148-99b2-2b6e1d182f7f None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:26:26.347298 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-7e8b6461-8480-4148-99b2-2b6e1d182f7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:26:26.407358 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fa0fb2-0dc1-4d5d-8eca-bfaa2c41f034 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:26:26.408931 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fa0fb2-0dc1-4d5d-8eca-bfaa2c41f034 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:26:26.417131 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 521/1058] 10.222.0.102 () {58 vars in 1028 bytes} [Mon Aug 1 15:26:26 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 01 15:26:26.439372 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8b6461-8480-4148-99b2-2b6e1d182f7f None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:26:26.517123 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:26:26.525323 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 538/1059] 10.222.0.102 () {58 vars in 1287 bytes} [Mon Aug 1 15:26:26 2022] GET /identity/v3/auth/tokens => generated 2113 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 01 15:26:26.526366 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fa0fb2-0dc1-4d5d-8eca-bfaa2c41f034 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:26:26.547331 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8b6461-8480-4148-99b2-2b6e1d182f7f None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:26:26.568745 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:26:26.587113 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78970268-43e9-45fa-a81b-3a804ffccdcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:26:26.587912 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78970268-43e9-45fa-a81b-3a804ffccdcc None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:26.588201 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78970268-43e9-45fa-a81b-3a804ffccdcc None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:26.588474 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78970268-43e9-45fa-a81b-3a804ffccdcc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:26.635378 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fa0fb2-0dc1-4d5d-8eca-bfaa2c41f034 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:26:26.660799 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78970268-43e9-45fa-a81b-3a804ffccdcc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:26:26.662202 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78970268-43e9-45fa-a81b-3a804ffccdcc None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:26:26.673314 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e005ca-3ec2-41dd-8a5c-d4abbfe3787d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:26:26.673950 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e005ca-3ec2-41dd-8a5c-d4abbfe3787d None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:26.674233 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e005ca-3ec2-41dd-8a5c-d4abbfe3787d None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:26.674506 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e005ca-3ec2-41dd-8a5c-d4abbfe3787d None admin] PATH_INFO: `/v3/projects/ec27543d14e3429baa42fc42b448f829` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:26.675658 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e005ca-3ec2-41dd-8a5c-d4abbfe3787d None admin] RBAC: Authorizing `identity:get_project(project_id=ec27543d14e3429baa42fc42b448f829)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:26:26.677105 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e005ca-3ec2-41dd-8a5c-d4abbfe3787d None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:26:26.678762 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 539/1060] 10.222.0.102 () {56 vars in 1191 bytes} [Mon Aug 1 15:26:26 2022] GET /identity/v3/projects/ec27543d14e3429baa42fc42b448f829 => generated 312 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:26:26.685889 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e005ca-3ec2-41dd-8a5c-d4abbfe3787d None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:26:26.735572 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:26:26.768147 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 522/1061] 10.222.0.102 () {58 vars in 1287 bytes} [Mon Aug 1 15:26:26 2022] GET /identity/v3/auth/tokens => generated 2113 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 01 15:26:26.774143 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78970268-43e9-45fa-a81b-3a804ffccdcc None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:26:26.803573 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e005ca-3ec2-41dd-8a5c-d4abbfe3787d None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:26:26.811953 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:26:26.841942 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2a5628-b9f3-43ce-afb0-62623f5a7ef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:26:26.842561 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2a5628-b9f3-43ce-afb0-62623f5a7ef7 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:26.842887 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2a5628-b9f3-43ce-afb0-62623f5a7ef7 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:26.843161 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2a5628-b9f3-43ce-afb0-62623f5a7ef7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:26.843967 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2a5628-b9f3-43ce-afb0-62623f5a7ef7 None admin] RBAC: Adding query filter params (role.id=de1374f966c04c27b579515b54334fd2, scope.project.id=ec27543d14e3429baa42fc42b448f829, user.id=3e4a57f6b4f742a1b76a2f555ae58ad6) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:26:26.844275 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2a5628-b9f3-43ce-afb0-62623f5a7ef7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:26:26.845720 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2a5628-b9f3-43ce-afb0-62623f5a7ef7 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:26:26.851288 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 540/1062] 10.222.0.102 () {56 vars in 1379 bytes} [Mon Aug 1 15:26:26 2022] GET /identity/v3/role_assignments?user.id=3e4a57f6b4f742a1b76a2f555ae58ad6&scope.project.id=ec27543d14e3429baa42fc42b448f829&role.id=de1374f966c04c27b579515b54334fd2 => generated 260 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:26:26.897347 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4c6370-be12-4522-843d-0c527a2d7a5a None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:26.897724 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4c6370-be12-4522-843d-0c527a2d7a5a None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:26.898001 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4c6370-be12-4522-843d-0c527a2d7a5a None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:26.899632 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 541/1063] 10.222.0.102 () {54 vars in 931 bytes} [Mon Aug 1 15:26:26 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 15:26:26.899756 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78970268-43e9-45fa-a81b-3a804ffccdcc None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:26:26.905162 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6c4f96-681a-4513-bb7a-ace4db3d328b None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:26.905492 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6c4f96-681a-4513-bb7a-ace4db3d328b None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:26.905726 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6c4f96-681a-4513-bb7a-ace4db3d328b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:26.925665 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-7b6c4f96-681a-4513-bb7a-ace4db3d328b None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:26:26.926926 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-7b6c4f96-681a-4513-bb7a-ace4db3d328b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:26:26.941643 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3522cac-db7d-4227-b91d-47287be059c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:26:26.942305 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3522cac-db7d-4227-b91d-47287be059c6 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:26.942586 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3522cac-db7d-4227-b91d-47287be059c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:26.942856 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3522cac-db7d-4227-b91d-47287be059c6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:26.955274 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3522cac-db7d-4227-b91d-47287be059c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:26:26.956765 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3522cac-db7d-4227-b91d-47287be059c6 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:26:26.972628 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-f3522cac-db7d-4227-b91d-47287be059c6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:26:26.972628 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:26:26.972628 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:26:26.972628 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:26:26.972628 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:26:26.972628 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:26:26.972628 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:26:26.972628 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:26:26.972628 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:26:26.972628 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:26:26.972628 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:26:26.972628 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:26:26.972628 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:26:26.972628 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:26:26.972628 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:26:26.973834 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:26:26.973834 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:26:26.973834 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:26:26.973834 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:26:26.973834 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:26:26.973834 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:26:26.973834 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:26:26.973834 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:26:26.973834 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 01 15:26:26.973834 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:26:26.973834 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:26:26.973834 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:26:26.973834 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:26:26.973834 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:26:26.973834 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:26:26.973834 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:26:26.973834 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:26:26.975294 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:26:26.975294 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:26:26.975294 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:26:26.975294 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 01 15:26:26.975294 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 523/1064] 10.222.0.102 () {56 vars in 1113 bytes} [Mon Aug 1 15:26:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 15:26:26.980620 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3522cac-db7d-4227-b91d-47287be059c6 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:26:27.008344 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:26:27.021696 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 542/1065] 10.222.0.102 () {58 vars in 1028 bytes} [Mon Aug 1 15:26:26 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 15:26:27.044598 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6c4f96-681a-4513-bb7a-ace4db3d328b None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:26:27.085255 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3522cac-db7d-4227-b91d-47287be059c6 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:26:27.121902 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df459d3f-cb1d-45b6-8485-ac45e83791ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:26:27.122937 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df459d3f-cb1d-45b6-8485-ac45e83791ee None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:27.123224 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df459d3f-cb1d-45b6-8485-ac45e83791ee None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:27.123499 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df459d3f-cb1d-45b6-8485-ac45e83791ee None admin] PATH_INFO: `/v3/domains` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:27.124557 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df459d3f-cb1d-45b6-8485-ac45e83791ee None admin] RBAC: Adding query filter params (name=Default) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:26:27.124891 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df459d3f-cb1d-45b6-8485-ac45e83791ee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:26:27.126592 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df459d3f-cb1d-45b6-8485-ac45e83791ee None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:26:27.138952 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 524/1066] 10.222.0.102 () {56 vars in 1114 bytes} [Mon Aug 1 15:26:26 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:26:27.149447 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:26:27.152827 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6c4f96-681a-4513-bb7a-ace4db3d328b None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:26:27.192872 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abad4c0-1880-46f9-835e-4706f0387d40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:26:27.193488 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abad4c0-1880-46f9-835e-4706f0387d40 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:27.193772 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abad4c0-1880-46f9-835e-4706f0387d40 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:27.194047 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abad4c0-1880-46f9-835e-4706f0387d40 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:27.206756 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abad4c0-1880-46f9-835e-4706f0387d40 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:26:27.211947 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-2abad4c0-1880-46f9-835e-4706f0387d40 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 01 15:26:27.211947 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:26:27.211947 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:26:27.211947 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:26:27.211947 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:26:27.211947 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:26:27.211947 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:26:27.211947 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:26:27.211947 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:26:27.211947 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:26:27.211947 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:26:27.211947 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:26:27.211947 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:26:27.211947 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:26:27.211947 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:26:27.211947 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:26:27.212998 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:26:27.212998 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:26:27.212998 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:26:27.212998 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:26:27.212998 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:26:27.212998 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:26:27.212998 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:26:27.212998 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:26:27.212998 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:26:27.212998 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:26:27.212998 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:26:27.212998 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 01 15:26:27.212998 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:26:27.212998 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:26:27.212998 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:26:27.212998 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:26:27.219288 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:26:27.219288 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:26:27.219288 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:26:27.219288 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:26:27.219288 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:26:27.219288 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:26:27.219288 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:26:27.219288 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:26:27.219288 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:26:27.219288 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:26:27.219288 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 01 15:26:27.219288 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 01 15:26:27.219288 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 543/1067] 10.222.0.102 () {56 vars in 1125 bytes} [Mon Aug 1 15:26:27 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 15:26:27.220166 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df459d3f-cb1d-45b6-8485-ac45e83791ee None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:26:27.315429 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:26:27.332068 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df459d3f-cb1d-45b6-8485-ac45e83791ee None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:26:27.373000 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d53a53-dff9-46e6-b095-d20d8eb18dfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:26:27.373665 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d53a53-dff9-46e6-b095-d20d8eb18dfe None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:27.373946 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d53a53-dff9-46e6-b095-d20d8eb18dfe None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:27.374217 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d53a53-dff9-46e6-b095-d20d8eb18dfe None admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:27.374943 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d53a53-dff9-46e6-b095-d20d8eb18dfe None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:26:27.375244 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d53a53-dff9-46e6-b095-d20d8eb18dfe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:26:27.376615 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d53a53-dff9-46e6-b095-d20d8eb18dfe None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:26:27.385540 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 525/1068] 10.222.0.102 () {56 vars in 1120 bytes} [Mon Aug 1 15:26:27 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 340 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:26:27.391316 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abad4c0-1880-46f9-835e-4706f0387d40 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:26:27.497355 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abad4c0-1880-46f9-835e-4706f0387d40 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:26:27.530908 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97bf5a4-8c52-4d93-a166-5fd8ce523412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:26:27.532214 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97bf5a4-8c52-4d93-a166-5fd8ce523412 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:27.532501 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97bf5a4-8c52-4d93-a166-5fd8ce523412 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:27.532777 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97bf5a4-8c52-4d93-a166-5fd8ce523412 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:27.544137 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97bf5a4-8c52-4d93-a166-5fd8ce523412 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:26:27.545637 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97bf5a4-8c52-4d93-a166-5fd8ce523412 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:26:27.559867 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-d97bf5a4-8c52-4d93-a166-5fd8ce523412 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:26:27.559867 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:26:27.559867 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:26:27.559867 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:26:27.559867 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:26:27.559867 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:26:27.559867 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:26:27.559867 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:26:27.559867 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:26:27.559867 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:26:27.559867 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:26:27.559867 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:26:27.559867 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:26:27.559867 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:26:27.559867 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:26:27.561088 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:26:27.561088 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:26:27.561088 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:26:27.561088 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:26:27.561088 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:26:27.561088 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:26:27.561088 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:26:27.561088 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:26:27.561088 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 01 15:26:27.561088 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:26:27.561088 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:26:27.561088 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:26:27.561088 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:26:27.561088 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:26:27.561088 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:26:27.561088 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:26:27.561088 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:26:27.562301 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:26:27.562301 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:26:27.562301 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:26:27.562301 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 01 15:26:27.562818 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 544/1069] 10.222.0.102 () {56 vars in 1113 bytes} [Mon Aug 1 15:26:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:26:27.566977 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d53a53-dff9-46e6-b095-d20d8eb18dfe None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:26:27.674391 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d53a53-dff9-46e6-b095-d20d8eb18dfe None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:26:27.707208 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7361503a-f155-45e4-a22a-0925dfed3c7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:26:27.707819 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7361503a-f155-45e4-a22a-0925dfed3c7f None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:27.708098 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7361503a-f155-45e4-a22a-0925dfed3c7f None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:27.708372 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7361503a-f155-45e4-a22a-0925dfed3c7f None admin] PATH_INFO: `/v3/domains` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:27.709092 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7361503a-f155-45e4-a22a-0925dfed3c7f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:26:27.709398 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7361503a-f155-45e4-a22a-0925dfed3c7f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:26:27.711322 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7361503a-f155-45e4-a22a-0925dfed3c7f None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:26:27.722850 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 526/1070] 10.222.0.102 () {56 vars in 1114 bytes} [Mon Aug 1 15:26:27 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:26:27.728504 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97bf5a4-8c52-4d93-a166-5fd8ce523412 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:26:27.743700 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:26:27.827123 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97bf5a4-8c52-4d93-a166-5fd8ce523412 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:26:27.860397 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93ccba0-e815-4fd8-b3eb-8694db04ec2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:26:27.861054 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93ccba0-e815-4fd8-b3eb-8694db04ec2f None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:27.861334 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93ccba0-e815-4fd8-b3eb-8694db04ec2f None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:27.861604 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93ccba0-e815-4fd8-b3eb-8694db04ec2f None admin] PATH_INFO: `/v3/users/nova` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:27.868471 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93ccba0-e815-4fd8-b3eb-8694db04ec2f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:26:27.869949 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93ccba0-e815-4fd8-b3eb-8694db04ec2f None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:26:27.881463 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-f93ccba0-e815-4fd8-b3eb-8694db04ec2f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 01 15:26:27.881463 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:26:27.881463 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:26:27.881463 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:26:27.881463 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:26:27.881463 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:26:27.881463 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:26:27.881463 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:26:27.881463 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:26:27.881463 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:26:27.881463 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:26:27.881463 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:26:27.881463 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 15:26:27.881463 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 15:26:27.881463 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 15:26:27.881463 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 15:26:27.883165 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:26:27.883165 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:26:27.883165 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 15:26:27.883165 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 15:26:27.883165 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 15:26:27.883165 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 15:26:27.883165 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:26:27.883165 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:26:27.883165 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:26:27.883165 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:26:27.883165 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:26:27.883165 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 01 15:26:27.883165 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:26:27.883165 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:26:27.883165 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:26:27.883165 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:26:27.883165 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:26:27.883165 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:26:27.884283 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:26:27.884283 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:26:27.884283 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 15:26:27.884283 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 15:26:27.884283 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 15:26:27.884283 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 15:26:27.884283 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 15:26:27.884283 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 15:26:27.884283 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 01 15:26:27.884283 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 01 15:26:27.884283 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 545/1071] 10.222.0.102 () {56 vars in 1098 bytes} [Mon Aug 1 15:26:27 2022] GET /identity/v3/users/nova => generated 82 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:26:27.889011 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7361503a-f155-45e4-a22a-0925dfed3c7f None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:26:27.898945 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:26:27.989635 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7361503a-f155-45e4-a22a-0925dfed3c7f None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:26:28.024308 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c770fd97-b302-49b5-909a-872c078f71d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:26:28.024952 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c770fd97-b302-49b5-909a-872c078f71d8 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:28.025240 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c770fd97-b302-49b5-909a-872c078f71d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:28.025514 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c770fd97-b302-49b5-909a-872c078f71d8 None admin] PATH_INFO: `/v3/users` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:28.026299 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c770fd97-b302-49b5-909a-872c078f71d8 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:26:28.026603 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c770fd97-b302-49b5-909a-872c078f71d8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:26:28.028017 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c770fd97-b302-49b5-909a-872c078f71d8 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:26:28.045675 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 527/1072] 10.222.0.102 () {56 vars in 1138 bytes} [Mon Aug 1 15:26:27 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 370 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:26:28.051412 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93ccba0-e815-4fd8-b3eb-8694db04ec2f None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:26:28.121669 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:26:28.151378 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93ccba0-e815-4fd8-b3eb-8694db04ec2f None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:26:28.184566 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c395f72-d37e-4859-b964-69e6d3586305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:26:28.185219 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c395f72-d37e-4859-b964-69e6d3586305 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:28.185502 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c395f72-d37e-4859-b964-69e6d3586305 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:28.185774 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c395f72-d37e-4859-b964-69e6d3586305 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:28.196714 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c395f72-d37e-4859-b964-69e6d3586305 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:26:28.198189 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c395f72-d37e-4859-b964-69e6d3586305 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:26:28.212313 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-8c395f72-d37e-4859-b964-69e6d3586305 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:26:28.212313 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:26:28.212313 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:26:28.212313 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:26:28.212313 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:26:28.212313 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:26:28.212313 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:26:28.212313 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:26:28.212313 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:26:28.212313 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:26:28.212313 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:26:28.212313 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:26:28.212313 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:26:28.212313 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:26:28.212313 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:26:28.213377 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:26:28.213377 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:26:28.213377 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:26:28.213377 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:26:28.213377 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:26:28.213377 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:26:28.213377 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:26:28.213377 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:26:28.213377 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 01 15:26:28.213377 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:26:28.213377 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:26:28.213377 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:26:28.213377 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:26:28.213377 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:26:28.213377 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:26:28.213377 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:26:28.213377 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:26:28.214275 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:26:28.214275 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:26:28.214275 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:26:28.214275 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 01 15:26:28.214275 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 546/1073] 10.222.0.102 () {56 vars in 1113 bytes} [Mon Aug 1 15:26:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:26:28.219118 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c770fd97-b302-49b5-909a-872c078f71d8 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:26:28.280131 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:26:28.316798 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c770fd97-b302-49b5-909a-872c078f71d8 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:26:28.351624 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ccbc18-ccb9-4f98-8a48-7c6992afb6e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:26:28.352235 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ccbc18-ccb9-4f98-8a48-7c6992afb6e5 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:28.352532 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ccbc18-ccb9-4f98-8a48-7c6992afb6e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:28.352799 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ccbc18-ccb9-4f98-8a48-7c6992afb6e5 None admin] PATH_INFO: `/v3/domains` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:28.353505 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ccbc18-ccb9-4f98-8a48-7c6992afb6e5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:26:28.353803 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ccbc18-ccb9-4f98-8a48-7c6992afb6e5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:26:28.355144 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ccbc18-ccb9-4f98-8a48-7c6992afb6e5 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:26:28.366137 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 528/1074] 10.222.0.102 () {56 vars in 1114 bytes} [Mon Aug 1 15:26:28 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:26:28.372480 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c395f72-d37e-4859-b964-69e6d3586305 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:26:28.471146 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c395f72-d37e-4859-b964-69e6d3586305 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:26:28.494976 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:26:28.505410 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6767f780-e150-44a9-9f22-00c9bce3709f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:26:28.516703 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6767f780-e150-44a9-9f22-00c9bce3709f None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:28.516703 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6767f780-e150-44a9-9f22-00c9bce3709f None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:28.516703 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6767f780-e150-44a9-9f22-00c9bce3709f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:28.516703 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6767f780-e150-44a9-9f22-00c9bce3709f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:26:28.516703 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6767f780-e150-44a9-9f22-00c9bce3709f None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:26:28.526535 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-6767f780-e150-44a9-9f22-00c9bce3709f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 15:26:28.526535 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:26:28.526535 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:26:28.526535 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:26:28.526535 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:26:28.526535 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:26:28.526535 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:26:28.526535 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:26:28.526535 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:26:28.526535 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:26:28.526535 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:26:28.526535 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:26:28.526535 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 15:26:28.526535 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 15:26:28.526535 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 15:26:28.527440 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 15:26:28.527440 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:26:28.527440 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:26:28.527440 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:26:28.527440 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:26:28.527440 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:26:28.527440 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:26:28.527440 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:26:28.527440 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 01 15:26:28.527440 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:26:28.527440 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:26:28.527440 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:26:28.527440 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:26:28.527440 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:26:28.527440 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:26:28.527440 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:26:28.527440 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:26:28.528586 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 15:26:28.528586 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 15:26:28.528586 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 15:26:28.528586 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 15:26:28.528586 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 15:26:28.528586 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 15:26:28.528586 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 15:26:28.528586 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 01 15:26:28.528586 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 547/1075] 10.222.0.102 () {56 vars in 1116 bytes} [Mon Aug 1 15:26:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:26:28.533566 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ccbc18-ccb9-4f98-8a48-7c6992afb6e5 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:26:28.637651 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ccbc18-ccb9-4f98-8a48-7c6992afb6e5 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:26:28.659824 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:26:28.670594 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b34708-51ed-4629-bb9c-cdd2587ebe45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:26:28.671213 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b34708-51ed-4629-bb9c-cdd2587ebe45 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:28.671497 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b34708-51ed-4629-bb9c-cdd2587ebe45 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:28.671765 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b34708-51ed-4629-bb9c-cdd2587ebe45 None admin] PATH_INFO: `/v3/projects` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:28.672511 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b34708-51ed-4629-bb9c-cdd2587ebe45 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:26:28.672816 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b34708-51ed-4629-bb9c-cdd2587ebe45 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:26:28.674288 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b34708-51ed-4629-bb9c-cdd2587ebe45 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:26:28.686608 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 529/1076] 10.222.0.102 () {56 vars in 1153 bytes} [Mon Aug 1 15:26:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:26:28.693083 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6767f780-e150-44a9-9f22-00c9bce3709f None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:26:28.792176 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6767f780-e150-44a9-9f22-00c9bce3709f None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:26:28.825338 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5313d0-21b0-403e-a528-a4e85f3355a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:26:28.826002 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5313d0-21b0-403e-a528-a4e85f3355a9 None admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:28.826532 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5313d0-21b0-403e-a528-a4e85f3355a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:28.826806 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5313d0-21b0-403e-a528-a4e85f3355a9 None admin] PATH_INFO: `/v3/projects/2eb32fbe631843d8be84d41f8ba88d6e/users/77b43f1ee8cc4be3907a494abe90c1cc/roles/b6e2017e93264842a2466736b83e4250` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:28.829113 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5313d0-21b0-403e-a528-a4e85f3355a9 None admin] RBAC: Authorizing `identity:create_grant(project_id=2eb32fbe631843d8be84d41f8ba88d6e, user_id=77b43f1ee8cc4be3907a494abe90c1cc, role_id=b6e2017e93264842a2466736b83e4250)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:26:28.830545 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5313d0-21b0-403e-a528-a4e85f3355a9 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:26:28.873139 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e1abd0-6d57-4a6a-a4c1-c686aeb8ef7b None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:28.873422 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e1abd0-6d57-4a6a-a4c1-c686aeb8ef7b None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:28.873695 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e1abd0-6d57-4a6a-a4c1-c686aeb8ef7b None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:28.875077 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 530/1077] 10.222.0.102 () {54 vars in 931 bytes} [Mon Aug 1 15:26:28 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 01 15:26:28.880335 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b897464b-c290-4988-9e82-39ae1ba0059d None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:28.880615 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b897464b-c290-4988-9e82-39ae1ba0059d None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:28.880928 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b897464b-c290-4988-9e82-39ae1ba0059d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:28.900194 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-b897464b-c290-4988-9e82-39ae1ba0059d None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:26:28.901451 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-b897464b-c290-4988-9e82-39ae1ba0059d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:26:28.917938 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 548/1078] 10.222.0.102 () {58 vars in 1444 bytes} [Mon Aug 1 15:26:28 2022] PUT /identity/v3/projects/2eb32fbe631843d8be84d41f8ba88d6e/users/77b43f1ee8cc4be3907a494abe90c1cc/roles/b6e2017e93264842a2466736b83e4250 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:26:28.974741 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 531/1079] 10.222.0.102 () {58 vars in 1028 bytes} [Mon Aug 1 15:26:28 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 01 15:26:28.998057 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5313d0-21b0-403e-a528-a4e85f3355a9 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:26:29.047019 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:26:29.104391 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5313d0-21b0-403e-a528-a4e85f3355a9 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:26:29.138752 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc1249c-94d9-4091-9942-5514f716d106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:26:29.139314 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc1249c-94d9-4091-9942-5514f716d106 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:29.139591 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc1249c-94d9-4091-9942-5514f716d106 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:29.139860 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc1249c-94d9-4091-9942-5514f716d106 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:29.150410 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc1249c-94d9-4091-9942-5514f716d106 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:26:29.155715 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-0bc1249c-94d9-4091-9942-5514f716d106 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 15:26:29.155715 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:26:29.155715 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:26:29.155715 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:26:29.155715 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:26:29.155715 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:26:29.155715 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:26:29.155715 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:26:29.155715 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:26:29.155715 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:26:29.155715 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:26:29.155715 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:26:29.155715 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:26:29.155715 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:26:29.155715 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:26:29.155715 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:26:29.156673 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:26:29.156673 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:26:29.156673 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:26:29.156673 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:26:29.156673 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:26:29.156673 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:26:29.156673 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:26:29.156673 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:26:29.156673 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:26:29.156673 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:26:29.156673 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:26:29.156673 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 01 15:26:29.156673 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:26:29.156673 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:26:29.156673 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:26:29.156673 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:26:29.157800 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:26:29.157800 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:26:29.157800 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:26:29.157800 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:26:29.157800 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:26:29.157800 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:26:29.157800 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:26:29.157800 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:26:29.157800 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:26:29.157800 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:26:29.157800 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 15:26:29.157800 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 01 15:26:29.157800 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 549/1080] 10.222.0.102 () {56 vars in 1101 bytes} [Mon Aug 1 15:26:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:26:29.162851 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b897464b-c290-4988-9e82-39ae1ba0059d None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:26:29.262821 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b897464b-c290-4988-9e82-39ae1ba0059d None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:26:29.277354 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:26:29.297010 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ec7dee-0955-4029-87ba-d858e9b62183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:26:29.297652 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ec7dee-0955-4029-87ba-d858e9b62183 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:29.297929 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ec7dee-0955-4029-87ba-d858e9b62183 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:29.298196 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ec7dee-0955-4029-87ba-d858e9b62183 None admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:29.298903 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ec7dee-0955-4029-87ba-d858e9b62183 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:26:29.299204 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ec7dee-0955-4029-87ba-d858e9b62183 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:26:29.300794 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ec7dee-0955-4029-87ba-d858e9b62183 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:26:29.310125 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 532/1081] 10.222.0.102 () {56 vars in 1104 bytes} [Mon Aug 1 15:26:29 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:26:29.315876 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc1249c-94d9-4091-9942-5514f716d106 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:26:29.417300 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc1249c-94d9-4091-9942-5514f716d106 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:26:29.419692 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:26:29.451500 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162450a2-dd92-471a-9831-556d159969d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:26:29.452144 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162450a2-dd92-471a-9831-556d159969d1 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:29.452424 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162450a2-dd92-471a-9831-556d159969d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:29.452695 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162450a2-dd92-471a-9831-556d159969d1 None admin] PATH_INFO: `/v3/users/3e4a57f6b4f742a1b76a2f555ae58ad6` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:29.453890 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162450a2-dd92-471a-9831-556d159969d1 None admin] RBAC: Authorizing `identity:get_user(user_id=3e4a57f6b4f742a1b76a2f555ae58ad6)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:26:29.455318 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162450a2-dd92-471a-9831-556d159969d1 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:26:29.456942 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 550/1082] 10.222.0.102 () {56 vars in 1182 bytes} [Mon Aug 1 15:26:29 2022] GET /identity/v3/users/3e4a57f6b4f742a1b76a2f555ae58ad6 => generated 286 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:26:29.463376 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ec7dee-0955-4029-87ba-d858e9b62183 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:26:29.561741 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ec7dee-0955-4029-87ba-d858e9b62183 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:26:29.595870 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d072683-24ac-49aa-aaf5-ac65226c618a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:26:29.596510 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d072683-24ac-49aa-aaf5-ac65226c618a None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:29.596790 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d072683-24ac-49aa-aaf5-ac65226c618a None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:29.597094 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d072683-24ac-49aa-aaf5-ac65226c618a None admin] PATH_INFO: `/v3/projects/ec27543d14e3429baa42fc42b448f829` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:29.598251 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d072683-24ac-49aa-aaf5-ac65226c618a None admin] RBAC: Authorizing `identity:get_project(project_id=ec27543d14e3429baa42fc42b448f829)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:26:29.599751 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d072683-24ac-49aa-aaf5-ac65226c618a None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:26:29.601492 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 533/1083] 10.222.0.102 () {56 vars in 1191 bytes} [Mon Aug 1 15:26:29 2022] GET /identity/v3/projects/ec27543d14e3429baa42fc42b448f829 => generated 312 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:26:29.607478 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162450a2-dd92-471a-9831-556d159969d1 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:26:29.713636 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162450a2-dd92-471a-9831-556d159969d1 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:26:29.746674 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7297abd-5f8c-43ab-a32f-a610fd690f47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:26:29.747328 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7297abd-5f8c-43ab-a32f-a610fd690f47 None admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:29.747607 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7297abd-5f8c-43ab-a32f-a610fd690f47 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:29.747878 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7297abd-5f8c-43ab-a32f-a610fd690f47 None admin] PATH_INFO: `/v3/projects/ec27543d14e3429baa42fc42b448f829/users/3e4a57f6b4f742a1b76a2f555ae58ad6/roles/de1374f966c04c27b579515b54334fd2` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:29.749840 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7297abd-5f8c-43ab-a32f-a610fd690f47 None admin] RBAC: Authorizing `identity:create_grant(project_id=ec27543d14e3429baa42fc42b448f829, user_id=3e4a57f6b4f742a1b76a2f555ae58ad6, role_id=de1374f966c04c27b579515b54334fd2)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:26:29.751276 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7297abd-5f8c-43ab-a32f-a610fd690f47 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:26:29.822738 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 551/1084] 10.222.0.102 () {58 vars in 1444 bytes} [Mon Aug 1 15:26:29 2022] PUT /identity/v3/projects/ec27543d14e3429baa42fc42b448f829/users/3e4a57f6b4f742a1b76a2f555ae58ad6/roles/de1374f966c04c27b579515b54334fd2 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:26:30.926696 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5957a012-f3ee-4b3c-9ec7-bd66385f271f None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:30.927239 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5957a012-f3ee-4b3c-9ec7-bd66385f271f None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:30.927239 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5957a012-f3ee-4b3c-9ec7-bd66385f271f None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:30.928602 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 534/1085] 10.222.0.102 () {54 vars in 931 bytes} [Mon Aug 1 15:26:30 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 15:26:30.934243 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4457c9-517b-44ca-935d-1850db97f08e None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:30.934623 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4457c9-517b-44ca-935d-1850db97f08e None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:30.934785 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4457c9-517b-44ca-935d-1850db97f08e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:30.952792 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-fa4457c9-517b-44ca-935d-1850db97f08e None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:26:30.954010 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-fa4457c9-517b-44ca-935d-1850db97f08e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:26:30.979538 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:26:31.020643 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 552/1086] 10.222.0.102 () {58 vars in 1028 bytes} [Mon Aug 1 15:26:30 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 15:26:31.044188 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5957a012-f3ee-4b3c-9ec7-bd66385f271f None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:26:31.091964 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:26:31.145439 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5957a012-f3ee-4b3c-9ec7-bd66385f271f None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:26:31.177914 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3195db19-aac3-43d3-bc0d-cf0ac75f7923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:26:31.178532 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3195db19-aac3-43d3-bc0d-cf0ac75f7923 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:31.178804 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3195db19-aac3-43d3-bc0d-cf0ac75f7923 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:31.179071 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3195db19-aac3-43d3-bc0d-cf0ac75f7923 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:31.189165 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3195db19-aac3-43d3-bc0d-cf0ac75f7923 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:26:31.193900 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-3195db19-aac3-43d3-bc0d-cf0ac75f7923 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 01 15:26:31.193900 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:26:31.193900 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:26:31.193900 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:26:31.193900 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:26:31.193900 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:26:31.193900 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:26:31.193900 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:26:31.193900 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:26:31.193900 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:26:31.193900 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:26:31.193900 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:26:31.193900 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:26:31.193900 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:26:31.193900 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:26:31.193900 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:26:31.194894 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:26:31.194894 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:26:31.194894 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:26:31.194894 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:26:31.194894 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:26:31.194894 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:26:31.194894 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:26:31.194894 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:26:31.194894 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:26:31.194894 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:26:31.194894 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:26:31.194894 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 01 15:26:31.194894 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:26:31.194894 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:26:31.194894 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:26:31.194894 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:26:31.195751 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:26:31.195751 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:26:31.195751 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:26:31.195751 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:26:31.195751 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:26:31.195751 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:26:31.195751 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:26:31.195751 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:26:31.195751 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:26:31.195751 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:26:31.195751 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 01 15:26:31.195751 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 01 15:26:31.195751 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 535/1087] 10.222.0.102 () {56 vars in 1125 bytes} [Mon Aug 1 15:26:31 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:26:31.201144 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4457c9-517b-44ca-935d-1850db97f08e None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:26:31.299842 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4457c9-517b-44ca-935d-1850db97f08e None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:26:31.332962 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef510f8-4555-464d-96e0-3d98b1ef6e28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:26:31.333578 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef510f8-4555-464d-96e0-3d98b1ef6e28 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:31.333859 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef510f8-4555-464d-96e0-3d98b1ef6e28 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:31.334127 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef510f8-4555-464d-96e0-3d98b1ef6e28 None admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:31.334833 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef510f8-4555-464d-96e0-3d98b1ef6e28 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:26:31.335670 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef510f8-4555-464d-96e0-3d98b1ef6e28 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:26:31.337119 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef510f8-4555-464d-96e0-3d98b1ef6e28 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:26:31.344993 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 553/1088] 10.222.0.102 () {56 vars in 1120 bytes} [Mon Aug 1 15:26:31 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 340 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:26:31.350646 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3195db19-aac3-43d3-bc0d-cf0ac75f7923 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:26:31.448173 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3195db19-aac3-43d3-bc0d-cf0ac75f7923 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:26:31.450502 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:26:31.481422 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8852cc3f-bb6b-4915-9098-08b4d5b2e5a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:26:31.482064 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8852cc3f-bb6b-4915-9098-08b4d5b2e5a7 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:31.482342 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8852cc3f-bb6b-4915-9098-08b4d5b2e5a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:31.482616 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8852cc3f-bb6b-4915-9098-08b4d5b2e5a7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:31.493059 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8852cc3f-bb6b-4915-9098-08b4d5b2e5a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:26:31.494500 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8852cc3f-bb6b-4915-9098-08b4d5b2e5a7 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:26:31.509583 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-8852cc3f-bb6b-4915-9098-08b4d5b2e5a7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:26:31.509583 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:26:31.509583 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:26:31.509583 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:26:31.509583 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:26:31.509583 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:26:31.509583 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:26:31.509583 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:26:31.509583 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:26:31.509583 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:26:31.509583 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:26:31.509583 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:26:31.509583 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:26:31.509583 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:26:31.509583 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:26:31.510701 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:26:31.510701 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:26:31.510701 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:26:31.510701 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:26:31.510701 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:26:31.510701 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:26:31.510701 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:26:31.510701 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:26:31.510701 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 01 15:26:31.510701 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:26:31.510701 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:26:31.510701 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:26:31.510701 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:26:31.510701 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:26:31.510701 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:26:31.510701 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:26:31.510701 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:26:31.511992 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:26:31.511992 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:26:31.511992 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:26:31.511992 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 01 15:26:31.513224 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 536/1089] 10.222.0.102 () {56 vars in 1113 bytes} [Mon Aug 1 15:26:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:26:31.516503 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef510f8-4555-464d-96e0-3d98b1ef6e28 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:26:31.542548 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:26:31.615362 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef510f8-4555-464d-96e0-3d98b1ef6e28 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:26:31.648713 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a03b97-2c6e-456e-8c37-32594b8c79c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:26:31.649340 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a03b97-2c6e-456e-8c37-32594b8c79c8 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:31.649610 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a03b97-2c6e-456e-8c37-32594b8c79c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:31.649870 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a03b97-2c6e-456e-8c37-32594b8c79c8 None admin] PATH_INFO: `/v3/domains` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:31.650537 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a03b97-2c6e-456e-8c37-32594b8c79c8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:26:31.650832 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a03b97-2c6e-456e-8c37-32594b8c79c8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:26:31.652180 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a03b97-2c6e-456e-8c37-32594b8c79c8 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:26:31.663156 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 554/1090] 10.222.0.102 () {56 vars in 1114 bytes} [Mon Aug 1 15:26:31 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:26:31.668898 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8852cc3f-bb6b-4915-9098-08b4d5b2e5a7 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:26:31.787629 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8852cc3f-bb6b-4915-9098-08b4d5b2e5a7 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:26:31.820262 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ca5730-6100-4b64-891c-b30d827f2057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:26:31.820933 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ca5730-6100-4b64-891c-b30d827f2057 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:31.821075 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1852a801-e5d1-4752-9f34-40e9efd733d8 None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:31.821214 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ca5730-6100-4b64-891c-b30d827f2057 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:31.821366 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1852a801-e5d1-4752-9f34-40e9efd733d8 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:31.821484 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ca5730-6100-4b64-891c-b30d827f2057 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:31.821642 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1852a801-e5d1-4752-9f34-40e9efd733d8 None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:31.822990 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 555/1091] 10.222.0.102 () {54 vars in 931 bytes} [Mon Aug 1 15:26:31 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 01 15:26:31.828240 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f45f10-694e-4165-818f-d4388b6b9b39 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:31.828527 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f45f10-694e-4165-818f-d4388b6b9b39 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:31.828808 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f45f10-694e-4165-818f-d4388b6b9b39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:31.829392 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ca5730-6100-4b64-891c-b30d827f2057 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:26:31.830855 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ca5730-6100-4b64-891c-b30d827f2057 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:26:31.842831 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-a5ca5730-6100-4b64-891c-b30d827f2057 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 01 15:26:31.842831 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:26:31.842831 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:26:31.842831 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:26:31.842831 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:26:31.842831 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:26:31.842831 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:26:31.842831 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:26:31.842831 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:26:31.842831 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:26:31.842831 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:26:31.842831 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:26:31.842831 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 15:26:31.842831 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 15:26:31.842831 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 15:26:31.842831 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 15:26:31.843793 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:26:31.843793 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:26:31.843793 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 15:26:31.843793 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 15:26:31.843793 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 15:26:31.843793 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 15:26:31.843793 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:26:31.843793 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:26:31.843793 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:26:31.843793 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:26:31.843793 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:26:31.843793 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 01 15:26:31.843793 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:26:31.843793 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:26:31.843793 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:26:31.843793 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:26:31.843793 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:26:31.843793 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:26:31.844724 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:26:31.844724 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:26:31.844724 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 15:26:31.844724 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 15:26:31.844724 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 15:26:31.844724 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 15:26:31.844724 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 15:26:31.844724 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 15:26:31.844724 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 01 15:26:31.844724 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 01 15:26:31.844724 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 537/1092] 10.222.0.102 () {56 vars in 1098 bytes} [Mon Aug 1 15:26:31 2022] GET /identity/v3/users/nova => generated 82 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 15:26:31.847211 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-39f45f10-694e-4165-818f-d4388b6b9b39 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:26:31.848470 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-39f45f10-694e-4165-818f-d4388b6b9b39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:26:31.849608 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ca5730-6100-4b64-891c-b30d827f2057 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:26:31.867820 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:26:31.917918 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 556/1093] 10.222.0.102 () {58 vars in 1028 bytes} [Mon Aug 1 15:26:31 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 01 15:26:31.941006 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f45f10-694e-4165-818f-d4388b6b9b39 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:26:31.952660 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ca5730-6100-4b64-891c-b30d827f2057 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:26:31.956644 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:26:31.986382 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a712ac-8b85-465d-b917-1ea4e4902aaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:26:31.986993 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a712ac-8b85-465d-b917-1ea4e4902aaf None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:31.987272 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a712ac-8b85-465d-b917-1ea4e4902aaf None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:31.987539 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a712ac-8b85-465d-b917-1ea4e4902aaf None admin] PATH_INFO: `/v3/users` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:31.988315 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a712ac-8b85-465d-b917-1ea4e4902aaf None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:26:31.988616 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a712ac-8b85-465d-b917-1ea4e4902aaf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:26:31.990059 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a712ac-8b85-465d-b917-1ea4e4902aaf None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:26:32.012264 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 538/1094] 10.222.0.102 () {56 vars in 1138 bytes} [Mon Aug 1 15:26:31 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 370 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:26:32.013378 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a712ac-8b85-465d-b917-1ea4e4902aaf None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:26:32.040086 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f45f10-694e-4165-818f-d4388b6b9b39 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:26:32.073783 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c71d24-7437-49f3-bf77-2648f48f92d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:26:32.074406 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c71d24-7437-49f3-bf77-2648f48f92d2 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:32.074678 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c71d24-7437-49f3-bf77-2648f48f92d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:32.074944 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c71d24-7437-49f3-bf77-2648f48f92d2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:32.085311 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c71d24-7437-49f3-bf77-2648f48f92d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:26:32.086637 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:26:32.090113 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-55c71d24-7437-49f3-bf77-2648f48f92d2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 15:26:32.090113 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:26:32.090113 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:26:32.090113 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:26:32.090113 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:26:32.090113 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:26:32.090113 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:26:32.090113 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:26:32.090113 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:26:32.090113 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:26:32.090113 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:26:32.090113 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:26:32.090113 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:26:32.090113 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:26:32.090113 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:26:32.090113 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:26:32.091064 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:26:32.091064 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:26:32.091064 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:26:32.091064 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:26:32.091064 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:26:32.091064 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:26:32.091064 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:26:32.091064 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:26:32.091064 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:26:32.091064 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:26:32.091064 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:26:32.091064 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 01 15:26:32.091064 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:26:32.091064 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:26:32.091064 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:26:32.091064 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:26:32.092029 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:26:32.092029 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:26:32.092029 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:26:32.092029 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:26:32.092029 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:26:32.092029 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:26:32.092029 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:26:32.092029 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:26:32.092029 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:26:32.092029 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:26:32.092029 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 15:26:32.092029 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 01 15:26:32.092029 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 557/1095] 10.222.0.102 () {56 vars in 1101 bytes} [Mon Aug 1 15:26:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 15:26:32.097428 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c71d24-7437-49f3-bf77-2648f48f92d2 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:26:32.111074 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a712ac-8b85-465d-b917-1ea4e4902aaf None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:26:32.145581 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d665f9-0eb9-4021-a748-1396080865bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:26:32.146193 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d665f9-0eb9-4021-a748-1396080865bf None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:32.146470 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d665f9-0eb9-4021-a748-1396080865bf None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:32.146741 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d665f9-0eb9-4021-a748-1396080865bf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:32.170304 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:26:32.196788 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c71d24-7437-49f3-bf77-2648f48f92d2 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:26:32.213731 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d665f9-0eb9-4021-a748-1396080865bf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:26:32.215189 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d665f9-0eb9-4021-a748-1396080865bf None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:26:32.229894 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8574cf64-8c05-4b0d-8841-70b6f1c7625f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:26:32.230504 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8574cf64-8c05-4b0d-8841-70b6f1c7625f None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:32.230804 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8574cf64-8c05-4b0d-8841-70b6f1c7625f None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:32.231078 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8574cf64-8c05-4b0d-8841-70b6f1c7625f None admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:32.231782 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8574cf64-8c05-4b0d-8841-70b6f1c7625f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:26:32.232089 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8574cf64-8c05-4b0d-8841-70b6f1c7625f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:26:32.233506 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8574cf64-8c05-4b0d-8841-70b6f1c7625f None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:26:32.242456 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 558/1096] 10.222.0.102 () {56 vars in 1104 bytes} [Mon Aug 1 15:26:32 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:26:32.248241 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8574cf64-8c05-4b0d-8841-70b6f1c7625f None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:26:32.287021 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:26:32.318074 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 539/1097] 10.222.0.102 () {58 vars in 1287 bytes} [Mon Aug 1 15:26:32 2022] GET /identity/v3/auth/tokens => generated 2113 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 01 15:26:32.319563 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d665f9-0eb9-4021-a748-1396080865bf None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:26:32.346615 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8574cf64-8c05-4b0d-8841-70b6f1c7625f None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:26:32.383807 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf22f2e-a042-4b2f-bca2-21677e21572e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:26:32.384438 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf22f2e-a042-4b2f-bca2-21677e21572e None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:32.384715 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf22f2e-a042-4b2f-bca2-21677e21572e None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:32.385026 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf22f2e-a042-4b2f-bca2-21677e21572e None admin] PATH_INFO: `/v3/users/3e4a57f6b4f742a1b76a2f555ae58ad6` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:32.386187 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf22f2e-a042-4b2f-bca2-21677e21572e None admin] RBAC: Authorizing `identity:get_user(user_id=3e4a57f6b4f742a1b76a2f555ae58ad6)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:26:32.387615 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf22f2e-a042-4b2f-bca2-21677e21572e None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:26:32.389256 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 559/1098] 10.222.0.102 () {56 vars in 1182 bytes} [Mon Aug 1 15:26:32 2022] GET /identity/v3/users/3e4a57f6b4f742a1b76a2f555ae58ad6 => generated 286 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:26:32.394776 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf22f2e-a042-4b2f-bca2-21677e21572e None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:26:32.398786 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:26:32.417783 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d665f9-0eb9-4021-a748-1396080865bf None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:26:32.451581 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d24529-71ae-4580-b48f-d0a0f4f28f6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:26:32.452262 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d24529-71ae-4580-b48f-d0a0f4f28f6e None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:32.452543 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d24529-71ae-4580-b48f-d0a0f4f28f6e None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:32.452815 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d24529-71ae-4580-b48f-d0a0f4f28f6e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:32.463478 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d24529-71ae-4580-b48f-d0a0f4f28f6e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:26:32.464943 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d24529-71ae-4580-b48f-d0a0f4f28f6e None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:26:32.479103 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-89d24529-71ae-4580-b48f-d0a0f4f28f6e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:26:32.479103 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:26:32.479103 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:26:32.479103 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:26:32.479103 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:26:32.479103 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:26:32.479103 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:26:32.479103 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:26:32.479103 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:26:32.479103 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:26:32.479103 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:26:32.479103 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:26:32.479103 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:26:32.479103 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:26:32.479103 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:26:32.480049 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:26:32.480049 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:26:32.480049 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:26:32.480049 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:26:32.480049 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:26:32.480049 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:26:32.480049 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:26:32.480049 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:26:32.480049 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 01 15:26:32.480049 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:26:32.480049 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:26:32.480049 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:26:32.480049 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:26:32.480049 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:26:32.480049 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:26:32.480049 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:26:32.480049 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:26:32.481164 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:26:32.481164 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:26:32.481164 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:26:32.481164 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 01 15:26:32.481164 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 540/1099] 10.222.0.102 () {56 vars in 1113 bytes} [Mon Aug 1 15:26:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:26:32.485797 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d24529-71ae-4580-b48f-d0a0f4f28f6e None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:26:32.495474 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf22f2e-a042-4b2f-bca2-21677e21572e None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:26:32.512687 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:26:32.529530 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c6c926-1d54-4973-beef-8f64e200e016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:26:32.536544 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c6c926-1d54-4973-beef-8f64e200e016 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:32.536544 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c6c926-1d54-4973-beef-8f64e200e016 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:32.536544 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c6c926-1d54-4973-beef-8f64e200e016 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:32.584338 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d24529-71ae-4580-b48f-d0a0f4f28f6e None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:26:32.600063 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c6c926-1d54-4973-beef-8f64e200e016 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:26:32.601557 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c6c926-1d54-4973-beef-8f64e200e016 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:26:32.604130 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:26:32.618991 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69227f9a-fc80-4ee7-8e54-e5125b4fc9de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:26:32.619605 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69227f9a-fc80-4ee7-8e54-e5125b4fc9de None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:32.619886 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69227f9a-fc80-4ee7-8e54-e5125b4fc9de None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:32.620159 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69227f9a-fc80-4ee7-8e54-e5125b4fc9de None admin] PATH_INFO: `/v3/domains` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:32.621039 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69227f9a-fc80-4ee7-8e54-e5125b4fc9de None admin] RBAC: Adding query filter params (name=Default) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:26:32.621348 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69227f9a-fc80-4ee7-8e54-e5125b4fc9de None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:26:32.622708 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69227f9a-fc80-4ee7-8e54-e5125b4fc9de None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:26:32.635011 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 541/1100] 10.222.0.102 () {56 vars in 1114 bytes} [Mon Aug 1 15:26:32 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:26:32.640515 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69227f9a-fc80-4ee7-8e54-e5125b4fc9de None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:26:32.709685 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 560/1101] 10.222.0.102 () {58 vars in 1287 bytes} [Mon Aug 1 15:26:32 2022] GET /identity/v3/auth/tokens => generated 2113 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 01 15:26:32.710854 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c6c926-1d54-4973-beef-8f64e200e016 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:26:32.725689 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:26:32.740383 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69227f9a-fc80-4ee7-8e54-e5125b4fc9de None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:26:32.778662 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3917e9-0ba8-47b6-85e4-94edf41651d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:26:32.779562 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3917e9-0ba8-47b6-85e4-94edf41651d0 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:32.779839 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3917e9-0ba8-47b6-85e4-94edf41651d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:32.780108 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3917e9-0ba8-47b6-85e4-94edf41651d0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:32.786960 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3917e9-0ba8-47b6-85e4-94edf41651d0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:26:32.788403 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3917e9-0ba8-47b6-85e4-94edf41651d0 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:26:32.799377 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-3e3917e9-0ba8-47b6-85e4-94edf41651d0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 15:26:32.799377 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:26:32.799377 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:26:32.799377 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:26:32.799377 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:26:32.799377 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:26:32.799377 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:26:32.799377 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:26:32.799377 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:26:32.799377 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:26:32.799377 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:26:32.799377 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:26:32.799377 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 15:26:32.799377 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 15:26:32.799377 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 15:26:32.800274 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 15:26:32.800274 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:26:32.800274 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:26:32.800274 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:26:32.800274 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:26:32.800274 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:26:32.800274 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:26:32.800274 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:26:32.800274 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 01 15:26:32.800274 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:26:32.800274 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:26:32.800274 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:26:32.800274 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:26:32.800274 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:26:32.800274 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:26:32.800274 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:26:32.800274 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:26:32.801256 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 15:26:32.801256 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 15:26:32.801256 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 15:26:32.801256 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 15:26:32.801256 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 15:26:32.801256 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 15:26:32.801256 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 15:26:32.801256 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 01 15:26:32.801256 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 542/1102] 10.222.0.102 () {56 vars in 1116 bytes} [Mon Aug 1 15:26:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 15:26:32.806874 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3917e9-0ba8-47b6-85e4-94edf41651d0 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:26:32.814178 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c6c926-1d54-4973-beef-8f64e200e016 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:26:32.816486 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:26:32.850188 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ba6c5e-1cd7-4f07-a455-d39327370df7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:26:32.850779 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ba6c5e-1cd7-4f07-a455-d39327370df7 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:32.851065 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ba6c5e-1cd7-4f07-a455-d39327370df7 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:32.851344 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ba6c5e-1cd7-4f07-a455-d39327370df7 None admin] PATH_INFO: `/v3/projects/ec27543d14e3429baa42fc42b448f829` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:32.852501 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ba6c5e-1cd7-4f07-a455-d39327370df7 None admin] RBAC: Authorizing `identity:get_project(project_id=ec27543d14e3429baa42fc42b448f829)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:26:32.853973 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ba6c5e-1cd7-4f07-a455-d39327370df7 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:26:32.855637 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 561/1103] 10.222.0.102 () {56 vars in 1191 bytes} [Mon Aug 1 15:26:32 2022] GET /identity/v3/projects/ec27543d14e3429baa42fc42b448f829 => generated 312 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:26:32.861805 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ba6c5e-1cd7-4f07-a455-d39327370df7 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:26:32.908103 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3917e9-0ba8-47b6-85e4-94edf41651d0 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:26:32.941842 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9279beaf-f503-43ab-ae1f-708ed709945b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:26:32.942460 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9279beaf-f503-43ab-ae1f-708ed709945b None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:32.942741 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9279beaf-f503-43ab-ae1f-708ed709945b None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:32.943014 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9279beaf-f503-43ab-ae1f-708ed709945b None admin] PATH_INFO: `/v3/projects` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:32.943767 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9279beaf-f503-43ab-ae1f-708ed709945b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:26:32.944073 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9279beaf-f503-43ab-ae1f-708ed709945b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:26:32.946457 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9279beaf-f503-43ab-ae1f-708ed709945b None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:26:32.958272 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 543/1104] 10.222.0.102 () {56 vars in 1153 bytes} [Mon Aug 1 15:26:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:26:32.962026 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ba6c5e-1cd7-4f07-a455-d39327370df7 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:26:32.964384 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9279beaf-f503-43ab-ae1f-708ed709945b None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:26:32.972925 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:26:32.997016 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada47f67-df8b-4fdb-a288-610416f4a8e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:26:32.997628 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada47f67-df8b-4fdb-a288-610416f4a8e2 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:32.997909 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada47f67-df8b-4fdb-a288-610416f4a8e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:32.998184 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada47f67-df8b-4fdb-a288-610416f4a8e2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:32.998971 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada47f67-df8b-4fdb-a288-610416f4a8e2 None admin] RBAC: Adding query filter params (role.id=de1374f966c04c27b579515b54334fd2, scope.project.id=ec27543d14e3429baa42fc42b448f829, user.id=3e4a57f6b4f742a1b76a2f555ae58ad6) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:26:32.999274 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada47f67-df8b-4fdb-a288-610416f4a8e2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:26:33.000698 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada47f67-df8b-4fdb-a288-610416f4a8e2 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:26:33.006646 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 562/1105] 10.222.0.102 () {56 vars in 1379 bytes} [Mon Aug 1 15:26:32 2022] GET /identity/v3/role_assignments?user.id=3e4a57f6b4f742a1b76a2f555ae58ad6&scope.project.id=ec27543d14e3429baa42fc42b448f829&role.id=de1374f966c04c27b579515b54334fd2 => generated 610 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:26:33.067452 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9279beaf-f503-43ab-ae1f-708ed709945b None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:26:33.102947 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ec5cba-9b21-4cd2-9cb7-a23f72d936ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:26:33.103487 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ec5cba-9b21-4cd2-9cb7-a23f72d936ad None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:33.103764 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ec5cba-9b21-4cd2-9cb7-a23f72d936ad None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:33.104036 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ec5cba-9b21-4cd2-9cb7-a23f72d936ad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:33.104830 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ec5cba-9b21-4cd2-9cb7-a23f72d936ad None admin] RBAC: Adding query filter params (role.id=b6e2017e93264842a2466736b83e4250, scope.project.id=2eb32fbe631843d8be84d41f8ba88d6e, user.id=77b43f1ee8cc4be3907a494abe90c1cc) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:26:33.105158 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ec5cba-9b21-4cd2-9cb7-a23f72d936ad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:26:33.106603 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ec5cba-9b21-4cd2-9cb7-a23f72d936ad None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:26:33.113111 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 544/1106] 10.222.0.102 () {56 vars in 1379 bytes} [Mon Aug 1 15:26:32 2022] GET /identity/v3/role_assignments?user.id=77b43f1ee8cc4be3907a494abe90c1cc&scope.project.id=2eb32fbe631843d8be84d41f8ba88d6e&role.id=b6e2017e93264842a2466736b83e4250 => generated 610 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:26:35.030781 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25281154-76a1-4c39-ad84-6e2e20599128 None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:35.031300 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25281154-76a1-4c39-ad84-6e2e20599128 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:35.031300 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25281154-76a1-4c39-ad84-6e2e20599128 None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:35.032654 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 563/1107] 10.222.0.102 () {54 vars in 931 bytes} [Mon Aug 1 15:26:35 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 15:26:35.037651 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c424d9-091b-45e8-89c3-232867f3fa1b None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:35.038078 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c424d9-091b-45e8-89c3-232867f3fa1b None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:35.038182 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c424d9-091b-45e8-89c3-232867f3fa1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:35.056194 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-d3c424d9-091b-45e8-89c3-232867f3fa1b None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:26:35.057403 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-d3c424d9-091b-45e8-89c3-232867f3fa1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:26:35.116958 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:26:35.121288 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 545/1108] 10.222.0.102 () {58 vars in 1028 bytes} [Mon Aug 1 15:26:35 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 15:26:35.145511 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25281154-76a1-4c39-ad84-6e2e20599128 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:26:35.181559 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:26:35.245800 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25281154-76a1-4c39-ad84-6e2e20599128 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:26:35.279823 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2394ad5a-dca4-4127-bca5-fb39020c2e6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:26:35.280465 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2394ad5a-dca4-4127-bca5-fb39020c2e6c None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:35.280743 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2394ad5a-dca4-4127-bca5-fb39020c2e6c None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:35.281051 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2394ad5a-dca4-4127-bca5-fb39020c2e6c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:35.282223 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2394ad5a-dca4-4127-bca5-fb39020c2e6c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:26:35.283690 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2394ad5a-dca4-4127-bca5-fb39020c2e6c None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:26:35.285316 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 564/1109] 10.222.0.102 () {56 vars in 1113 bytes} [Mon Aug 1 15:26:35 2022] GET /identity/v3/domains/default => generated 200 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:26:35.291631 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c424d9-091b-45e8-89c3-232867f3fa1b None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:26:35.391584 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c424d9-091b-45e8-89c3-232867f3fa1b None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:26:35.424363 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd97050-cd9a-485f-893b-bc958c67df87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:26:35.425019 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd97050-cd9a-485f-893b-bc958c67df87 None admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:35.425300 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd97050-cd9a-485f-893b-bc958c67df87 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:35.425574 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd97050-cd9a-485f-893b-bc958c67df87 None admin] PATH_INFO: `/v3/users` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:35.426259 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd97050-cd9a-485f-893b-bc958c67df87 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:26:35.427714 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd97050-cd9a-485f-893b-bc958c67df87 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:26:35.501899 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 546/1110] 10.222.0.102 () {60 vars in 1137 bytes} [Mon Aug 1 15:26:35 2022] POST /identity/v3/users => generated 287 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:26:37.566685 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2edad9e-c94b-4a99-aa8e-97be44c1a714 None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:37.567212 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2edad9e-c94b-4a99-aa8e-97be44c1a714 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:37.567212 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2edad9e-c94b-4a99-aa8e-97be44c1a714 None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:37.568599 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 565/1111] 10.222.0.102 () {54 vars in 931 bytes} [Mon Aug 1 15:26:37 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 15:26:37.573864 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f82db8a-0c3d-42cf-83eb-1bc35cc5f9f8 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:37.574287 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f82db8a-0c3d-42cf-83eb-1bc35cc5f9f8 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:37.574414 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f82db8a-0c3d-42cf-83eb-1bc35cc5f9f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:37.592360 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-5f82db8a-0c3d-42cf-83eb-1bc35cc5f9f8 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:26:37.593566 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-5f82db8a-0c3d-42cf-83eb-1bc35cc5f9f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:26:37.642122 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:26:37.657570 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 547/1112] 10.222.0.102 () {58 vars in 1028 bytes} [Mon Aug 1 15:26:37 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 15:26:37.681715 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2edad9e-c94b-4a99-aa8e-97be44c1a714 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:26:37.785689 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2edad9e-c94b-4a99-aa8e-97be44c1a714 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:26:37.787969 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:26:37.819440 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c132fd04-9bee-443b-b32e-a7bd35134cd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:26:37.820131 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c132fd04-9bee-443b-b32e-a7bd35134cd1 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:37.820394 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c132fd04-9bee-443b-b32e-a7bd35134cd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:37.821023 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c132fd04-9bee-443b-b32e-a7bd35134cd1 None admin] PATH_INFO: `/v3/roles/5acf9fe30ec74532a49ebed755ea61e4` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:37.822431 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c132fd04-9bee-443b-b32e-a7bd35134cd1 None admin] RBAC: Authorizing `identity:get_role(role_id=5acf9fe30ec74532a49ebed755ea61e4)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:26:37.824066 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c132fd04-9bee-443b-b32e-a7bd35134cd1 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:26:37.825440 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 566/1113] 10.222.0.102 () {56 vars in 1182 bytes} [Mon Aug 1 15:26:37 2022] GET /identity/v3/roles/5acf9fe30ec74532a49ebed755ea61e4 => generated 224 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:26:37.831497 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f82db8a-0c3d-42cf-83eb-1bc35cc5f9f8 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:26:37.928880 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f82db8a-0c3d-42cf-83eb-1bc35cc5f9f8 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:26:37.961965 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0728de1-f68c-4ebe-af2a-27cf00e3f447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:26:37.962593 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0728de1-f68c-4ebe-af2a-27cf00e3f447 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:37.962875 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0728de1-f68c-4ebe-af2a-27cf00e3f447 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:37.963149 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0728de1-f68c-4ebe-af2a-27cf00e3f447 None admin] PATH_INFO: `/v3/users/68506ad74b2b459a8a93767350c71a1d` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:37.975636 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0728de1-f68c-4ebe-af2a-27cf00e3f447 None admin] RBAC: Authorizing `identity:get_user(user_id=68506ad74b2b459a8a93767350c71a1d)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:26:37.977666 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0728de1-f68c-4ebe-af2a-27cf00e3f447 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:26:37.979274 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 548/1114] 10.222.0.102 () {56 vars in 1182 bytes} [Mon Aug 1 15:26:37 2022] GET /identity/v3/users/68506ad74b2b459a8a93767350c71a1d => generated 287 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:26:37.984981 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c132fd04-9bee-443b-b32e-a7bd35134cd1 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:26:38.085575 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c132fd04-9bee-443b-b32e-a7bd35134cd1 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:26:38.118260 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c56c7a8-1ece-41b8-9d81-efadd8152f2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:26:38.118855 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c56c7a8-1ece-41b8-9d81-efadd8152f2e None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:38.119133 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c56c7a8-1ece-41b8-9d81-efadd8152f2e None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:38.119404 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c56c7a8-1ece-41b8-9d81-efadd8152f2e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:38.158816 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:26:38.184464 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c56c7a8-1ece-41b8-9d81-efadd8152f2e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:26:38.185933 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c56c7a8-1ece-41b8-9d81-efadd8152f2e None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:26:38.281950 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 567/1115] 10.222.0.102 () {58 vars in 1287 bytes} [Mon Aug 1 15:26:37 2022] GET /identity/v3/auth/tokens => generated 2113 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 01 15:26:38.287790 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0728de1-f68c-4ebe-af2a-27cf00e3f447 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:26:38.332297 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:26:38.385538 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0728de1-f68c-4ebe-af2a-27cf00e3f447 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:26:38.418180 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f6d3db-a9ff-489b-8032-e1f5f161299e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:26:38.418798 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f6d3db-a9ff-489b-8032-e1f5f161299e None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:38.419074 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f6d3db-a9ff-489b-8032-e1f5f161299e None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:38.419341 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f6d3db-a9ff-489b-8032-e1f5f161299e None admin] PATH_INFO: `/v3/projects/ec27543d14e3429baa42fc42b448f829` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:38.420488 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f6d3db-a9ff-489b-8032-e1f5f161299e None admin] RBAC: Authorizing `identity:get_project(project_id=ec27543d14e3429baa42fc42b448f829)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:26:38.421931 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f6d3db-a9ff-489b-8032-e1f5f161299e None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:26:38.423562 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 549/1116] 10.222.0.102 () {56 vars in 1191 bytes} [Mon Aug 1 15:26:38 2022] GET /identity/v3/projects/ec27543d14e3429baa42fc42b448f829 => generated 312 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:26:38.429694 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c56c7a8-1ece-41b8-9d81-efadd8152f2e None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:26:38.496941 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:26:38.525548 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c56c7a8-1ece-41b8-9d81-efadd8152f2e None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:26:38.557326 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf938e4f-07a7-4d6b-a40f-3298ac0787bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:26:38.557918 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf938e4f-07a7-4d6b-a40f-3298ac0787bc None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:38.558193 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf938e4f-07a7-4d6b-a40f-3298ac0787bc None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:38.558465 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf938e4f-07a7-4d6b-a40f-3298ac0787bc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:38.559230 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf938e4f-07a7-4d6b-a40f-3298ac0787bc None admin] RBAC: Adding query filter params (role.id=5acf9fe30ec74532a49ebed755ea61e4, scope.project.id=ec27543d14e3429baa42fc42b448f829, user.id=68506ad74b2b459a8a93767350c71a1d) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:26:38.559532 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf938e4f-07a7-4d6b-a40f-3298ac0787bc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:26:38.561006 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf938e4f-07a7-4d6b-a40f-3298ac0787bc None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:26:38.566183 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 568/1117] 10.222.0.102 () {56 vars in 1379 bytes} [Mon Aug 1 15:26:38 2022] GET /identity/v3/role_assignments?user.id=68506ad74b2b459a8a93767350c71a1d&scope.project.id=ec27543d14e3429baa42fc42b448f829&role.id=5acf9fe30ec74532a49ebed755ea61e4 => generated 260 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:26:40.539853 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b914c9-73f9-4d85-9e42-332e623d3712 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:40.540382 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b914c9-73f9-4d85-9e42-332e623d3712 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:40.540382 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b914c9-73f9-4d85-9e42-332e623d3712 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:40.541777 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 550/1118] 10.222.0.102 () {54 vars in 931 bytes} [Mon Aug 1 15:26:40 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 15:26:40.547115 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfab2b79-2c98-4ff6-a814-40fb7b928893 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:40.547777 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfab2b79-2c98-4ff6-a814-40fb7b928893 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:40.548012 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfab2b79-2c98-4ff6-a814-40fb7b928893 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:40.566749 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-cfab2b79-2c98-4ff6-a814-40fb7b928893 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:26:40.567954 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-cfab2b79-2c98-4ff6-a814-40fb7b928893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:26:40.634109 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 569/1119] 10.222.0.102 () {58 vars in 1028 bytes} [Mon Aug 1 15:26:40 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 15:26:40.656941 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b914c9-73f9-4d85-9e42-332e623d3712 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:26:40.754571 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b914c9-73f9-4d85-9e42-332e623d3712 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:26:40.767883 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:26:40.788730 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628b1ee9-4bda-4e34-b33c-b88acb9ded4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:26:40.789389 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628b1ee9-4bda-4e34-b33c-b88acb9ded4e None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:40.789721 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628b1ee9-4bda-4e34-b33c-b88acb9ded4e None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:40.790085 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628b1ee9-4bda-4e34-b33c-b88acb9ded4e None admin] PATH_INFO: `/v3/roles/5acf9fe30ec74532a49ebed755ea61e4` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:40.791626 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628b1ee9-4bda-4e34-b33c-b88acb9ded4e None admin] RBAC: Authorizing `identity:get_role(role_id=5acf9fe30ec74532a49ebed755ea61e4)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:26:40.793023 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628b1ee9-4bda-4e34-b33c-b88acb9ded4e None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:26:40.794367 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 551/1120] 10.222.0.102 () {56 vars in 1182 bytes} [Mon Aug 1 15:26:40 2022] GET /identity/v3/roles/5acf9fe30ec74532a49ebed755ea61e4 => generated 224 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:26:40.800098 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfab2b79-2c98-4ff6-a814-40fb7b928893 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:26:40.863594 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:26:40.898492 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfab2b79-2c98-4ff6-a814-40fb7b928893 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:26:40.931250 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd7c60d-c1db-4cd5-b882-8e97239497e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:26:40.931873 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd7c60d-c1db-4cd5-b882-8e97239497e7 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:40.932148 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd7c60d-c1db-4cd5-b882-8e97239497e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:40.932412 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd7c60d-c1db-4cd5-b882-8e97239497e7 None admin] PATH_INFO: `/v3/users/68506ad74b2b459a8a93767350c71a1d` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:40.933576 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd7c60d-c1db-4cd5-b882-8e97239497e7 None admin] RBAC: Authorizing `identity:get_user(user_id=68506ad74b2b459a8a93767350c71a1d)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:26:40.935075 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd7c60d-c1db-4cd5-b882-8e97239497e7 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:26:40.936644 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 570/1121] 10.222.0.102 () {56 vars in 1182 bytes} [Mon Aug 1 15:26:40 2022] GET /identity/v3/users/68506ad74b2b459a8a93767350c71a1d => generated 287 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:26:40.942465 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628b1ee9-4bda-4e34-b33c-b88acb9ded4e None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:26:41.041517 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628b1ee9-4bda-4e34-b33c-b88acb9ded4e None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:26:41.074444 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49964ff-a74e-488a-af78-2a057020c92e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:26:41.075074 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49964ff-a74e-488a-af78-2a057020c92e None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:41.075355 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49964ff-a74e-488a-af78-2a057020c92e None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:41.075710 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49964ff-a74e-488a-af78-2a057020c92e None admin] PATH_INFO: `/v3/projects/ec27543d14e3429baa42fc42b448f829` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:41.077133 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49964ff-a74e-488a-af78-2a057020c92e None admin] RBAC: Authorizing `identity:get_project(project_id=ec27543d14e3429baa42fc42b448f829)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:26:41.078557 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49964ff-a74e-488a-af78-2a057020c92e None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:26:41.080222 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 552/1122] 10.222.0.102 () {56 vars in 1191 bytes} [Mon Aug 1 15:26:40 2022] GET /identity/v3/projects/ec27543d14e3429baa42fc42b448f829 => generated 312 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:26:41.086707 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd7c60d-c1db-4cd5-b882-8e97239497e7 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:26:41.184663 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd7c60d-c1db-4cd5-b882-8e97239497e7 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:26:41.217768 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e36d709-023d-4988-bcde-2673d3dca042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:26:41.218418 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e36d709-023d-4988-bcde-2673d3dca042 None admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:41.218694 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e36d709-023d-4988-bcde-2673d3dca042 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:41.218961 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e36d709-023d-4988-bcde-2673d3dca042 None admin] PATH_INFO: `/v3/projects/ec27543d14e3429baa42fc42b448f829/users/68506ad74b2b459a8a93767350c71a1d/roles/5acf9fe30ec74532a49ebed755ea61e4` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:41.221114 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e36d709-023d-4988-bcde-2673d3dca042 None admin] RBAC: Authorizing `identity:create_grant(project_id=ec27543d14e3429baa42fc42b448f829, user_id=68506ad74b2b459a8a93767350c71a1d, role_id=5acf9fe30ec74532a49ebed755ea61e4)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:26:41.222658 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e36d709-023d-4988-bcde-2673d3dca042 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:26:41.224816 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:26:41.267515 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 571/1123] 10.222.0.102 () {58 vars in 1444 bytes} [Mon Aug 1 15:26:41 2022] PUT /identity/v3/projects/ec27543d14e3429baa42fc42b448f829/users/68506ad74b2b459a8a93767350c71a1d/roles/5acf9fe30ec74532a49ebed755ea61e4 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:26:43.246209 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3345bd2-0ec0-4d12-a103-ac1cbe105b79 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:43.246790 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3345bd2-0ec0-4d12-a103-ac1cbe105b79 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:43.246790 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3345bd2-0ec0-4d12-a103-ac1cbe105b79 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:43.248125 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 553/1124] 10.222.0.102 () {54 vars in 931 bytes} [Mon Aug 1 15:26:43 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 15:26:43.253317 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c46bcca-586e-4c53-9f1e-c6ac97950425 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:43.253741 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c46bcca-586e-4c53-9f1e-c6ac97950425 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:43.253845 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c46bcca-586e-4c53-9f1e-c6ac97950425 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:43.271560 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-3c46bcca-586e-4c53-9f1e-c6ac97950425 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:26:43.273252 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-3c46bcca-586e-4c53-9f1e-c6ac97950425 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:26:43.337706 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 572/1125] 10.222.0.102 () {58 vars in 1028 bytes} [Mon Aug 1 15:26:43 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 15:26:43.360377 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3345bd2-0ec0-4d12-a103-ac1cbe105b79 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:26:43.409316 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:26:43.458730 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3345bd2-0ec0-4d12-a103-ac1cbe105b79 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:26:43.493345 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c53bc38-5c81-47ed-830d-8f0b21289615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:26:43.493975 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c53bc38-5c81-47ed-830d-8f0b21289615 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:43.494251 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c53bc38-5c81-47ed-830d-8f0b21289615 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:43.494520 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c53bc38-5c81-47ed-830d-8f0b21289615 None admin] PATH_INFO: `/v3/roles/5acf9fe30ec74532a49ebed755ea61e4` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:43.495942 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c53bc38-5c81-47ed-830d-8f0b21289615 None admin] RBAC: Authorizing `identity:get_role(role_id=5acf9fe30ec74532a49ebed755ea61e4)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:26:43.497392 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c53bc38-5c81-47ed-830d-8f0b21289615 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:26:43.498690 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 554/1126] 10.222.0.102 () {56 vars in 1182 bytes} [Mon Aug 1 15:26:43 2022] GET /identity/v3/roles/5acf9fe30ec74532a49ebed755ea61e4 => generated 224 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:26:43.504544 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c46bcca-586e-4c53-9f1e-c6ac97950425 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:26:43.599911 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c46bcca-586e-4c53-9f1e-c6ac97950425 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:26:43.622200 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:26:43.632891 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9122dd2-bd52-486c-ac4c-1b6f60700960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:26:43.636636 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9122dd2-bd52-486c-ac4c-1b6f60700960 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:43.636636 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9122dd2-bd52-486c-ac4c-1b6f60700960 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:43.636636 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9122dd2-bd52-486c-ac4c-1b6f60700960 None admin] PATH_INFO: `/v3/users/68506ad74b2b459a8a93767350c71a1d` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:43.636636 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9122dd2-bd52-486c-ac4c-1b6f60700960 None admin] RBAC: Authorizing `identity:get_user(user_id=68506ad74b2b459a8a93767350c71a1d)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:26:43.636636 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9122dd2-bd52-486c-ac4c-1b6f60700960 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:26:43.638318 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 573/1127] 10.222.0.102 () {56 vars in 1182 bytes} [Mon Aug 1 15:26:43 2022] GET /identity/v3/users/68506ad74b2b459a8a93767350c71a1d => generated 287 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:26:43.643980 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c53bc38-5c81-47ed-830d-8f0b21289615 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:26:43.739776 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c53bc38-5c81-47ed-830d-8f0b21289615 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:26:43.756011 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:26:43.773654 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d8e63c-7515-4e3c-85c0-e312cf7ea332 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:26:43.774249 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d8e63c-7515-4e3c-85c0-e312cf7ea332 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:43.774522 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d8e63c-7515-4e3c-85c0-e312cf7ea332 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:43.774788 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d8e63c-7515-4e3c-85c0-e312cf7ea332 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:43.840010 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d8e63c-7515-4e3c-85c0-e312cf7ea332 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:26:43.842376 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d8e63c-7515-4e3c-85c0-e312cf7ea332 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:26:43.936937 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 555/1128] 10.222.0.102 () {58 vars in 1287 bytes} [Mon Aug 1 15:26:43 2022] GET /identity/v3/auth/tokens => generated 2113 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 01 15:26:43.942873 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9122dd2-bd52-486c-ac4c-1b6f60700960 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:26:44.055419 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9122dd2-bd52-486c-ac4c-1b6f60700960 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:26:44.095769 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cec5b3b-1f16-4b3a-8ac5-0e12f9d8d88b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:26:44.096402 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cec5b3b-1f16-4b3a-8ac5-0e12f9d8d88b None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:44.096680 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cec5b3b-1f16-4b3a-8ac5-0e12f9d8d88b None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:44.096978 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cec5b3b-1f16-4b3a-8ac5-0e12f9d8d88b None admin] PATH_INFO: `/v3/projects/ec27543d14e3429baa42fc42b448f829` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:44.098119 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cec5b3b-1f16-4b3a-8ac5-0e12f9d8d88b None admin] RBAC: Authorizing `identity:get_project(project_id=ec27543d14e3429baa42fc42b448f829)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:26:44.099557 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cec5b3b-1f16-4b3a-8ac5-0e12f9d8d88b None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:26:44.101352 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 574/1129] 10.222.0.102 () {56 vars in 1191 bytes} [Mon Aug 1 15:26:43 2022] GET /identity/v3/projects/ec27543d14e3429baa42fc42b448f829 => generated 312 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:26:44.107777 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d8e63c-7515-4e3c-85c0-e312cf7ea332 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:26:44.125349 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:26:44.204888 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d8e63c-7515-4e3c-85c0-e312cf7ea332 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:26:44.237696 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0f234e-dcd1-4da8-a9c6-5cecd76cda92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:26:44.238599 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0f234e-dcd1-4da8-a9c6-5cecd76cda92 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:44.239057 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0f234e-dcd1-4da8-a9c6-5cecd76cda92 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:44.239504 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0f234e-dcd1-4da8-a9c6-5cecd76cda92 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:44.240825 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0f234e-dcd1-4da8-a9c6-5cecd76cda92 None admin] RBAC: Adding query filter params (role.id=5acf9fe30ec74532a49ebed755ea61e4, scope.project.id=ec27543d14e3429baa42fc42b448f829, user.id=68506ad74b2b459a8a93767350c71a1d) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:26:44.241442 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0f234e-dcd1-4da8-a9c6-5cecd76cda92 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:26:44.243606 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0f234e-dcd1-4da8-a9c6-5cecd76cda92 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:26:44.249717 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 556/1130] 10.222.0.102 () {56 vars in 1379 bytes} [Mon Aug 1 15:26:44 2022] GET /identity/v3/role_assignments?user.id=68506ad74b2b459a8a93767350c71a1d&scope.project.id=ec27543d14e3429baa42fc42b448f829&role.id=5acf9fe30ec74532a49ebed755ea61e4 => generated 610 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:26:46.276729 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43f9b4b-06d6-4bc3-aab4-bdcc67c33a28 None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:46.277324 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43f9b4b-06d6-4bc3-aab4-bdcc67c33a28 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:46.277467 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43f9b4b-06d6-4bc3-aab4-bdcc67c33a28 None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:46.278833 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 575/1131] 10.222.0.102 () {54 vars in 931 bytes} [Mon Aug 1 15:26:46 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 15:26:46.284063 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6246240-2b6f-49b0-83b1-f4f314e10a4e None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:46.284479 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6246240-2b6f-49b0-83b1-f4f314e10a4e None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:46.284589 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6246240-2b6f-49b0-83b1-f4f314e10a4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:46.302912 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-c6246240-2b6f-49b0-83b1-f4f314e10a4e None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:26:46.304073 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-c6246240-2b6f-49b0-83b1-f4f314e10a4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:26:46.367920 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 557/1132] 10.222.0.102 () {58 vars in 1028 bytes} [Mon Aug 1 15:26:46 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 15:26:46.390689 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43f9b4b-06d6-4bc3-aab4-bdcc67c33a28 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:26:46.451088 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:26:46.491815 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43f9b4b-06d6-4bc3-aab4-bdcc67c33a28 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:26:46.525347 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8161838-634d-47cb-b5e5-1779cb0c301c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:26:46.525974 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8161838-634d-47cb-b5e5-1779cb0c301c None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:46.526256 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8161838-634d-47cb-b5e5-1779cb0c301c None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:46.526529 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8161838-634d-47cb-b5e5-1779cb0c301c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:46.527729 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8161838-634d-47cb-b5e5-1779cb0c301c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:26:46.529131 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8161838-634d-47cb-b5e5-1779cb0c301c None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:26:46.530711 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 576/1133] 10.222.0.102 () {56 vars in 1113 bytes} [Mon Aug 1 15:26:46 2022] GET /identity/v3/domains/default => generated 200 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:26:46.536484 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6246240-2b6f-49b0-83b1-f4f314e10a4e None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:26:46.547859 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:26:46.633139 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6246240-2b6f-49b0-83b1-f4f314e10a4e None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:26:46.665779 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ed6442-f096-41f4-bf29-0f4b4ac02d61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:26:46.666386 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ed6442-f096-41f4-bf29-0f4b4ac02d61 None admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:46.666662 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ed6442-f096-41f4-bf29-0f4b4ac02d61 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:46.666931 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ed6442-f096-41f4-bf29-0f4b4ac02d61 None admin] PATH_INFO: `/v3/projects` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:46.667609 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ed6442-f096-41f4-bf29-0f4b4ac02d61 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:26:46.669048 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ed6442-f096-41f4-bf29-0f4b4ac02d61 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:26:46.748789 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 558/1134] 10.222.0.102 () {60 vars in 1146 bytes} [Mon Aug 1 15:26:46 2022] POST /identity/v3/projects => generated 312 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:26:48.771965 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d61bd54-bd04-4cc5-982f-ba6e7a22a173 None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:48.772522 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d61bd54-bd04-4cc5-982f-ba6e7a22a173 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:48.772522 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d61bd54-bd04-4cc5-982f-ba6e7a22a173 None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:48.773880 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 577/1135] 10.222.0.102 () {54 vars in 931 bytes} [Mon Aug 1 15:26:48 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 15:26:48.779171 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5109c7-cd7c-45af-9c26-ab8e6e04ea1a None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:48.779581 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5109c7-cd7c-45af-9c26-ab8e6e04ea1a None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:48.779730 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5109c7-cd7c-45af-9c26-ab8e6e04ea1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:48.798141 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-8f5109c7-cd7c-45af-9c26-ab8e6e04ea1a None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:26:48.799334 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-8f5109c7-cd7c-45af-9c26-ab8e6e04ea1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:26:48.853909 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:26:48.863742 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 559/1136] 10.222.0.102 () {58 vars in 1028 bytes} [Mon Aug 1 15:26:48 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 15:26:48.893074 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d61bd54-bd04-4cc5-982f-ba6e7a22a173 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:26:48.986932 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d61bd54-bd04-4cc5-982f-ba6e7a22a173 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:26:49.012798 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:26:49.020090 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4453fc1-d416-4761-abf9-28263a0371db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:26:49.024682 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4453fc1-d416-4761-abf9-28263a0371db None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:49.024682 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4453fc1-d416-4761-abf9-28263a0371db None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:49.024682 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4453fc1-d416-4761-abf9-28263a0371db None admin] PATH_INFO: `/v3/domains/default` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:49.024682 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4453fc1-d416-4761-abf9-28263a0371db None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:26:49.024682 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4453fc1-d416-4761-abf9-28263a0371db None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:26:49.025921 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 578/1137] 10.222.0.102 () {56 vars in 1113 bytes} [Mon Aug 1 15:26:48 2022] GET /identity/v3/domains/default => generated 200 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:26:49.032139 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5109c7-cd7c-45af-9c26-ab8e6e04ea1a None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:26:49.130907 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5109c7-cd7c-45af-9c26-ab8e6e04ea1a None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:26:49.163957 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ac7bfa-ef91-4f32-a04c-2a031402854e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:26:49.164573 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ac7bfa-ef91-4f32-a04c-2a031402854e None admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:49.164876 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ac7bfa-ef91-4f32-a04c-2a031402854e None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:49.165157 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ac7bfa-ef91-4f32-a04c-2a031402854e None admin] PATH_INFO: `/v3/users` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:49.165827 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ac7bfa-ef91-4f32-a04c-2a031402854e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:26:49.167254 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ac7bfa-ef91-4f32-a04c-2a031402854e None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:26:49.272381 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 560/1138] 10.222.0.102 () {60 vars in 1137 bytes} [Mon Aug 1 15:26:49 2022] POST /identity/v3/users => generated 287 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:26:51.378884 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b1a945-9acc-44c4-a5a8-3e61c9d63bb7 None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:51.379413 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b1a945-9acc-44c4-a5a8-3e61c9d63bb7 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:51.379413 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b1a945-9acc-44c4-a5a8-3e61c9d63bb7 None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:51.380776 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 579/1139] 10.222.0.102 () {54 vars in 931 bytes} [Mon Aug 1 15:26:51 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 15:26:51.386833 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d8b613-09c1-4d20-b639-a8f745a27b12 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:51.387260 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d8b613-09c1-4d20-b639-a8f745a27b12 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:51.387354 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d8b613-09c1-4d20-b639-a8f745a27b12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:51.405030 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-66d8b613-09c1-4d20-b639-a8f745a27b12 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:26:51.406206 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-66d8b613-09c1-4d20-b639-a8f745a27b12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:26:51.448727 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:26:51.470625 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 561/1140] 10.222.0.102 () {58 vars in 1028 bytes} [Mon Aug 1 15:26:51 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 15:26:51.493949 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b1a945-9acc-44c4-a5a8-3e61c9d63bb7 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:26:51.615377 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b1a945-9acc-44c4-a5a8-3e61c9d63bb7 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:26:51.660547 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f595152-169c-4f3c-b9c4-bc9c20a1e2af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:26:51.661503 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f595152-169c-4f3c-b9c4-bc9c20a1e2af None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:51.661907 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f595152-169c-4f3c-b9c4-bc9c20a1e2af None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:51.662303 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f595152-169c-4f3c-b9c4-bc9c20a1e2af None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:51.672283 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f595152-169c-4f3c-b9c4-bc9c20a1e2af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:26:51.677140 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-4f595152-169c-4f3c-b9c4-bc9c20a1e2af None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 15:26:51.677140 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:26:51.677140 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:26:51.677140 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:26:51.677140 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:26:51.677140 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:26:51.677140 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:26:51.677140 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:26:51.677140 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:26:51.677140 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:26:51.677140 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:26:51.677140 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:26:51.677140 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:26:51.677140 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:26:51.677140 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:26:51.677140 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:26:51.678319 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:26:51.678319 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:26:51.678319 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:26:51.678319 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:26:51.678319 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:26:51.678319 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:26:51.678319 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:26:51.678319 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:26:51.678319 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:26:51.678319 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:26:51.678319 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:26:51.678319 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 01 15:26:51.678319 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:26:51.678319 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:26:51.678319 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:26:51.678319 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:26:51.680025 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:26:51.680025 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:26:51.680025 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:26:51.680025 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:26:51.680025 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:26:51.680025 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:26:51.680025 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:26:51.680025 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:26:51.680025 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:26:51.680025 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:26:51.680025 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 15:26:51.680025 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 01 15:26:51.680025 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 580/1141] 10.222.0.102 () {56 vars in 1101 bytes} [Mon Aug 1 15:26:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:26:51.684820 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d8b613-09c1-4d20-b639-a8f745a27b12 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:26:51.780113 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d8b613-09c1-4d20-b639-a8f745a27b12 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:26:51.813191 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4502d377-b33d-4f04-8d4a-a8c58203e235 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:26:51.813804 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4502d377-b33d-4f04-8d4a-a8c58203e235 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:51.814084 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4502d377-b33d-4f04-8d4a-a8c58203e235 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:51.814357 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4502d377-b33d-4f04-8d4a-a8c58203e235 None admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:51.815066 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4502d377-b33d-4f04-8d4a-a8c58203e235 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:26:51.815368 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4502d377-b33d-4f04-8d4a-a8c58203e235 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:26:51.816726 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4502d377-b33d-4f04-8d4a-a8c58203e235 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:26:51.824536 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 562/1142] 10.222.0.102 () {56 vars in 1104 bytes} [Mon Aug 1 15:26:51 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:26:51.830399 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f595152-169c-4f3c-b9c4-bc9c20a1e2af None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:26:51.886204 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:26:51.935603 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f595152-169c-4f3c-b9c4-bc9c20a1e2af None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:26:51.979150 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8940bb8c-166e-425d-b9b6-421cb163e2f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:26:51.979795 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8940bb8c-166e-425d-b9b6-421cb163e2f8 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:51.980074 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8940bb8c-166e-425d-b9b6-421cb163e2f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:51.980346 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8940bb8c-166e-425d-b9b6-421cb163e2f8 None admin] PATH_INFO: `/v3/users/077989f21f944143bd123e75becdaa29` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:51.994682 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8940bb8c-166e-425d-b9b6-421cb163e2f8 None admin] RBAC: Authorizing `identity:get_user(user_id=077989f21f944143bd123e75becdaa29)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:26:51.996132 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8940bb8c-166e-425d-b9b6-421cb163e2f8 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:26:51.998033 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 581/1143] 10.222.0.102 () {56 vars in 1182 bytes} [Mon Aug 1 15:26:51 2022] GET /identity/v3/users/077989f21f944143bd123e75becdaa29 => generated 287 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:26:52.005324 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4502d377-b33d-4f04-8d4a-a8c58203e235 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:26:52.045758 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:26:52.102312 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4502d377-b33d-4f04-8d4a-a8c58203e235 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:26:52.133930 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49367df7-43a8-413c-a36b-b07c24832f70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:26:52.134532 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49367df7-43a8-413c-a36b-b07c24832f70 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:52.134804 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49367df7-43a8-413c-a36b-b07c24832f70 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:52.135066 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49367df7-43a8-413c-a36b-b07c24832f70 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:52.199762 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49367df7-43a8-413c-a36b-b07c24832f70 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:26:52.201153 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49367df7-43a8-413c-a36b-b07c24832f70 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:26:52.239919 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:26:52.308513 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 563/1144] 10.222.0.102 () {58 vars in 1287 bytes} [Mon Aug 1 15:26:52 2022] GET /identity/v3/auth/tokens => generated 2113 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 01 15:26:52.314497 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8940bb8c-166e-425d-b9b6-421cb163e2f8 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:26:52.412794 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8940bb8c-166e-425d-b9b6-421cb163e2f8 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:26:52.427498 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:26:52.446992 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b01be5-e2ca-46d2-8777-415a315e93e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:26:52.447618 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b01be5-e2ca-46d2-8777-415a315e93e5 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:52.447895 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b01be5-e2ca-46d2-8777-415a315e93e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:52.448162 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b01be5-e2ca-46d2-8777-415a315e93e5 None admin] PATH_INFO: `/v3/projects/b8565806a2e04df7a493f5eb802e0223` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:52.449321 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b01be5-e2ca-46d2-8777-415a315e93e5 None admin] RBAC: Authorizing `identity:get_project(project_id=b8565806a2e04df7a493f5eb802e0223)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:26:52.450805 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b01be5-e2ca-46d2-8777-415a315e93e5 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:26:52.452646 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 582/1145] 10.222.0.102 () {56 vars in 1191 bytes} [Mon Aug 1 15:26:52 2022] GET /identity/v3/projects/b8565806a2e04df7a493f5eb802e0223 => generated 312 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:26:52.459020 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49367df7-43a8-413c-a36b-b07c24832f70 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:26:52.554236 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49367df7-43a8-413c-a36b-b07c24832f70 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:26:52.590413 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d9556c-3a05-480c-9dcd-e467b3cb2372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:26:52.591063 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d9556c-3a05-480c-9dcd-e467b3cb2372 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:52.591355 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d9556c-3a05-480c-9dcd-e467b3cb2372 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:52.591619 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d9556c-3a05-480c-9dcd-e467b3cb2372 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:52.592385 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d9556c-3a05-480c-9dcd-e467b3cb2372 None admin] RBAC: Adding query filter params (role.id=de1374f966c04c27b579515b54334fd2, scope.project.id=b8565806a2e04df7a493f5eb802e0223, user.id=077989f21f944143bd123e75becdaa29) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:26:52.592683 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d9556c-3a05-480c-9dcd-e467b3cb2372 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:26:52.594120 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d9556c-3a05-480c-9dcd-e467b3cb2372 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:26:52.599363 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 564/1146] 10.222.0.102 () {56 vars in 1379 bytes} [Mon Aug 1 15:26:52 2022] GET /identity/v3/role_assignments?user.id=077989f21f944143bd123e75becdaa29&scope.project.id=b8565806a2e04df7a493f5eb802e0223&role.id=de1374f966c04c27b579515b54334fd2 => generated 260 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:26:54.575892 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9992bf2e-638f-4fd1-a1a4-dfdfbd6ba5da None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:54.577199 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9992bf2e-638f-4fd1-a1a4-dfdfbd6ba5da None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:54.577650 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9992bf2e-638f-4fd1-a1a4-dfdfbd6ba5da None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:54.580124 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 583/1147] 10.222.0.102 () {54 vars in 931 bytes} [Mon Aug 1 15:26:54 2022] GET /identity => generated 271 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 15:26:54.586236 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189c7d83-e4e0-47fe-911d-aa10dcb2ac6f None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:54.586647 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189c7d83-e4e0-47fe-911d-aa10dcb2ac6f None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:54.586779 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189c7d83-e4e0-47fe-911d-aa10dcb2ac6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:54.594819 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:26:54.610466 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-189c7d83-e4e0-47fe-911d-aa10dcb2ac6f None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:26:54.611667 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-189c7d83-e4e0-47fe-911d-aa10dcb2ac6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:26:54.681972 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 565/1148] 10.222.0.102 () {58 vars in 1028 bytes} [Mon Aug 1 15:26:54 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 15:26:54.705301 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9992bf2e-638f-4fd1-a1a4-dfdfbd6ba5da None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:26:54.806796 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9992bf2e-638f-4fd1-a1a4-dfdfbd6ba5da None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:26:54.840526 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89853331-d1ca-40e5-9ed4-a07262287524 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:26:54.841112 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89853331-d1ca-40e5-9ed4-a07262287524 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:54.841391 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89853331-d1ca-40e5-9ed4-a07262287524 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:54.841661 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89853331-d1ca-40e5-9ed4-a07262287524 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:54.851491 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89853331-d1ca-40e5-9ed4-a07262287524 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:26:54.856315 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-89853331-d1ca-40e5-9ed4-a07262287524 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 15:26:54.856315 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:26:54.856315 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:26:54.856315 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:26:54.856315 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:26:54.856315 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:26:54.856315 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:26:54.856315 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:26:54.856315 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:26:54.856315 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:26:54.856315 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:26:54.856315 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:26:54.856315 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:26:54.856315 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:26:54.856315 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:26:54.856315 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:26:54.857548 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:26:54.857548 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:26:54.857548 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:26:54.857548 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:26:54.857548 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:26:54.857548 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:26:54.857548 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:26:54.857548 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:26:54.857548 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:26:54.857548 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:26:54.857548 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:26:54.857548 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 01 15:26:54.857548 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:26:54.857548 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:26:54.857548 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:26:54.857548 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:26:54.858575 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:26:54.858575 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:26:54.858575 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:26:54.858575 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:26:54.858575 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:26:54.858575 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:26:54.858575 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:26:54.858575 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:26:54.858575 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:26:54.858575 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:26:54.858575 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 15:26:54.858575 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 01 15:26:54.858575 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 584/1149] 10.222.0.102 () {56 vars in 1101 bytes} [Mon Aug 1 15:26:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:26:54.863751 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189c7d83-e4e0-47fe-911d-aa10dcb2ac6f None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:26:54.961469 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189c7d83-e4e0-47fe-911d-aa10dcb2ac6f None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:26:54.993649 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a88abd-5c0f-4f3b-9a96-daceba894e85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:26:54.994258 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a88abd-5c0f-4f3b-9a96-daceba894e85 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:54.994536 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a88abd-5c0f-4f3b-9a96-daceba894e85 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:54.994807 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a88abd-5c0f-4f3b-9a96-daceba894e85 None admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:54.995509 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a88abd-5c0f-4f3b-9a96-daceba894e85 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:26:54.995810 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a88abd-5c0f-4f3b-9a96-daceba894e85 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:26:54.997211 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a88abd-5c0f-4f3b-9a96-daceba894e85 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:26:54.998525 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:26:55.005282 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 566/1150] 10.222.0.102 () {56 vars in 1104 bytes} [Mon Aug 1 15:26:54 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:26:55.011574 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89853331-d1ca-40e5-9ed4-a07262287524 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:26:55.058444 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:26:55.118403 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89853331-d1ca-40e5-9ed4-a07262287524 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:26:55.153752 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b76ea8-03b8-4654-9144-082c5f16bc37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:26:55.154380 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b76ea8-03b8-4654-9144-082c5f16bc37 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:55.154657 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b76ea8-03b8-4654-9144-082c5f16bc37 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:55.154925 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b76ea8-03b8-4654-9144-082c5f16bc37 None admin] PATH_INFO: `/v3/users/077989f21f944143bd123e75becdaa29` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:55.156058 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b76ea8-03b8-4654-9144-082c5f16bc37 None admin] RBAC: Authorizing `identity:get_user(user_id=077989f21f944143bd123e75becdaa29)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:26:55.157514 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b76ea8-03b8-4654-9144-082c5f16bc37 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:26:55.159106 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 585/1151] 10.222.0.102 () {56 vars in 1182 bytes} [Mon Aug 1 15:26:55 2022] GET /identity/v3/users/077989f21f944143bd123e75becdaa29 => generated 287 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:26:55.164973 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a88abd-5c0f-4f3b-9a96-daceba894e85 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:26:55.261332 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a88abd-5c0f-4f3b-9a96-daceba894e85 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:26:55.293178 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e728cd-9479-4472-b6f0-0e154f4b24ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:26:55.293797 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e728cd-9479-4472-b6f0-0e154f4b24ff None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:55.294073 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e728cd-9479-4472-b6f0-0e154f4b24ff None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:55.294339 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e728cd-9479-4472-b6f0-0e154f4b24ff None admin] PATH_INFO: `/v3/projects/b8565806a2e04df7a493f5eb802e0223` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:55.295467 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e728cd-9479-4472-b6f0-0e154f4b24ff None admin] RBAC: Authorizing `identity:get_project(project_id=b8565806a2e04df7a493f5eb802e0223)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:26:55.296903 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e728cd-9479-4472-b6f0-0e154f4b24ff None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:26:55.298595 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 567/1152] 10.222.0.102 () {56 vars in 1191 bytes} [Mon Aug 1 15:26:55 2022] GET /identity/v3/projects/b8565806a2e04df7a493f5eb802e0223 => generated 312 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:26:55.305504 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b76ea8-03b8-4654-9144-082c5f16bc37 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:26:55.440415 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b76ea8-03b8-4654-9144-082c5f16bc37 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:26:55.455485 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:26:55.487440 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524474cf-35c3-4023-bf30-a268f8839317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:26:55.488378 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524474cf-35c3-4023-bf30-a268f8839317 None admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:55.488782 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524474cf-35c3-4023-bf30-a268f8839317 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:55.489211 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524474cf-35c3-4023-bf30-a268f8839317 None admin] PATH_INFO: `/v3/projects/b8565806a2e04df7a493f5eb802e0223/users/077989f21f944143bd123e75becdaa29/roles/de1374f966c04c27b579515b54334fd2` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:55.492045 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524474cf-35c3-4023-bf30-a268f8839317 None admin] RBAC: Authorizing `identity:create_grant(project_id=b8565806a2e04df7a493f5eb802e0223, user_id=077989f21f944143bd123e75becdaa29, role_id=de1374f966c04c27b579515b54334fd2)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:26:55.494372 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524474cf-35c3-4023-bf30-a268f8839317 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:26:55.559191 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 586/1153] 10.222.0.102 () {58 vars in 1444 bytes} [Mon Aug 1 15:26:55 2022] PUT /identity/v3/projects/b8565806a2e04df7a493f5eb802e0223/users/077989f21f944143bd123e75becdaa29/roles/de1374f966c04c27b579515b54334fd2 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:26:57.774883 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edab9fb-6da3-4b46-a102-5f93206c50ed None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:57.775415 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edab9fb-6da3-4b46-a102-5f93206c50ed None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:57.775415 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edab9fb-6da3-4b46-a102-5f93206c50ed None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:57.776829 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 568/1154] 10.222.0.102 () {54 vars in 931 bytes} [Mon Aug 1 15:26:57 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 15:26:57.782161 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ace5dd2-d01b-496d-bec6-2605635bb46c None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:57.782602 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ace5dd2-d01b-496d-bec6-2605635bb46c None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:57.782697 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ace5dd2-d01b-496d-bec6-2605635bb46c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:57.801465 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-6ace5dd2-d01b-496d-bec6-2605635bb46c None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:26:57.802657 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-6ace5dd2-d01b-496d-bec6-2605635bb46c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:26:57.869234 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 587/1155] 10.222.0.102 () {58 vars in 1028 bytes} [Mon Aug 1 15:26:57 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 15:26:57.892005 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edab9fb-6da3-4b46-a102-5f93206c50ed None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:26:57.955336 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:26:57.995777 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edab9fb-6da3-4b46-a102-5f93206c50ed None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:26:58.031640 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1bbb3b-6c76-494b-ad52-58a153d29941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:26:58.032189 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1bbb3b-6c76-494b-ad52-58a153d29941 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:58.032469 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1bbb3b-6c76-494b-ad52-58a153d29941 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:58.032740 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1bbb3b-6c76-494b-ad52-58a153d29941 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:58.043050 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1bbb3b-6c76-494b-ad52-58a153d29941 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:26:58.047932 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-0c1bbb3b-6c76-494b-ad52-58a153d29941 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 15:26:58.047932 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:26:58.047932 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:26:58.047932 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:26:58.047932 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:26:58.047932 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:26:58.047932 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:26:58.047932 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:26:58.047932 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:26:58.047932 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:26:58.047932 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:26:58.047932 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:26:58.047932 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:26:58.047932 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:26:58.047932 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:26:58.047932 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:26:58.049160 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:26:58.049160 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:26:58.049160 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:26:58.049160 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:26:58.049160 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:26:58.049160 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:26:58.049160 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:26:58.049160 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:26:58.049160 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:26:58.049160 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:26:58.049160 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:26:58.049160 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 01 15:26:58.049160 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:26:58.049160 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:26:58.049160 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:26:58.049160 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:26:58.050411 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:26:58.050411 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:26:58.050411 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:26:58.050411 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:26:58.050411 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:26:58.050411 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:26:58.050411 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:26:58.050411 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:26:58.050411 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:26:58.050411 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:26:58.050411 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 15:26:58.050411 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 01 15:26:58.050411 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 569/1156] 10.222.0.102 () {56 vars in 1101 bytes} [Mon Aug 1 15:26:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:26:58.055179 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ace5dd2-d01b-496d-bec6-2605635bb46c None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:26:58.148716 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:26:58.151570 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ace5dd2-d01b-496d-bec6-2605635bb46c None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:26:58.184059 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a658c6e4-27d6-40b5-bbd6-1169a16563c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:26:58.184660 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a658c6e4-27d6-40b5-bbd6-1169a16563c1 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:58.184964 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a658c6e4-27d6-40b5-bbd6-1169a16563c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:58.185234 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a658c6e4-27d6-40b5-bbd6-1169a16563c1 None admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:58.185929 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a658c6e4-27d6-40b5-bbd6-1169a16563c1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:26:58.186237 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a658c6e4-27d6-40b5-bbd6-1169a16563c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:26:58.188063 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a658c6e4-27d6-40b5-bbd6-1169a16563c1 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:26:58.196733 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 588/1157] 10.222.0.102 () {56 vars in 1104 bytes} [Mon Aug 1 15:26:58 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:26:58.202787 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1bbb3b-6c76-494b-ad52-58a153d29941 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:26:58.300888 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1bbb3b-6c76-494b-ad52-58a153d29941 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:26:58.322969 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:26:58.333680 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a74f72-b32e-4b39-8ea7-dd34793b492d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:26:58.334313 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a74f72-b32e-4b39-8ea7-dd34793b492d None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:58.334592 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a74f72-b32e-4b39-8ea7-dd34793b492d None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:58.335358 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a74f72-b32e-4b39-8ea7-dd34793b492d None admin] PATH_INFO: `/v3/users/077989f21f944143bd123e75becdaa29` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:58.336650 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a74f72-b32e-4b39-8ea7-dd34793b492d None admin] RBAC: Authorizing `identity:get_user(user_id=077989f21f944143bd123e75becdaa29)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:26:58.338184 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a74f72-b32e-4b39-8ea7-dd34793b492d None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:26:58.339869 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 570/1158] 10.222.0.102 () {56 vars in 1182 bytes} [Mon Aug 1 15:26:58 2022] GET /identity/v3/users/077989f21f944143bd123e75becdaa29 => generated 287 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:26:58.345756 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a658c6e4-27d6-40b5-bbd6-1169a16563c1 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:26:58.443972 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a658c6e4-27d6-40b5-bbd6-1169a16563c1 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:26:58.477799 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdb0779-eba7-4fad-87ff-5891f468fa7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:26:58.478396 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdb0779-eba7-4fad-87ff-5891f468fa7e None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:58.478669 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdb0779-eba7-4fad-87ff-5891f468fa7e None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:58.478938 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdb0779-eba7-4fad-87ff-5891f468fa7e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:58.507800 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:26:58.544557 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdb0779-eba7-4fad-87ff-5891f468fa7e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:26:58.546122 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdb0779-eba7-4fad-87ff-5891f468fa7e None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:26:58.643076 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 589/1159] 10.222.0.102 () {58 vars in 1287 bytes} [Mon Aug 1 15:26:58 2022] GET /identity/v3/auth/tokens => generated 2113 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 01 15:26:58.649545 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a74f72-b32e-4b39-8ea7-dd34793b492d None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:26:58.748178 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a74f72-b32e-4b39-8ea7-dd34793b492d None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:26:58.780956 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd06e63-11a1-45f4-9dfe-cf3251e76b9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:26:58.781587 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd06e63-11a1-45f4-9dfe-cf3251e76b9a None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:58.781869 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd06e63-11a1-45f4-9dfe-cf3251e76b9a None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:58.782136 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd06e63-11a1-45f4-9dfe-cf3251e76b9a None admin] PATH_INFO: `/v3/projects/b8565806a2e04df7a493f5eb802e0223` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:58.783275 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd06e63-11a1-45f4-9dfe-cf3251e76b9a None admin] RBAC: Authorizing `identity:get_project(project_id=b8565806a2e04df7a493f5eb802e0223)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:26:58.784834 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd06e63-11a1-45f4-9dfe-cf3251e76b9a None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:26:58.786522 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 571/1160] 10.222.0.102 () {56 vars in 1191 bytes} [Mon Aug 1 15:26:58 2022] GET /identity/v3/projects/b8565806a2e04df7a493f5eb802e0223 => generated 312 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:26:58.792788 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdb0779-eba7-4fad-87ff-5891f468fa7e None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:26:58.854246 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:26:58.898545 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdb0779-eba7-4fad-87ff-5891f468fa7e None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:26:58.931316 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143bfcdc-9889-45f1-a89a-4b55ccb28ad9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:26:58.931917 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143bfcdc-9889-45f1-a89a-4b55ccb28ad9 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:26:58.932198 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143bfcdc-9889-45f1-a89a-4b55ccb28ad9 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:26:58.932471 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143bfcdc-9889-45f1-a89a-4b55ccb28ad9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:26:58.933279 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143bfcdc-9889-45f1-a89a-4b55ccb28ad9 None admin] RBAC: Adding query filter params (role.id=de1374f966c04c27b579515b54334fd2, scope.project.id=b8565806a2e04df7a493f5eb802e0223, user.id=077989f21f944143bd123e75becdaa29) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:26:58.933589 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143bfcdc-9889-45f1-a89a-4b55ccb28ad9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:26:58.935019 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143bfcdc-9889-45f1-a89a-4b55ccb28ad9 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:26:58.940654 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 590/1161] 10.222.0.102 () {56 vars in 1379 bytes} [Mon Aug 1 15:26:58 2022] GET /identity/v3/role_assignments?user.id=077989f21f944143bd123e75becdaa29&scope.project.id=b8565806a2e04df7a493f5eb802e0223&role.id=de1374f966c04c27b579515b54334fd2 => generated 610 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:27:00.950806 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c6d609-592a-4699-be5d-47cfb0f5dc2a None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:27:00.951564 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c6d609-592a-4699-be5d-47cfb0f5dc2a None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:27:00.951690 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c6d609-592a-4699-be5d-47cfb0f5dc2a None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:27:00.953011 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 572/1162] 10.222.0.102 () {54 vars in 931 bytes} [Mon Aug 1 15:27:00 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 15:27:00.958113 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1544810-7378-498c-aea3-21bbd0734e60 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:27:00.958507 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1544810-7378-498c-aea3-21bbd0734e60 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:27:00.958649 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1544810-7378-498c-aea3-21bbd0734e60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:27:00.976889 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-d1544810-7378-498c-aea3-21bbd0734e60 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:27:00.978053 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-d1544810-7378-498c-aea3-21bbd0734e60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:27:01.041833 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 591/1163] 10.222.0.102 () {58 vars in 1028 bytes} [Mon Aug 1 15:27:00 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 15:27:01.062819 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c6d609-592a-4699-be5d-47cfb0f5dc2a None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:27:01.123936 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:27:01.165671 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c6d609-592a-4699-be5d-47cfb0f5dc2a None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:27:01.198341 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49e516e-5b30-4ae3-a9f6-2f1289ddd247 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:27:01.198945 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49e516e-5b30-4ae3-a9f6-2f1289ddd247 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:27:01.199216 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49e516e-5b30-4ae3-a9f6-2f1289ddd247 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:27:01.199481 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49e516e-5b30-4ae3-a9f6-2f1289ddd247 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:27:01.273459 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49e516e-5b30-4ae3-a9f6-2f1289ddd247 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:27:01.274917 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49e516e-5b30-4ae3-a9f6-2f1289ddd247 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:27:01.331145 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:27:01.371975 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 573/1164] 10.222.0.102 () {58 vars in 1287 bytes} [Mon Aug 1 15:27:01 2022] GET /identity/v3/auth/tokens => generated 2113 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 01 15:27:01.378011 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1544810-7378-498c-aea3-21bbd0734e60 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:27:01.433467 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:27:01.478417 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1544810-7378-498c-aea3-21bbd0734e60 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:27:01.511887 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2727959e-bcfe-4f86-9caa-3b9c3838483b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:27:01.512509 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2727959e-bcfe-4f86-9caa-3b9c3838483b None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:27:01.512788 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2727959e-bcfe-4f86-9caa-3b9c3838483b None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:27:01.513089 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2727959e-bcfe-4f86-9caa-3b9c3838483b None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:27:01.519588 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2727959e-bcfe-4f86-9caa-3b9c3838483b None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:27:01.521063 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2727959e-bcfe-4f86-9caa-3b9c3838483b None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:27:01.532440 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-2727959e-bcfe-4f86-9caa-3b9c3838483b None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 01 15:27:01.532440 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:27:01.532440 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 01 15:27:01.532440 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 01 15:27:01.532440 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 15:27:01.532440 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 15:27:01.532440 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 15:27:01.532440 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 15:27:01.532440 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Aug 01 15:27:01.532440 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 01 15:27:01.532440 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 15:27:01.532440 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 01 15:27:01.532440 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:27:01.532440 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:27:01.532440 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:27:01.532440 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:27:01.532440 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:27:01.533741 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:27:01.533741 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:27:01.533741 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:27:01.533741 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:27:01.533741 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:27:01.533741 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:27:01.533741 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:27:01.533741 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:27:01.533741 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:27:01.533741 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:27:01.533741 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:27:01.533741 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:27:01.533741 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:27:01.533741 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:27:01.533741 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:27:01.533741 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:27:01.534594 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:27:01.534594 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 01 15:27:01.534594 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:27:01.534594 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:27:01.534594 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:27:01.534594 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:27:01.534594 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:27:01.534594 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:27:01.534594 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:27:01.534594 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:27:01.534594 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 01 15:27:01.534594 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:27:01.534594 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 01 15:27:01.534594 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 01 15:27:01.534594 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 592/1165] 10.222.0.102 () {56 vars in 1122 bytes} [Mon Aug 1 15:27:01 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:27:01.540147 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49e516e-5b30-4ae3-a9f6-2f1289ddd247 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:27:01.639191 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49e516e-5b30-4ae3-a9f6-2f1289ddd247 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:27:01.672453 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae19110-470b-4d9e-957c-3992682e22d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:27:01.673093 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae19110-470b-4d9e-957c-3992682e22d4 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:27:01.673372 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae19110-470b-4d9e-957c-3992682e22d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:27:01.673641 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae19110-470b-4d9e-957c-3992682e22d4 None admin] PATH_INFO: `/v3/domains` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:27:01.674322 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae19110-470b-4d9e-957c-3992682e22d4 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:27:01.674622 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae19110-470b-4d9e-957c-3992682e22d4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:27:01.675984 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae19110-470b-4d9e-957c-3992682e22d4 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:27:01.684704 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 574/1166] 10.222.0.102 () {56 vars in 1120 bytes} [Mon Aug 1 15:27:01 2022] GET /identity/v3/domains?name=swift_test => generated 126 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:27:03.658909 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90dfffd-a1f2-469f-9c4b-bfb9a8c0979f None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:27:03.659492 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90dfffd-a1f2-469f-9c4b-bfb9a8c0979f None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:27:03.659492 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90dfffd-a1f2-469f-9c4b-bfb9a8c0979f None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:27:03.660805 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 593/1167] 10.222.0.102 () {54 vars in 931 bytes} [Mon Aug 1 15:27:03 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 15:27:03.666244 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeccaaaa-0983-4b59-a683-446acd79820c None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:27:03.666652 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeccaaaa-0983-4b59-a683-446acd79820c None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:27:03.666789 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeccaaaa-0983-4b59-a683-446acd79820c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:27:03.685491 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-aeccaaaa-0983-4b59-a683-446acd79820c None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:27:03.686704 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-aeccaaaa-0983-4b59-a683-446acd79820c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:27:03.704527 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:27:03.752734 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 575/1168] 10.222.0.102 () {58 vars in 1028 bytes} [Mon Aug 1 15:27:03 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 15:27:03.775174 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90dfffd-a1f2-469f-9c4b-bfb9a8c0979f None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:27:03.876676 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90dfffd-a1f2-469f-9c4b-bfb9a8c0979f None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:27:03.893021 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:27:03.910045 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d48cd5-4e0f-42f9-a19b-d033b0006f9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:27:03.910591 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d48cd5-4e0f-42f9-a19b-d033b0006f9b None admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:27:03.910870 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d48cd5-4e0f-42f9-a19b-d033b0006f9b None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:27:03.911140 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d48cd5-4e0f-42f9-a19b-d033b0006f9b None admin] PATH_INFO: `/v3/domains` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:27:03.911839 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d48cd5-4e0f-42f9-a19b-d033b0006f9b None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:27:03.913769 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d48cd5-4e0f-42f9-a19b-d033b0006f9b None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:27:04.039847 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 594/1169] 10.222.0.102 () {60 vars in 1143 bytes} [Mon Aug 1 15:27:03 2022] POST /identity/v3/domains => generated 268 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:27:06.122616 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de63394b-371b-4369-95be-e5e5ec1ee011 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:27:06.123138 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de63394b-371b-4369-95be-e5e5ec1ee011 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:27:06.123138 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de63394b-371b-4369-95be-e5e5ec1ee011 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:27:06.124528 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 576/1170] 10.222.0.102 () {54 vars in 931 bytes} [Mon Aug 1 15:27:06 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 15:27:06.129933 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d5c479-4f88-438a-80e2-a8a5a59c151e None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:27:06.130369 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d5c479-4f88-438a-80e2-a8a5a59c151e None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:27:06.130464 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d5c479-4f88-438a-80e2-a8a5a59c151e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:27:06.148658 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-d6d5c479-4f88-438a-80e2-a8a5a59c151e None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:27:06.149793 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-d6d5c479-4f88-438a-80e2-a8a5a59c151e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:27:06.217068 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 595/1171] 10.222.0.102 () {58 vars in 1028 bytes} [Mon Aug 1 15:27:06 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 15:27:06.241130 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de63394b-371b-4369-95be-e5e5ec1ee011 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:27:06.340078 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de63394b-371b-4369-95be-e5e5ec1ee011 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:27:06.374490 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92ff954-6314-4604-a7e5-5afec2898a01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:27:06.375186 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92ff954-6314-4604-a7e5-5afec2898a01 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:27:06.375493 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92ff954-6314-4604-a7e5-5afec2898a01 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:27:06.375787 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92ff954-6314-4604-a7e5-5afec2898a01 None admin] PATH_INFO: `/v3/domains/24f2bc3ba8f542e6b48b9dcb346cee63` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:27:06.387369 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92ff954-6314-4604-a7e5-5afec2898a01 None admin] RBAC: Authorizing `identity:get_domain(domain_id=24f2bc3ba8f542e6b48b9dcb346cee63)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:27:06.389037 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92ff954-6314-4604-a7e5-5afec2898a01 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:27:06.390630 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 577/1172] 10.222.0.102 () {56 vars in 1188 bytes} [Mon Aug 1 15:27:06 2022] GET /identity/v3/domains/24f2bc3ba8f542e6b48b9dcb346cee63 => generated 268 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:27:06.396456 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d5c479-4f88-438a-80e2-a8a5a59c151e None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:27:06.493951 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d5c479-4f88-438a-80e2-a8a5a59c151e None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:27:06.501300 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:27:06.527357 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bed581b-07e7-4741-b84a-48741328ce1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:27:06.527965 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bed581b-07e7-4741-b84a-48741328ce1d None admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:27:06.528242 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bed581b-07e7-4741-b84a-48741328ce1d None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:27:06.528524 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bed581b-07e7-4741-b84a-48741328ce1d None admin] PATH_INFO: `/v3/projects` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:27:06.529225 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bed581b-07e7-4741-b84a-48741328ce1d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:27:06.530654 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bed581b-07e7-4741-b84a-48741328ce1d None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:27:06.639559 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 596/1173] 10.222.0.102 () {60 vars in 1146 bytes} [Mon Aug 1 15:27:06 2022] POST /identity/v3/projects => generated 362 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:27:08.758936 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1b6e80-f136-4a52-b3b6-077fb4fd7a8b None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:27:08.759491 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1b6e80-f136-4a52-b3b6-077fb4fd7a8b None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:27:08.759491 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1b6e80-f136-4a52-b3b6-077fb4fd7a8b None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:27:08.760831 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 578/1174] 10.222.0.102 () {54 vars in 931 bytes} [Mon Aug 1 15:27:08 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 15:27:08.766074 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfc324f-bf8b-4866-8cc3-bed04d693fd3 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:27:08.766537 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfc324f-bf8b-4866-8cc3-bed04d693fd3 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:27:08.766627 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfc324f-bf8b-4866-8cc3-bed04d693fd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:27:08.784322 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-adfc324f-bf8b-4866-8cc3-bed04d693fd3 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:27:08.785538 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-adfc324f-bf8b-4866-8cc3-bed04d693fd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:27:08.850716 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 597/1175] 10.222.0.102 () {58 vars in 1028 bytes} [Mon Aug 1 15:27:08 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 15:27:08.875738 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1b6e80-f136-4a52-b3b6-077fb4fd7a8b None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:27:08.892707 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:27:08.976750 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1b6e80-f136-4a52-b3b6-077fb4fd7a8b None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:27:09.009288 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94826bc-0a4d-4129-867f-f6236af6df76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:27:09.009860 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94826bc-0a4d-4129-867f-f6236af6df76 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:27:09.010140 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94826bc-0a4d-4129-867f-f6236af6df76 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:27:09.010414 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94826bc-0a4d-4129-867f-f6236af6df76 None admin] PATH_INFO: `/v3/domains/24f2bc3ba8f542e6b48b9dcb346cee63` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:27:09.011560 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94826bc-0a4d-4129-867f-f6236af6df76 None admin] RBAC: Authorizing `identity:get_domain(domain_id=24f2bc3ba8f542e6b48b9dcb346cee63)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:27:09.013022 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94826bc-0a4d-4129-867f-f6236af6df76 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:27:09.014607 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 579/1176] 10.222.0.102 () {56 vars in 1188 bytes} [Mon Aug 1 15:27:08 2022] GET /identity/v3/domains/24f2bc3ba8f542e6b48b9dcb346cee63 => generated 268 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:27:09.020365 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfc324f-bf8b-4866-8cc3-bed04d693fd3 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:27:09.105515 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:27:09.117665 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfc324f-bf8b-4866-8cc3-bed04d693fd3 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:27:09.151516 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bd2eb1-3867-421d-beea-37fcb36c2844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:27:09.152120 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bd2eb1-3867-421d-beea-37fcb36c2844 None admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:27:09.152400 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bd2eb1-3867-421d-beea-37fcb36c2844 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:27:09.152673 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bd2eb1-3867-421d-beea-37fcb36c2844 None admin] PATH_INFO: `/v3/users` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:27:09.153386 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bd2eb1-3867-421d-beea-37fcb36c2844 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:27:09.154804 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bd2eb1-3867-421d-beea-37fcb36c2844 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:27:09.250189 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 598/1177] 10.222.0.102 () {60 vars in 1137 bytes} [Mon Aug 1 15:27:09 2022] POST /identity/v3/users => generated 312 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:27:11.281812 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a897580-9345-455d-9ca6-4ec42679b91b None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:27:11.282359 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a897580-9345-455d-9ca6-4ec42679b91b None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:27:11.282359 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a897580-9345-455d-9ca6-4ec42679b91b None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:27:11.283714 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 580/1178] 10.222.0.102 () {54 vars in 931 bytes} [Mon Aug 1 15:27:11 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 15:27:11.288676 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c32bcf-be57-4408-9469-31c0fd69d160 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:27:11.289125 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c32bcf-be57-4408-9469-31c0fd69d160 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:27:11.289262 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c32bcf-be57-4408-9469-31c0fd69d160 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:27:11.306977 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-53c32bcf-be57-4408-9469-31c0fd69d160 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:27:11.308137 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-53c32bcf-be57-4408-9469-31c0fd69d160 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:27:11.373382 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 599/1179] 10.222.0.102 () {58 vars in 1028 bytes} [Mon Aug 1 15:27:11 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 15:27:11.399734 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a897580-9345-455d-9ca6-4ec42679b91b None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:27:11.480676 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:27:11.498656 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a897580-9345-455d-9ca6-4ec42679b91b None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:27:11.532004 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f79904-e17b-4f13-afab-28a5d58a83f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:27:11.532592 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f79904-e17b-4f13-afab-28a5d58a83f7 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:27:11.532891 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f79904-e17b-4f13-afab-28a5d58a83f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:27:11.533159 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f79904-e17b-4f13-afab-28a5d58a83f7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:27:11.542895 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f79904-e17b-4f13-afab-28a5d58a83f7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:27:11.547813 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-21f79904-e17b-4f13-afab-28a5d58a83f7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 15:27:11.547813 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:27:11.547813 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:27:11.547813 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:27:11.547813 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:27:11.547813 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:27:11.547813 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:27:11.547813 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:27:11.547813 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:27:11.547813 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:27:11.547813 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:27:11.547813 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:27:11.547813 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:27:11.547813 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:27:11.547813 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:27:11.547813 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:27:11.548997 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:27:11.548997 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:27:11.548997 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:27:11.548997 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:27:11.548997 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:27:11.548997 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:27:11.548997 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:27:11.548997 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:27:11.548997 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:27:11.548997 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:27:11.548997 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:27:11.548997 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 01 15:27:11.548997 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:27:11.548997 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:27:11.548997 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:27:11.548997 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:27:11.550052 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:27:11.550052 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:27:11.550052 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:27:11.550052 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:27:11.550052 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:27:11.550052 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:27:11.550052 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:27:11.550052 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:27:11.550052 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:27:11.550052 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:27:11.550052 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 15:27:11.550052 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 01 15:27:11.550052 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 581/1180] 10.222.0.102 () {56 vars in 1101 bytes} [Mon Aug 1 15:27:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:27:11.555116 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c32bcf-be57-4408-9469-31c0fd69d160 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:27:11.627226 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:27:11.651469 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c32bcf-be57-4408-9469-31c0fd69d160 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:27:11.684418 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae6cc13-1a90-426c-ab52-592f66a9ef07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:27:11.685050 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae6cc13-1a90-426c-ab52-592f66a9ef07 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:27:11.685326 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae6cc13-1a90-426c-ab52-592f66a9ef07 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:27:11.685594 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae6cc13-1a90-426c-ab52-592f66a9ef07 None admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:27:11.686293 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae6cc13-1a90-426c-ab52-592f66a9ef07 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:27:11.686623 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae6cc13-1a90-426c-ab52-592f66a9ef07 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:27:11.687986 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae6cc13-1a90-426c-ab52-592f66a9ef07 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:27:11.696381 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 600/1181] 10.222.0.102 () {56 vars in 1104 bytes} [Mon Aug 1 15:27:11 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:27:11.703490 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f79904-e17b-4f13-afab-28a5d58a83f7 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:27:11.801069 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f79904-e17b-4f13-afab-28a5d58a83f7 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:27:11.834025 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b297732b-e81a-4c06-8fbe-12b791237699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:27:11.834746 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b297732b-e81a-4c06-8fbe-12b791237699 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:27:11.835040 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b297732b-e81a-4c06-8fbe-12b791237699 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:27:11.835314 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b297732b-e81a-4c06-8fbe-12b791237699 None admin] PATH_INFO: `/v3/users/b5aca6c953054272bebe142227c3222b` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:27:11.846143 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:27:11.848465 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b297732b-e81a-4c06-8fbe-12b791237699 None admin] RBAC: Authorizing `identity:get_user(user_id=b5aca6c953054272bebe142227c3222b)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:27:11.849948 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b297732b-e81a-4c06-8fbe-12b791237699 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:27:11.851597 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 582/1182] 10.222.0.102 () {56 vars in 1182 bytes} [Mon Aug 1 15:27:11 2022] GET /identity/v3/users/b5aca6c953054272bebe142227c3222b => generated 312 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:27:11.857391 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae6cc13-1a90-426c-ab52-592f66a9ef07 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:27:11.957066 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae6cc13-1a90-426c-ab52-592f66a9ef07 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:27:11.989861 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb8732a-d386-4710-9784-2ed79da62d77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:27:11.990465 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb8732a-d386-4710-9784-2ed79da62d77 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:27:11.990744 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb8732a-d386-4710-9784-2ed79da62d77 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:27:11.991611 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb8732a-d386-4710-9784-2ed79da62d77 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:27:11.995008 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:27:12.056898 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb8732a-d386-4710-9784-2ed79da62d77 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:27:12.058275 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb8732a-d386-4710-9784-2ed79da62d77 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:27:12.152728 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 601/1183] 10.222.0.102 () {58 vars in 1287 bytes} [Mon Aug 1 15:27:11 2022] GET /identity/v3/auth/tokens => generated 2113 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 01 15:27:12.158586 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b297732b-e81a-4c06-8fbe-12b791237699 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:27:12.260548 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b297732b-e81a-4c06-8fbe-12b791237699 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:27:12.294579 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b2f56b-34fc-4ea6-83e5-bc34ea11aed4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:27:12.295212 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b2f56b-34fc-4ea6-83e5-bc34ea11aed4 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:27:12.295492 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b2f56b-34fc-4ea6-83e5-bc34ea11aed4 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:27:12.295767 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b2f56b-34fc-4ea6-83e5-bc34ea11aed4 None admin] PATH_INFO: `/v3/projects/7618bf9298c94414bf94bc645f9d598d` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:27:12.296942 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b2f56b-34fc-4ea6-83e5-bc34ea11aed4 None admin] RBAC: Authorizing `identity:get_project(project_id=7618bf9298c94414bf94bc645f9d598d)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:27:12.298381 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b2f56b-34fc-4ea6-83e5-bc34ea11aed4 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:27:12.300042 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 583/1184] 10.222.0.102 () {56 vars in 1191 bytes} [Mon Aug 1 15:27:12 2022] GET /identity/v3/projects/7618bf9298c94414bf94bc645f9d598d => generated 362 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:27:12.306746 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb8732a-d386-4710-9784-2ed79da62d77 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:27:12.340742 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:27:12.402551 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb8732a-d386-4710-9784-2ed79da62d77 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:27:12.435282 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ea0acb-d17c-4c74-af84-97af812eae87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:27:12.435875 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ea0acb-d17c-4c74-af84-97af812eae87 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:27:12.436150 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ea0acb-d17c-4c74-af84-97af812eae87 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:27:12.436415 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ea0acb-d17c-4c74-af84-97af812eae87 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:27:12.437212 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ea0acb-d17c-4c74-af84-97af812eae87 None admin] RBAC: Adding query filter params (role.id=de1374f966c04c27b579515b54334fd2, scope.project.id=7618bf9298c94414bf94bc645f9d598d, user.id=b5aca6c953054272bebe142227c3222b) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:27:12.437512 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ea0acb-d17c-4c74-af84-97af812eae87 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:27:12.438919 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ea0acb-d17c-4c74-af84-97af812eae87 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:27:12.444148 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 602/1185] 10.222.0.102 () {56 vars in 1379 bytes} [Mon Aug 1 15:27:12 2022] GET /identity/v3/role_assignments?user.id=b5aca6c953054272bebe142227c3222b&scope.project.id=7618bf9298c94414bf94bc645f9d598d&role.id=de1374f966c04c27b579515b54334fd2 => generated 260 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:27:14.410371 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f052bc38-1abf-414c-b9a1-629540c9c47c None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:27:14.410957 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f052bc38-1abf-414c-b9a1-629540c9c47c None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:27:14.410957 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f052bc38-1abf-414c-b9a1-629540c9c47c None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:27:14.412274 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 584/1186] 10.222.0.102 () {54 vars in 931 bytes} [Mon Aug 1 15:27:14 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 15:27:14.417416 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4badb6e1-91f5-4913-a540-92997a0a6dc9 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:27:14.417826 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4badb6e1-91f5-4913-a540-92997a0a6dc9 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:27:14.417960 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4badb6e1-91f5-4913-a540-92997a0a6dc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:27:14.435689 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-4badb6e1-91f5-4913-a540-92997a0a6dc9 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:27:14.436878 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-4badb6e1-91f5-4913-a540-92997a0a6dc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:27:14.505662 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 603/1187] 10.222.0.102 () {58 vars in 1028 bytes} [Mon Aug 1 15:27:14 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 15:27:14.528944 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f052bc38-1abf-414c-b9a1-629540c9c47c None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:27:14.595049 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:27:14.627409 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f052bc38-1abf-414c-b9a1-629540c9c47c None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:27:14.661634 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249d26d3-043d-4df2-94b8-182b141230ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:27:14.662203 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249d26d3-043d-4df2-94b8-182b141230ee None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:27:14.662488 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249d26d3-043d-4df2-94b8-182b141230ee None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:27:14.662762 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249d26d3-043d-4df2-94b8-182b141230ee None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:27:14.672672 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249d26d3-043d-4df2-94b8-182b141230ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:27:14.677527 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-249d26d3-043d-4df2-94b8-182b141230ee None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 15:27:14.677527 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:27:14.677527 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:27:14.677527 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:27:14.677527 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:27:14.677527 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:27:14.677527 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:27:14.677527 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:27:14.677527 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:27:14.677527 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:27:14.677527 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:27:14.677527 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:27:14.677527 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:27:14.677527 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:27:14.677527 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:27:14.677527 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:27:14.679229 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:27:14.679229 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:27:14.679229 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:27:14.679229 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:27:14.679229 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:27:14.679229 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:27:14.679229 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:27:14.679229 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:27:14.679229 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:27:14.679229 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:27:14.679229 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:27:14.679229 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 01 15:27:14.679229 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:27:14.679229 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:27:14.679229 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:27:14.679229 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:27:14.680335 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:27:14.680335 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:27:14.680335 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:27:14.680335 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:27:14.680335 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:27:14.680335 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:27:14.680335 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:27:14.680335 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:27:14.680335 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:27:14.680335 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:27:14.680335 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 15:27:14.680335 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 01 15:27:14.680335 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 585/1188] 10.222.0.102 () {56 vars in 1101 bytes} [Mon Aug 1 15:27:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:27:14.685214 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4badb6e1-91f5-4913-a540-92997a0a6dc9 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:27:14.715018 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:27:14.782797 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4badb6e1-91f5-4913-a540-92997a0a6dc9 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:27:14.815585 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f645546b-f734-4af9-b94e-b09734710d96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:27:14.816182 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f645546b-f734-4af9-b94e-b09734710d96 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:27:14.816457 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f645546b-f734-4af9-b94e-b09734710d96 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:27:14.816723 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f645546b-f734-4af9-b94e-b09734710d96 None admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:27:14.817453 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f645546b-f734-4af9-b94e-b09734710d96 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:27:14.817751 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f645546b-f734-4af9-b94e-b09734710d96 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:27:14.819125 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f645546b-f734-4af9-b94e-b09734710d96 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:27:14.827677 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 604/1189] 10.222.0.102 () {56 vars in 1104 bytes} [Mon Aug 1 15:27:14 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:27:14.833445 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249d26d3-043d-4df2-94b8-182b141230ee None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:27:14.931029 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249d26d3-043d-4df2-94b8-182b141230ee None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:27:14.956870 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:27:14.964502 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d980632c-f7fc-402c-8d97-89b0c4447d62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:27:14.970612 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d980632c-f7fc-402c-8d97-89b0c4447d62 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:27:14.970612 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d980632c-f7fc-402c-8d97-89b0c4447d62 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:27:14.970612 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d980632c-f7fc-402c-8d97-89b0c4447d62 None admin] PATH_INFO: `/v3/users/b5aca6c953054272bebe142227c3222b` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:27:14.970612 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d980632c-f7fc-402c-8d97-89b0c4447d62 None admin] RBAC: Authorizing `identity:get_user(user_id=b5aca6c953054272bebe142227c3222b)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:27:14.970612 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d980632c-f7fc-402c-8d97-89b0c4447d62 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:27:14.970612 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 586/1190] 10.222.0.102 () {56 vars in 1182 bytes} [Mon Aug 1 15:27:14 2022] GET /identity/v3/users/b5aca6c953054272bebe142227c3222b => generated 312 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:27:14.976191 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f645546b-f734-4af9-b94e-b09734710d96 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:27:15.065278 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:27:15.073750 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f645546b-f734-4af9-b94e-b09734710d96 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:27:15.107195 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7db4e27-1655-4bb4-a8c4-dbae2b239b00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:27:15.107820 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7db4e27-1655-4bb4-a8c4-dbae2b239b00 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:27:15.108098 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7db4e27-1655-4bb4-a8c4-dbae2b239b00 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:27:15.108374 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7db4e27-1655-4bb4-a8c4-dbae2b239b00 None admin] PATH_INFO: `/v3/projects/7618bf9298c94414bf94bc645f9d598d` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:27:15.109534 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7db4e27-1655-4bb4-a8c4-dbae2b239b00 None admin] RBAC: Authorizing `identity:get_project(project_id=7618bf9298c94414bf94bc645f9d598d)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:27:15.110991 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7db4e27-1655-4bb4-a8c4-dbae2b239b00 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:27:15.112663 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 605/1191] 10.222.0.102 () {56 vars in 1191 bytes} [Mon Aug 1 15:27:14 2022] GET /identity/v3/projects/7618bf9298c94414bf94bc645f9d598d => generated 362 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:27:15.119164 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d980632c-f7fc-402c-8d97-89b0c4447d62 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:27:15.216751 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d980632c-f7fc-402c-8d97-89b0c4447d62 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:27:15.249677 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a511a286-57fc-480a-b951-8b646ee5bd0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:27:15.250331 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a511a286-57fc-480a-b951-8b646ee5bd0e None admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:27:15.250612 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a511a286-57fc-480a-b951-8b646ee5bd0e None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:27:15.250883 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a511a286-57fc-480a-b951-8b646ee5bd0e None admin] PATH_INFO: `/v3/projects/7618bf9298c94414bf94bc645f9d598d/users/b5aca6c953054272bebe142227c3222b/roles/de1374f966c04c27b579515b54334fd2` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:27:15.252802 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a511a286-57fc-480a-b951-8b646ee5bd0e None admin] RBAC: Authorizing `identity:create_grant(project_id=7618bf9298c94414bf94bc645f9d598d, user_id=b5aca6c953054272bebe142227c3222b, role_id=de1374f966c04c27b579515b54334fd2)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:27:15.254257 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a511a286-57fc-480a-b951-8b646ee5bd0e None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:27:15.318818 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 587/1192] 10.222.0.102 () {58 vars in 1444 bytes} [Mon Aug 1 15:27:15 2022] PUT /identity/v3/projects/7618bf9298c94414bf94bc645f9d598d/users/b5aca6c953054272bebe142227c3222b/roles/de1374f966c04c27b579515b54334fd2 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:27:17.294146 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a367bd-7508-4249-877e-b732646ddea0 None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:27:17.294690 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a367bd-7508-4249-877e-b732646ddea0 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:27:17.294782 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a367bd-7508-4249-877e-b732646ddea0 None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:27:17.296149 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 606/1193] 10.222.0.102 () {54 vars in 931 bytes} [Mon Aug 1 15:27:17 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 15:27:17.301359 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91929b91-760c-4115-84d1-e41d7087aa73 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:27:17.301775 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91929b91-760c-4115-84d1-e41d7087aa73 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:27:17.301903 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91929b91-760c-4115-84d1-e41d7087aa73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:27:17.319992 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-91929b91-760c-4115-84d1-e41d7087aa73 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:27:17.321184 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-91929b91-760c-4115-84d1-e41d7087aa73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:27:17.370058 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:27:17.385777 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 588/1194] 10.222.0.102 () {58 vars in 1028 bytes} [Mon Aug 1 15:27:17 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 15:27:17.408527 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a367bd-7508-4249-877e-b732646ddea0 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:27:17.508319 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a367bd-7508-4249-877e-b732646ddea0 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:27:17.541169 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afda6993-11c9-476e-b62e-549112d34e5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:27:17.541788 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afda6993-11c9-476e-b62e-549112d34e5d None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:27:17.542074 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afda6993-11c9-476e-b62e-549112d34e5d None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:27:17.542348 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afda6993-11c9-476e-b62e-549112d34e5d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:27:17.552227 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afda6993-11c9-476e-b62e-549112d34e5d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:27:17.557658 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-afda6993-11c9-476e-b62e-549112d34e5d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 15:27:17.557658 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:27:17.557658 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:27:17.557658 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:27:17.557658 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:27:17.557658 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:27:17.557658 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:27:17.557658 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:27:17.557658 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:27:17.557658 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:27:17.557658 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:27:17.557658 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:27:17.557658 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:27:17.557658 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:27:17.557658 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:27:17.557658 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:27:17.558750 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:27:17.558750 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:27:17.558750 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:27:17.558750 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:27:17.558750 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:27:17.558750 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:27:17.558750 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:27:17.558750 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:27:17.558750 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:27:17.558750 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:27:17.558750 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:27:17.558750 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 01 15:27:17.558750 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:27:17.558750 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:27:17.558750 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:27:17.558750 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:27:17.559890 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:27:17.559890 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:27:17.559890 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:27:17.559890 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:27:17.559890 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:27:17.559890 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:27:17.559890 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:27:17.559890 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:27:17.559890 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:27:17.559890 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:27:17.559890 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 15:27:17.559890 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 01 15:27:17.559890 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 607/1195] 10.222.0.102 () {56 vars in 1101 bytes} [Mon Aug 1 15:27:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:27:17.564786 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91929b91-760c-4115-84d1-e41d7087aa73 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:27:17.660107 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91929b91-760c-4115-84d1-e41d7087aa73 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:27:17.692613 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6318617f-7a5f-41a5-80e6-69855983e06b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:27:17.693242 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6318617f-7a5f-41a5-80e6-69855983e06b None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:27:17.693518 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6318617f-7a5f-41a5-80e6-69855983e06b None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:27:17.693782 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6318617f-7a5f-41a5-80e6-69855983e06b None admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:27:17.694509 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6318617f-7a5f-41a5-80e6-69855983e06b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:27:17.694807 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6318617f-7a5f-41a5-80e6-69855983e06b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:27:17.696192 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6318617f-7a5f-41a5-80e6-69855983e06b None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:27:17.704318 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 589/1196] 10.222.0.102 () {56 vars in 1104 bytes} [Mon Aug 1 15:27:17 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:27:17.715394 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afda6993-11c9-476e-b62e-549112d34e5d None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:27:17.733057 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:27:17.808891 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afda6993-11c9-476e-b62e-549112d34e5d None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:27:17.842294 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f40560-856b-4751-a365-47ff808043fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:27:17.842922 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f40560-856b-4751-a365-47ff808043fb None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:27:17.843203 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f40560-856b-4751-a365-47ff808043fb None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:27:17.843476 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f40560-856b-4751-a365-47ff808043fb None admin] PATH_INFO: `/v3/users/b5aca6c953054272bebe142227c3222b` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:27:17.844626 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f40560-856b-4751-a365-47ff808043fb None admin] RBAC: Authorizing `identity:get_user(user_id=b5aca6c953054272bebe142227c3222b)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:27:17.846083 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f40560-856b-4751-a365-47ff808043fb None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:27:17.847671 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 608/1197] 10.222.0.102 () {56 vars in 1182 bytes} [Mon Aug 1 15:27:17 2022] GET /identity/v3/users/b5aca6c953054272bebe142227c3222b => generated 312 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:27:17.853955 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6318617f-7a5f-41a5-80e6-69855983e06b None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:27:17.903421 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:27:17.953495 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6318617f-7a5f-41a5-80e6-69855983e06b None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:27:17.985597 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b385c90f-3a36-417c-9888-bd4cf3b4f3eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:27:17.986196 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b385c90f-3a36-417c-9888-bd4cf3b4f3eb None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:27:17.986471 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b385c90f-3a36-417c-9888-bd4cf3b4f3eb None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:27:17.986738 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b385c90f-3a36-417c-9888-bd4cf3b4f3eb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:27:18.051242 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b385c90f-3a36-417c-9888-bd4cf3b4f3eb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:27:18.052670 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b385c90f-3a36-417c-9888-bd4cf3b4f3eb None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:27:18.098833 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:27:18.147316 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 590/1198] 10.222.0.102 () {58 vars in 1287 bytes} [Mon Aug 1 15:27:17 2022] GET /identity/v3/auth/tokens => generated 2113 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 01 15:27:18.153323 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f40560-856b-4751-a365-47ff808043fb None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:27:18.240059 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:27:18.251469 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f40560-856b-4751-a365-47ff808043fb None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:27:18.286174 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d83251-8890-4440-976c-ba86d98e0955 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:27:18.286807 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d83251-8890-4440-976c-ba86d98e0955 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:27:18.287082 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d83251-8890-4440-976c-ba86d98e0955 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:27:18.287351 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d83251-8890-4440-976c-ba86d98e0955 None admin] PATH_INFO: `/v3/projects/7618bf9298c94414bf94bc645f9d598d` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:27:18.288503 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d83251-8890-4440-976c-ba86d98e0955 None admin] RBAC: Authorizing `identity:get_project(project_id=7618bf9298c94414bf94bc645f9d598d)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:27:18.289978 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d83251-8890-4440-976c-ba86d98e0955 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:27:18.291618 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 609/1199] 10.222.0.102 () {56 vars in 1191 bytes} [Mon Aug 1 15:27:18 2022] GET /identity/v3/projects/7618bf9298c94414bf94bc645f9d598d => generated 362 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:27:18.297809 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b385c90f-3a36-417c-9888-bd4cf3b4f3eb None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:27:18.394471 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b385c90f-3a36-417c-9888-bd4cf3b4f3eb None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:27:18.426674 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710d204b-ba7f-4dbe-9679-a8cd887bdf07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:27:18.427279 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710d204b-ba7f-4dbe-9679-a8cd887bdf07 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:27:18.427559 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710d204b-ba7f-4dbe-9679-a8cd887bdf07 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:27:18.427832 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710d204b-ba7f-4dbe-9679-a8cd887bdf07 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:27:18.429132 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710d204b-ba7f-4dbe-9679-a8cd887bdf07 None admin] RBAC: Adding query filter params (role.id=de1374f966c04c27b579515b54334fd2, scope.project.id=7618bf9298c94414bf94bc645f9d598d, user.id=b5aca6c953054272bebe142227c3222b) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:27:18.429440 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710d204b-ba7f-4dbe-9679-a8cd887bdf07 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:27:18.430861 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710d204b-ba7f-4dbe-9679-a8cd887bdf07 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:27:18.436485 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 591/1200] 10.222.0.102 () {56 vars in 1379 bytes} [Mon Aug 1 15:27:18 2022] GET /identity/v3/role_assignments?user.id=b5aca6c953054272bebe142227c3222b&scope.project.id=7618bf9298c94414bf94bc645f9d598d&role.id=de1374f966c04c27b579515b54334fd2 => generated 610 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:27:28.282009 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=22 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:27:28.433936 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=94 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:28:31.341109 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6e674f-5489-4004-b1fe-4c7062244de7 None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:28:31.341724 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6e674f-5489-4004-b1fe-4c7062244de7 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:28:31.341724 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6e674f-5489-4004-b1fe-4c7062244de7 None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:28:31.343069 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 610/1201] 10.222.0.102 () {54 vars in 931 bytes} [Mon Aug 1 15:28:31 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 15:28:31.348361 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f51318-6b7b-4db0-8a43-439820b9c19d None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:28:31.348755 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f51318-6b7b-4db0-8a43-439820b9c19d None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:28:31.348941 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f51318-6b7b-4db0-8a43-439820b9c19d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:28:31.366826 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-99f51318-6b7b-4db0-8a43-439820b9c19d None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:28:31.375234 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-99f51318-6b7b-4db0-8a43-439820b9c19d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:28:31.435349 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 592/1202] 10.222.0.102 () {58 vars in 1028 bytes} [Mon Aug 1 15:28:31 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 15:28:31.459659 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6e674f-5489-4004-b1fe-4c7062244de7 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:28:31.561259 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6e674f-5489-4004-b1fe-4c7062244de7 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:28:31.596548 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901cf0ba-bc15-4f8d-b4e5-ccd8a9d2bc08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:28:31.597135 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901cf0ba-bc15-4f8d-b4e5-ccd8a9d2bc08 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:28:31.597418 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901cf0ba-bc15-4f8d-b4e5-ccd8a9d2bc08 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:28:31.597697 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901cf0ba-bc15-4f8d-b4e5-ccd8a9d2bc08 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:28:31.607842 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901cf0ba-bc15-4f8d-b4e5-ccd8a9d2bc08 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:28:31.610202 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901cf0ba-bc15-4f8d-b4e5-ccd8a9d2bc08 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:28:31.624276 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-901cf0ba-bc15-4f8d-b4e5-ccd8a9d2bc08 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:28:31.624276 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:28:31.624276 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:28:31.624276 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:28:31.624276 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:28:31.624276 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:28:31.624276 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:28:31.624276 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:28:31.624276 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:28:31.624276 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:28:31.624276 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:28:31.624276 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:28:31.624276 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:28:31.624276 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:28:31.624276 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:28:31.625404 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:28:31.625404 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:28:31.625404 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:28:31.625404 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:28:31.625404 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:28:31.625404 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:28:31.625404 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:28:31.625404 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:28:31.625404 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 01 15:28:31.625404 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:28:31.625404 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:28:31.625404 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:28:31.625404 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:28:31.625404 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:28:31.625404 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:28:31.625404 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:28:31.625404 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:28:31.626572 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:28:31.626572 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:28:31.626572 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:28:31.626572 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 01 15:28:31.626572 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 611/1203] 10.222.0.102 () {56 vars in 1113 bytes} [Mon Aug 1 15:28:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:28:31.631798 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f51318-6b7b-4db0-8a43-439820b9c19d None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:28:31.730169 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f51318-6b7b-4db0-8a43-439820b9c19d None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:28:31.760533 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:28:31.766337 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd774ff-ef77-447e-8221-eb27bf6d1edd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:28:31.766961 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd774ff-ef77-447e-8221-eb27bf6d1edd None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:28:31.767240 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd774ff-ef77-447e-8221-eb27bf6d1edd None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:28:31.767512 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd774ff-ef77-447e-8221-eb27bf6d1edd None admin] PATH_INFO: `/v3/domains` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:28:31.768200 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd774ff-ef77-447e-8221-eb27bf6d1edd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:28:31.768501 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd774ff-ef77-447e-8221-eb27bf6d1edd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:28:31.769968 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd774ff-ef77-447e-8221-eb27bf6d1edd None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:28:31.781289 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 593/1204] 10.222.0.102 () {56 vars in 1114 bytes} [Mon Aug 1 15:28:31 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:28:31.787070 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901cf0ba-bc15-4f8d-b4e5-ccd8a9d2bc08 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:28:31.842640 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:28:31.894897 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901cf0ba-bc15-4f8d-b4e5-ccd8a9d2bc08 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:28:31.928583 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada51591-3144-48aa-ad91-ea00a546a169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:28:31.929212 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada51591-3144-48aa-ad91-ea00a546a169 None admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:28:31.929491 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada51591-3144-48aa-ad91-ea00a546a169 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:28:31.929759 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada51591-3144-48aa-ad91-ea00a546a169 None admin] PATH_INFO: `/v3/users` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:28:31.930444 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada51591-3144-48aa-ad91-ea00a546a169 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:28:31.931932 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada51591-3144-48aa-ad91-ea00a546a169 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:28:32.033632 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 612/1205] 10.222.0.102 () {60 vars in 1137 bytes} [Mon Aug 1 15:28:31 2022] POST /identity/v3/users => generated 252 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:28:34.113421 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e703c461-052d-4287-bbe2-dea3d89b7ee2 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:28:34.113953 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e703c461-052d-4287-bbe2-dea3d89b7ee2 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:28:34.114068 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e703c461-052d-4287-bbe2-dea3d89b7ee2 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:28:34.115373 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 594/1206] 10.222.0.102 () {54 vars in 931 bytes} [Mon Aug 1 15:28:34 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 15:28:34.120633 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d6eb4a-50cf-4239-a28d-0ca6fb932317 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:28:34.123227 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d6eb4a-50cf-4239-a28d-0ca6fb932317 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:28:34.123227 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d6eb4a-50cf-4239-a28d-0ca6fb932317 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:28:34.141457 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-28d6eb4a-50cf-4239-a28d-0ca6fb932317 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:28:34.142611 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-28d6eb4a-50cf-4239-a28d-0ca6fb932317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:28:34.221079 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 613/1207] 10.222.0.102 () {58 vars in 1028 bytes} [Mon Aug 1 15:28:34 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 15:28:34.250487 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e703c461-052d-4287-bbe2-dea3d89b7ee2 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:28:34.356655 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e703c461-052d-4287-bbe2-dea3d89b7ee2 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:28:34.394857 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405e521f-226a-4855-8559-1388c2ce3f90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:28:34.395424 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405e521f-226a-4855-8559-1388c2ce3f90 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:28:34.395791 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405e521f-226a-4855-8559-1388c2ce3f90 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:28:34.396096 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405e521f-226a-4855-8559-1388c2ce3f90 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:28:34.408729 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405e521f-226a-4855-8559-1388c2ce3f90 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:28:34.414162 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-405e521f-226a-4855-8559-1388c2ce3f90 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 01 15:28:34.414162 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:28:34.414162 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:28:34.414162 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:28:34.414162 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:28:34.414162 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:28:34.414162 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:28:34.414162 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:28:34.414162 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:28:34.414162 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:28:34.414162 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:28:34.414162 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:28:34.414162 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:28:34.414162 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:28:34.414162 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:28:34.414162 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:28:34.415321 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:28:34.415321 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:28:34.415321 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:28:34.415321 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:28:34.415321 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:28:34.415321 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:28:34.415321 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:28:34.415321 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:28:34.415321 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:28:34.415321 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:28:34.415321 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:28:34.415321 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 01 15:28:34.415321 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:28:34.415321 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:28:34.415321 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:28:34.415321 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:28:34.416391 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:28:34.416391 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:28:34.416391 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:28:34.416391 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:28:34.416391 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:28:34.416391 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:28:34.416391 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:28:34.416391 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:28:34.416391 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:28:34.416391 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:28:34.416391 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 01 15:28:34.416391 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 01 15:28:34.416391 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 595/1208] 10.222.0.102 () {56 vars in 1107 bytes} [Mon Aug 1 15:28:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:28:34.422182 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d6eb4a-50cf-4239-a28d-0ca6fb932317 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:28:34.469434 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:28:34.530333 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d6eb4a-50cf-4239-a28d-0ca6fb932317 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:28:34.564755 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad64015-fcb3-44b2-b1e5-d8637588c6cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:28:34.565403 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad64015-fcb3-44b2-b1e5-d8637588c6cc None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:28:34.565683 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad64015-fcb3-44b2-b1e5-d8637588c6cc None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:28:34.565954 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad64015-fcb3-44b2-b1e5-d8637588c6cc None admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:28:34.566659 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad64015-fcb3-44b2-b1e5-d8637588c6cc None admin] RBAC: Adding query filter params (name=service) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:28:34.566964 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad64015-fcb3-44b2-b1e5-d8637588c6cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:28:34.568346 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad64015-fcb3-44b2-b1e5-d8637588c6cc None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:28:34.576627 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 614/1209] 10.222.0.102 () {56 vars in 1108 bytes} [Mon Aug 1 15:28:34 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:28:34.582574 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405e521f-226a-4855-8559-1388c2ce3f90 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:28:34.632244 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:28:34.682313 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405e521f-226a-4855-8559-1388c2ce3f90 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:28:34.714768 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3b479e-0024-412f-92d3-1fb67dedcf8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:28:34.716018 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3b479e-0024-412f-92d3-1fb67dedcf8b None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:28:34.716288 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3b479e-0024-412f-92d3-1fb67dedcf8b None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:28:34.716553 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3b479e-0024-412f-92d3-1fb67dedcf8b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:28:34.727337 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3b479e-0024-412f-92d3-1fb67dedcf8b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:28:34.728947 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3b479e-0024-412f-92d3-1fb67dedcf8b None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:28:34.743054 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-5f3b479e-0024-412f-92d3-1fb67dedcf8b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:28:34.743054 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:28:34.743054 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:28:34.743054 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:28:34.743054 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:28:34.743054 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:28:34.743054 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:28:34.743054 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:28:34.743054 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:28:34.743054 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:28:34.743054 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:28:34.743054 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:28:34.743054 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:28:34.743054 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:28:34.743054 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:28:34.744104 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:28:34.744104 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:28:34.744104 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:28:34.744104 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:28:34.744104 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:28:34.744104 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:28:34.744104 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:28:34.744104 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:28:34.744104 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 01 15:28:34.744104 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:28:34.744104 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:28:34.744104 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:28:34.744104 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:28:34.744104 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:28:34.744104 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:28:34.744104 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:28:34.744104 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:28:34.745270 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:28:34.745270 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:28:34.745270 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:28:34.745270 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 01 15:28:34.745270 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 596/1210] 10.222.0.102 () {56 vars in 1113 bytes} [Mon Aug 1 15:28:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:28:34.750370 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad64015-fcb3-44b2-b1e5-d8637588c6cc None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:28:34.847944 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:28:34.850852 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad64015-fcb3-44b2-b1e5-d8637588c6cc None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:28:34.886183 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0681d5c-2fbb-4f70-846d-873c6cdc71cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:28:34.887303 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0681d5c-2fbb-4f70-846d-873c6cdc71cf None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:28:34.887585 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0681d5c-2fbb-4f70-846d-873c6cdc71cf None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:28:34.887870 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0681d5c-2fbb-4f70-846d-873c6cdc71cf None admin] PATH_INFO: `/v3/domains` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:28:34.888554 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0681d5c-2fbb-4f70-846d-873c6cdc71cf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:28:34.889219 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0681d5c-2fbb-4f70-846d-873c6cdc71cf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:28:34.891070 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0681d5c-2fbb-4f70-846d-873c6cdc71cf None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:28:34.903425 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 615/1211] 10.222.0.102 () {56 vars in 1114 bytes} [Mon Aug 1 15:28:34 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:28:34.909298 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3b479e-0024-412f-92d3-1fb67dedcf8b None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:28:35.010641 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3b479e-0024-412f-92d3-1fb67dedcf8b None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:28:35.012634 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:28:35.044544 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48468d0b-ece8-48dd-9d96-2062ad6de1dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:28:35.045207 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48468d0b-ece8-48dd-9d96-2062ad6de1dd None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:28:35.045497 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48468d0b-ece8-48dd-9d96-2062ad6de1dd None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:28:35.045772 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48468d0b-ece8-48dd-9d96-2062ad6de1dd None admin] PATH_INFO: `/v3/users/placement` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:28:35.053183 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48468d0b-ece8-48dd-9d96-2062ad6de1dd None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:28:35.054681 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48468d0b-ece8-48dd-9d96-2062ad6de1dd None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:28:35.065946 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-48468d0b-ece8-48dd-9d96-2062ad6de1dd None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 01 15:28:35.065946 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:28:35.065946 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:28:35.065946 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:28:35.065946 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:28:35.065946 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:28:35.065946 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:28:35.065946 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:28:35.065946 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:28:35.065946 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:28:35.065946 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:28:35.065946 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:28:35.065946 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 15:28:35.065946 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 15:28:35.065946 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 15:28:35.065946 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 15:28:35.067124 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:28:35.067124 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:28:35.067124 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 15:28:35.067124 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 15:28:35.067124 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 15:28:35.067124 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 15:28:35.067124 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:28:35.067124 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:28:35.067124 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:28:35.067124 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:28:35.067124 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:28:35.067124 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 01 15:28:35.067124 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:28:35.067124 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:28:35.067124 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:28:35.067124 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:28:35.067124 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:28:35.067124 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:28:35.068362 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:28:35.068362 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:28:35.068362 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 15:28:35.068362 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 15:28:35.068362 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 15:28:35.068362 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 15:28:35.068362 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 15:28:35.068362 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 15:28:35.068362 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 01 15:28:35.068362 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 01 15:28:35.068362 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 597/1212] 10.222.0.102 () {56 vars in 1113 bytes} [Mon Aug 1 15:28:34 2022] GET /identity/v3/users/placement => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:28:35.073116 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0681d5c-2fbb-4f70-846d-873c6cdc71cf None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:28:35.182062 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0681d5c-2fbb-4f70-846d-873c6cdc71cf None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:28:35.217454 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285b01bf-90b9-48a4-b062-c39008ee0836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:28:35.218061 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285b01bf-90b9-48a4-b062-c39008ee0836 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:28:35.218337 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285b01bf-90b9-48a4-b062-c39008ee0836 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:28:35.218609 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285b01bf-90b9-48a4-b062-c39008ee0836 None admin] PATH_INFO: `/v3/users` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:28:35.219390 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285b01bf-90b9-48a4-b062-c39008ee0836 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:28:35.219693 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285b01bf-90b9-48a4-b062-c39008ee0836 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:28:35.221155 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285b01bf-90b9-48a4-b062-c39008ee0836 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:28:35.237533 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 616/1213] 10.222.0.102 () {56 vars in 1148 bytes} [Mon Aug 1 15:28:35 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 380 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:28:35.243356 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48468d0b-ece8-48dd-9d96-2062ad6de1dd None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:28:35.342731 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48468d0b-ece8-48dd-9d96-2062ad6de1dd None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:28:35.375594 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b26788b-c804-4a9c-b052-e40a7ba9013c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:28:35.376283 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b26788b-c804-4a9c-b052-e40a7ba9013c None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:28:35.395206 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b26788b-c804-4a9c-b052-e40a7ba9013c None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:28:35.395206 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b26788b-c804-4a9c-b052-e40a7ba9013c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:28:35.405539 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:28:35.441232 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b26788b-c804-4a9c-b052-e40a7ba9013c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:28:35.442654 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b26788b-c804-4a9c-b052-e40a7ba9013c None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:28:35.544300 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 598/1214] 10.222.0.102 () {58 vars in 1287 bytes} [Mon Aug 1 15:28:35 2022] GET /identity/v3/auth/tokens => generated 2113 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 01 15:28:35.550202 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285b01bf-90b9-48a4-b062-c39008ee0836 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:28:35.572044 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:28:35.659404 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285b01bf-90b9-48a4-b062-c39008ee0836 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:28:35.695515 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e869c375-c477-4e19-b27d-ba966e777a1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:28:35.696146 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e869c375-c477-4e19-b27d-ba966e777a1e None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:28:35.696424 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e869c375-c477-4e19-b27d-ba966e777a1e None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:28:35.696697 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e869c375-c477-4e19-b27d-ba966e777a1e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:28:35.707090 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e869c375-c477-4e19-b27d-ba966e777a1e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:28:35.708527 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e869c375-c477-4e19-b27d-ba966e777a1e None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:28:35.722942 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-e869c375-c477-4e19-b27d-ba966e777a1e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:28:35.722942 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:28:35.722942 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:28:35.722942 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:28:35.722942 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:28:35.722942 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:28:35.722942 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:28:35.722942 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:28:35.722942 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:28:35.722942 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:28:35.722942 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:28:35.722942 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:28:35.722942 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:28:35.722942 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:28:35.722942 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:28:35.723972 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:28:35.723972 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:28:35.723972 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:28:35.723972 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:28:35.723972 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:28:35.723972 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:28:35.723972 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:28:35.723972 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:28:35.723972 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 01 15:28:35.723972 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:28:35.723972 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:28:35.723972 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:28:35.723972 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:28:35.723972 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:28:35.723972 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:28:35.723972 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:28:35.723972 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:28:35.725120 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:28:35.725120 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:28:35.725120 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:28:35.725120 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 01 15:28:35.725120 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 617/1215] 10.222.0.102 () {56 vars in 1113 bytes} [Mon Aug 1 15:28:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:28:35.730105 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b26788b-c804-4a9c-b052-e40a7ba9013c None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:28:35.790434 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:28:35.828420 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b26788b-c804-4a9c-b052-e40a7ba9013c None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:28:35.861384 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5633939-674f-46dd-91f6-a45ff53388c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:28:35.861990 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5633939-674f-46dd-91f6-a45ff53388c8 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:28:35.862268 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5633939-674f-46dd-91f6-a45ff53388c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:28:35.862537 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5633939-674f-46dd-91f6-a45ff53388c8 None admin] PATH_INFO: `/v3/domains` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:28:35.863218 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5633939-674f-46dd-91f6-a45ff53388c8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:28:35.863518 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5633939-674f-46dd-91f6-a45ff53388c8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:28:35.864892 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5633939-674f-46dd-91f6-a45ff53388c8 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:28:35.875789 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 599/1216] 10.222.0.102 () {56 vars in 1114 bytes} [Mon Aug 1 15:28:35 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:28:35.881495 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e869c375-c477-4e19-b27d-ba966e777a1e None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:28:35.952068 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:28:35.982889 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e869c375-c477-4e19-b27d-ba966e777a1e None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:28:36.016958 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca44e32-54d8-4ee4-bc8e-2b80bc552e67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:28:36.017596 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca44e32-54d8-4ee4-bc8e-2b80bc552e67 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:28:36.017876 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca44e32-54d8-4ee4-bc8e-2b80bc552e67 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:28:36.018145 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca44e32-54d8-4ee4-bc8e-2b80bc552e67 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:28:36.024913 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca44e32-54d8-4ee4-bc8e-2b80bc552e67 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:28:36.026355 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca44e32-54d8-4ee4-bc8e-2b80bc552e67 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:28:36.038072 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-3ca44e32-54d8-4ee4-bc8e-2b80bc552e67 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 15:28:36.038072 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:28:36.038072 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:28:36.038072 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:28:36.038072 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:28:36.038072 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:28:36.038072 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:28:36.038072 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:28:36.038072 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:28:36.038072 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:28:36.038072 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:28:36.038072 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:28:36.038072 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 15:28:36.038072 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 15:28:36.038072 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 15:28:36.039187 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 15:28:36.039187 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:28:36.039187 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:28:36.039187 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:28:36.039187 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:28:36.039187 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:28:36.039187 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:28:36.039187 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:28:36.039187 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 01 15:28:36.039187 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:28:36.039187 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:28:36.039187 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:28:36.039187 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:28:36.039187 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:28:36.039187 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:28:36.039187 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:28:36.039187 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:28:36.040267 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 15:28:36.040267 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 15:28:36.040267 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 15:28:36.040267 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 15:28:36.040267 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 15:28:36.040267 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 15:28:36.040267 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 15:28:36.040267 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 01 15:28:36.040267 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 618/1217] 10.222.0.102 () {56 vars in 1116 bytes} [Mon Aug 1 15:28:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:28:36.045737 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5633939-674f-46dd-91f6-a45ff53388c8 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:28:36.149530 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5633939-674f-46dd-91f6-a45ff53388c8 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:28:36.171544 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:28:36.182956 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7aa4a6a-4d30-4b54-a286-de3006ac196c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:28:36.183571 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aa4a6a-4d30-4b54-a286-de3006ac196c None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:28:36.184512 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aa4a6a-4d30-4b54-a286-de3006ac196c None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:28:36.184811 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aa4a6a-4d30-4b54-a286-de3006ac196c None admin] PATH_INFO: `/v3/projects` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:28:36.185989 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7aa4a6a-4d30-4b54-a286-de3006ac196c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:28:36.186301 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7aa4a6a-4d30-4b54-a286-de3006ac196c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:28:36.187789 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7aa4a6a-4d30-4b54-a286-de3006ac196c None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:28:36.200475 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 600/1218] 10.222.0.102 () {56 vars in 1153 bytes} [Mon Aug 1 15:28:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:28:36.206997 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca44e32-54d8-4ee4-bc8e-2b80bc552e67 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:28:36.308325 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca44e32-54d8-4ee4-bc8e-2b80bc552e67 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:28:36.337007 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:28:36.342786 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d651f5c1-52f5-4fbe-82a1-60fa2bd485a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:28:36.343394 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d651f5c1-52f5-4fbe-82a1-60fa2bd485a8 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:28:36.343673 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d651f5c1-52f5-4fbe-82a1-60fa2bd485a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:28:36.343946 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d651f5c1-52f5-4fbe-82a1-60fa2bd485a8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:28:36.344829 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d651f5c1-52f5-4fbe-82a1-60fa2bd485a8 None admin] RBAC: Adding query filter params (role.id=3087c03acf8d44d9ae512385924c5d0d, scope.project.id=2eb32fbe631843d8be84d41f8ba88d6e, user.id=b78f5749fe9c46a389c88bb9c222cc73) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:28:36.345174 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d651f5c1-52f5-4fbe-82a1-60fa2bd485a8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:28:36.346600 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d651f5c1-52f5-4fbe-82a1-60fa2bd485a8 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:28:36.351910 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 619/1219] 10.222.0.102 () {56 vars in 1379 bytes} [Mon Aug 1 15:28:36 2022] GET /identity/v3/role_assignments?user.id=b78f5749fe9c46a389c88bb9c222cc73&scope.project.id=2eb32fbe631843d8be84d41f8ba88d6e&role.id=3087c03acf8d44d9ae512385924c5d0d => generated 260 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:28:38.360341 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f44818b-cec7-4583-947e-d756a4cf62ee None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:28:38.360934 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f44818b-cec7-4583-947e-d756a4cf62ee None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:28:38.360934 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f44818b-cec7-4583-947e-d756a4cf62ee None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:28:38.362325 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 601/1220] 10.222.0.102 () {54 vars in 931 bytes} [Mon Aug 1 15:28:38 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 15:28:38.367381 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686052f7-5145-47d4-911f-8f36c05576bc None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:28:38.367751 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686052f7-5145-47d4-911f-8f36c05576bc None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:28:38.367928 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686052f7-5145-47d4-911f-8f36c05576bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:28:38.386402 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-686052f7-5145-47d4-911f-8f36c05576bc None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:28:38.388213 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-686052f7-5145-47d4-911f-8f36c05576bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:28:38.456678 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 620/1221] 10.222.0.102 () {58 vars in 1028 bytes} [Mon Aug 1 15:28:38 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 15:28:38.479130 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f44818b-cec7-4583-947e-d756a4cf62ee None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:28:38.581500 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f44818b-cec7-4583-947e-d756a4cf62ee None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:28:38.614537 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46439d59-2cff-46e9-becd-ebf2f94f48b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:28:38.615142 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46439d59-2cff-46e9-becd-ebf2f94f48b3 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:28:38.615414 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46439d59-2cff-46e9-becd-ebf2f94f48b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:28:38.615707 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46439d59-2cff-46e9-becd-ebf2f94f48b3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:28:38.626338 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46439d59-2cff-46e9-becd-ebf2f94f48b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:28:38.631151 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-46439d59-2cff-46e9-becd-ebf2f94f48b3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 01 15:28:38.631151 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:28:38.631151 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:28:38.631151 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:28:38.631151 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:28:38.631151 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:28:38.631151 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:28:38.631151 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:28:38.631151 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:28:38.631151 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:28:38.631151 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:28:38.631151 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:28:38.631151 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:28:38.631151 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:28:38.631151 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:28:38.631151 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:28:38.632286 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:28:38.632286 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:28:38.632286 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:28:38.632286 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:28:38.632286 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:28:38.632286 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:28:38.632286 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:28:38.632286 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:28:38.632286 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:28:38.632286 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:28:38.632286 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:28:38.632286 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 01 15:28:38.632286 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:28:38.632286 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:28:38.632286 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:28:38.632286 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:28:38.633650 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:28:38.633650 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:28:38.633650 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:28:38.633650 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:28:38.633650 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:28:38.633650 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:28:38.633650 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:28:38.633650 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:28:38.633650 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:28:38.633650 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:28:38.633650 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 01 15:28:38.633650 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 01 15:28:38.633650 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 602/1222] 10.222.0.102 () {56 vars in 1107 bytes} [Mon Aug 1 15:28:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:28:38.638513 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686052f7-5145-47d4-911f-8f36c05576bc None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:28:38.738079 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686052f7-5145-47d4-911f-8f36c05576bc None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:28:38.761480 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:28:38.771836 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c0d481-0809-4478-b13a-903c1b180956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:28:38.772298 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c0d481-0809-4478-b13a-903c1b180956 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:28:38.772579 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c0d481-0809-4478-b13a-903c1b180956 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:28:38.772869 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c0d481-0809-4478-b13a-903c1b180956 None admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:28:38.773588 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c0d481-0809-4478-b13a-903c1b180956 None admin] RBAC: Adding query filter params (name=service) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:28:38.773908 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c0d481-0809-4478-b13a-903c1b180956 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:28:38.775313 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c0d481-0809-4478-b13a-903c1b180956 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:28:38.783289 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 621/1223] 10.222.0.102 () {56 vars in 1108 bytes} [Mon Aug 1 15:28:38 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:28:38.789249 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46439d59-2cff-46e9-becd-ebf2f94f48b3 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:28:38.833814 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:28:38.892302 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46439d59-2cff-46e9-becd-ebf2f94f48b3 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:28:38.927479 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2635686b-8502-4b7b-a3d2-d681abfea29e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:28:38.928114 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2635686b-8502-4b7b-a3d2-d681abfea29e None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:28:38.928395 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2635686b-8502-4b7b-a3d2-d681abfea29e None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:28:38.928671 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2635686b-8502-4b7b-a3d2-d681abfea29e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:28:38.938601 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2635686b-8502-4b7b-a3d2-d681abfea29e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:28:38.940126 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2635686b-8502-4b7b-a3d2-d681abfea29e None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:28:38.954986 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-2635686b-8502-4b7b-a3d2-d681abfea29e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:28:38.954986 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:28:38.954986 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:28:38.954986 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:28:38.954986 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:28:38.954986 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:28:38.954986 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:28:38.954986 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:28:38.954986 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:28:38.954986 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:28:38.954986 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:28:38.954986 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:28:38.954986 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:28:38.954986 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:28:38.954986 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:28:38.956117 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:28:38.956117 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:28:38.956117 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:28:38.956117 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:28:38.956117 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:28:38.956117 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:28:38.956117 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:28:38.956117 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:28:38.956117 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 01 15:28:38.956117 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:28:38.956117 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:28:38.956117 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:28:38.956117 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:28:38.956117 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:28:38.956117 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:28:38.956117 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:28:38.956117 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:28:38.957201 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:28:38.957201 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:28:38.957201 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:28:38.957201 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 01 15:28:38.957201 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 603/1224] 10.222.0.102 () {56 vars in 1113 bytes} [Mon Aug 1 15:28:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:28:38.962263 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c0d481-0809-4478-b13a-903c1b180956 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:28:39.075275 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c0d481-0809-4478-b13a-903c1b180956 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:28:39.109760 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfdec8a-9dc9-4843-8d1d-17130c55aa0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:28:39.110361 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfdec8a-9dc9-4843-8d1d-17130c55aa0b None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:28:39.110635 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfdec8a-9dc9-4843-8d1d-17130c55aa0b None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:28:39.110903 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfdec8a-9dc9-4843-8d1d-17130c55aa0b None admin] PATH_INFO: `/v3/domains` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:28:39.111575 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfdec8a-9dc9-4843-8d1d-17130c55aa0b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:28:39.111907 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfdec8a-9dc9-4843-8d1d-17130c55aa0b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:28:39.113335 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfdec8a-9dc9-4843-8d1d-17130c55aa0b None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:28:39.128492 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 622/1225] 10.222.0.102 () {56 vars in 1114 bytes} [Mon Aug 1 15:28:38 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:28:39.134483 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2635686b-8502-4b7b-a3d2-d681abfea29e None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:28:39.233734 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:28:39.242897 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2635686b-8502-4b7b-a3d2-d681abfea29e None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:28:39.279341 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c55c6f-68e4-4508-b626-0ed869ccfe81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:28:39.280024 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c55c6f-68e4-4508-b626-0ed869ccfe81 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:28:39.280451 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c55c6f-68e4-4508-b626-0ed869ccfe81 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:28:39.280732 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c55c6f-68e4-4508-b626-0ed869ccfe81 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:28:39.288533 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c55c6f-68e4-4508-b626-0ed869ccfe81 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:28:39.290494 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c55c6f-68e4-4508-b626-0ed869ccfe81 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:28:39.309239 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-a7c55c6f-68e4-4508-b626-0ed869ccfe81 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 01 15:28:39.309239 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:28:39.309239 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:28:39.309239 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:28:39.309239 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:28:39.309239 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:28:39.309239 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:28:39.309239 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:28:39.309239 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:28:39.309239 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:28:39.309239 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:28:39.309239 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:28:39.309239 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 15:28:39.309239 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 15:28:39.309239 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 15:28:39.309239 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 15:28:39.310429 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:28:39.310429 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:28:39.310429 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 15:28:39.310429 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 15:28:39.310429 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 15:28:39.310429 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 15:28:39.310429 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:28:39.310429 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:28:39.310429 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:28:39.310429 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:28:39.310429 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:28:39.310429 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 01 15:28:39.310429 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:28:39.310429 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:28:39.310429 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:28:39.310429 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:28:39.310429 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:28:39.310429 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:28:39.311648 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:28:39.311648 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:28:39.311648 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 15:28:39.311648 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 15:28:39.311648 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 15:28:39.311648 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 15:28:39.311648 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 15:28:39.311648 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 15:28:39.311648 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 01 15:28:39.311648 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 01 15:28:39.311648 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 604/1226] 10.222.0.102 () {56 vars in 1113 bytes} [Mon Aug 1 15:28:39 2022] GET /identity/v3/users/placement => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:28:39.316458 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfdec8a-9dc9-4843-8d1d-17130c55aa0b None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:28:39.364788 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:28:39.420397 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfdec8a-9dc9-4843-8d1d-17130c55aa0b None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:28:39.455705 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c638acf-9647-487a-ae39-b2c6e8ac93c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:28:39.456314 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c638acf-9647-487a-ae39-b2c6e8ac93c0 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:28:39.456591 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c638acf-9647-487a-ae39-b2c6e8ac93c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:28:39.456887 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c638acf-9647-487a-ae39-b2c6e8ac93c0 None admin] PATH_INFO: `/v3/users` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:28:39.457674 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c638acf-9647-487a-ae39-b2c6e8ac93c0 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:28:39.457976 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c638acf-9647-487a-ae39-b2c6e8ac93c0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:28:39.459426 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c638acf-9647-487a-ae39-b2c6e8ac93c0 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:28:39.477678 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 623/1227] 10.222.0.102 () {56 vars in 1148 bytes} [Mon Aug 1 15:28:39 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 380 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:28:39.484626 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c55c6f-68e4-4508-b626-0ed869ccfe81 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:28:39.589749 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c55c6f-68e4-4508-b626-0ed869ccfe81 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:28:39.624803 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b50986-febe-46c5-b6a6-b2858fadcb96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:28:39.625478 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b50986-febe-46c5-b6a6-b2858fadcb96 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:28:39.625761 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b50986-febe-46c5-b6a6-b2858fadcb96 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:28:39.626086 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b50986-febe-46c5-b6a6-b2858fadcb96 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:28:39.636385 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b50986-febe-46c5-b6a6-b2858fadcb96 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:28:39.644783 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b50986-febe-46c5-b6a6-b2858fadcb96 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:28:39.653008 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-07b50986-febe-46c5-b6a6-b2858fadcb96 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:28:39.653008 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:28:39.653008 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:28:39.653008 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:28:39.653008 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:28:39.653008 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:28:39.653008 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:28:39.653008 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:28:39.653008 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:28:39.653008 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:28:39.653008 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:28:39.653008 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:28:39.653008 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:28:39.653008 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:28:39.653008 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:28:39.654069 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:28:39.654069 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:28:39.654069 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:28:39.654069 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:28:39.654069 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:28:39.654069 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:28:39.654069 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:28:39.654069 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:28:39.654069 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 01 15:28:39.654069 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:28:39.654069 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:28:39.654069 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:28:39.654069 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:28:39.654069 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:28:39.654069 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:28:39.654069 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:28:39.654069 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:28:39.655059 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:28:39.655059 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:28:39.655059 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:28:39.655059 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 01 15:28:39.655059 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 605/1228] 10.222.0.102 () {56 vars in 1113 bytes} [Mon Aug 1 15:28:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:28:39.659865 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c638acf-9647-487a-ae39-b2c6e8ac93c0 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:28:39.758190 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c638acf-9647-487a-ae39-b2c6e8ac93c0 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:28:39.760412 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:28:39.794526 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720e8747-d7c7-4499-8b56-2cc3e6ef19fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:28:39.795137 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720e8747-d7c7-4499-8b56-2cc3e6ef19fa None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:28:39.795411 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720e8747-d7c7-4499-8b56-2cc3e6ef19fa None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:28:39.795682 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720e8747-d7c7-4499-8b56-2cc3e6ef19fa None admin] PATH_INFO: `/v3/domains` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:28:39.796359 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720e8747-d7c7-4499-8b56-2cc3e6ef19fa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:28:39.796661 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720e8747-d7c7-4499-8b56-2cc3e6ef19fa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:28:39.798133 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720e8747-d7c7-4499-8b56-2cc3e6ef19fa None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:28:39.815909 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 624/1229] 10.222.0.102 () {56 vars in 1114 bytes} [Mon Aug 1 15:28:39 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:28:39.816065 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b50986-febe-46c5-b6a6-b2858fadcb96 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:28:39.826820 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:28:39.920976 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b50986-febe-46c5-b6a6-b2858fadcb96 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:28:39.954301 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf592454-586c-4519-9a4c-e03bbc504bcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:28:39.954935 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf592454-586c-4519-9a4c-e03bbc504bcc None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:28:39.955216 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf592454-586c-4519-9a4c-e03bbc504bcc None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:28:39.955490 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf592454-586c-4519-9a4c-e03bbc504bcc None admin] PATH_INFO: `/v3/projects/service` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:28:39.961911 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf592454-586c-4519-9a4c-e03bbc504bcc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:28:39.963343 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf592454-586c-4519-9a4c-e03bbc504bcc None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:28:39.974541 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-cf592454-586c-4519-9a4c-e03bbc504bcc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 15:28:39.974541 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:28:39.974541 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:28:39.974541 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:28:39.974541 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:28:39.974541 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:28:39.974541 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:28:39.974541 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:28:39.974541 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:28:39.974541 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:28:39.974541 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:28:39.974541 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:28:39.974541 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 15:28:39.974541 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 15:28:39.974541 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 15:28:39.983087 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 15:28:39.983087 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:28:39.983087 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:28:39.983087 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:28:39.983087 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:28:39.983087 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:28:39.983087 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:28:39.983087 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:28:39.983087 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 01 15:28:39.983087 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:28:39.983087 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:28:39.983087 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:28:39.983087 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:28:39.983087 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:28:39.983087 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:28:39.983087 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:28:39.983087 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:28:39.984065 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 15:28:39.984065 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 15:28:39.984065 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 15:28:39.984065 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 15:28:39.984065 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 15:28:39.984065 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 15:28:39.984065 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 15:28:39.984065 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 01 15:28:39.984065 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 606/1230] 10.222.0.102 () {56 vars in 1116 bytes} [Mon Aug 1 15:28:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:28:39.984573 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720e8747-d7c7-4499-8b56-2cc3e6ef19fa None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:28:40.081231 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720e8747-d7c7-4499-8b56-2cc3e6ef19fa None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:28:40.116017 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4bebd9-7904-48c3-9983-40a9dcb5a586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:28:40.116626 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4bebd9-7904-48c3-9983-40a9dcb5a586 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:28:40.116934 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4bebd9-7904-48c3-9983-40a9dcb5a586 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:28:40.117211 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4bebd9-7904-48c3-9983-40a9dcb5a586 None admin] PATH_INFO: `/v3/projects` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:28:40.117953 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4bebd9-7904-48c3-9983-40a9dcb5a586 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:28:40.118260 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4bebd9-7904-48c3-9983-40a9dcb5a586 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:28:40.119689 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4bebd9-7904-48c3-9983-40a9dcb5a586 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:28:40.155997 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 625/1231] 10.222.0.102 () {56 vars in 1153 bytes} [Mon Aug 1 15:28:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:28:40.162507 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf592454-586c-4519-9a4c-e03bbc504bcc None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:28:40.232038 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:28:40.267922 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf592454-586c-4519-9a4c-e03bbc504bcc None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:28:40.307480 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd58ff57-4481-4ce5-b4b9-d132064a0d4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:28:40.308141 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd58ff57-4481-4ce5-b4b9-d132064a0d4c None admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:28:40.308419 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd58ff57-4481-4ce5-b4b9-d132064a0d4c None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:28:40.308705 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd58ff57-4481-4ce5-b4b9-d132064a0d4c None admin] PATH_INFO: `/v3/projects/2eb32fbe631843d8be84d41f8ba88d6e/users/b78f5749fe9c46a389c88bb9c222cc73/roles/3087c03acf8d44d9ae512385924c5d0d` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:28:40.323100 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd58ff57-4481-4ce5-b4b9-d132064a0d4c None admin] RBAC: Authorizing `identity:create_grant(project_id=2eb32fbe631843d8be84d41f8ba88d6e, user_id=b78f5749fe9c46a389c88bb9c222cc73, role_id=3087c03acf8d44d9ae512385924c5d0d)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:28:40.329935 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd58ff57-4481-4ce5-b4b9-d132064a0d4c None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:28:40.422296 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 607/1232] 10.222.0.102 () {58 vars in 1444 bytes} [Mon Aug 1 15:28:40 2022] PUT /identity/v3/projects/2eb32fbe631843d8be84d41f8ba88d6e/users/b78f5749fe9c46a389c88bb9c222cc73/roles/3087c03acf8d44d9ae512385924c5d0d => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:28:42.436865 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77df3ae-1284-4586-a263-92443cf3b25f None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:28:42.437442 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77df3ae-1284-4586-a263-92443cf3b25f None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:28:42.437442 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77df3ae-1284-4586-a263-92443cf3b25f None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:28:42.438967 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 626/1233] 10.222.0.102 () {54 vars in 931 bytes} [Mon Aug 1 15:28:42 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 15:28:42.444104 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1865b114-795f-47c7-8031-a5a3e7c183fe None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:28:42.444497 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1865b114-795f-47c7-8031-a5a3e7c183fe None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:28:42.444793 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1865b114-795f-47c7-8031-a5a3e7c183fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:28:42.463052 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-1865b114-795f-47c7-8031-a5a3e7c183fe None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:28:42.464239 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-1865b114-795f-47c7-8031-a5a3e7c183fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:28:42.529872 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 608/1234] 10.222.0.102 () {58 vars in 1028 bytes} [Mon Aug 1 15:28:42 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 15:28:42.553640 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77df3ae-1284-4586-a263-92443cf3b25f None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:28:42.581334 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:28:42.656568 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77df3ae-1284-4586-a263-92443cf3b25f None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:28:42.691260 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0576e57a-1fbb-4da6-9e7a-d4c15a99607f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:28:42.691818 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0576e57a-1fbb-4da6-9e7a-d4c15a99607f None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:28:42.692089 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0576e57a-1fbb-4da6-9e7a-d4c15a99607f None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:28:42.692355 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0576e57a-1fbb-4da6-9e7a-d4c15a99607f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:28:42.702813 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0576e57a-1fbb-4da6-9e7a-d4c15a99607f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:28:42.707653 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-0576e57a-1fbb-4da6-9e7a-d4c15a99607f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 01 15:28:42.707653 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:28:42.707653 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:28:42.707653 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:28:42.707653 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:28:42.707653 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:28:42.707653 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:28:42.707653 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:28:42.707653 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:28:42.707653 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:28:42.707653 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:28:42.707653 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:28:42.707653 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:28:42.707653 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:28:42.707653 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:28:42.707653 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:28:42.708758 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:28:42.708758 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:28:42.708758 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:28:42.708758 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:28:42.708758 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:28:42.708758 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:28:42.708758 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:28:42.708758 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:28:42.708758 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:28:42.708758 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:28:42.708758 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:28:42.708758 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 01 15:28:42.708758 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:28:42.708758 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:28:42.708758 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:28:42.708758 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:28:42.709854 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:28:42.709854 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:28:42.709854 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:28:42.709854 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:28:42.709854 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:28:42.709854 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:28:42.709854 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:28:42.709854 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:28:42.709854 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:28:42.709854 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:28:42.709854 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 01 15:28:42.709854 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 01 15:28:42.709854 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 627/1235] 10.222.0.102 () {56 vars in 1107 bytes} [Mon Aug 1 15:28:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:28:42.715506 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1865b114-795f-47c7-8031-a5a3e7c183fe None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:28:42.761946 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:28:42.814360 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1865b114-795f-47c7-8031-a5a3e7c183fe None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:28:42.848151 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6229c0e9-3828-4dfe-b00d-3489aca0feb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:28:42.859540 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6229c0e9-3828-4dfe-b00d-3489aca0feb8 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:28:42.859540 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6229c0e9-3828-4dfe-b00d-3489aca0feb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:28:42.859540 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6229c0e9-3828-4dfe-b00d-3489aca0feb8 None admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:28:42.859540 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6229c0e9-3828-4dfe-b00d-3489aca0feb8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:28:42.859540 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6229c0e9-3828-4dfe-b00d-3489aca0feb8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:28:42.859540 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6229c0e9-3828-4dfe-b00d-3489aca0feb8 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:28:42.860114 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 609/1236] 10.222.0.102 () {56 vars in 1108 bytes} [Mon Aug 1 15:28:42 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:28:42.865378 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0576e57a-1fbb-4da6-9e7a-d4c15a99607f None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:28:42.957912 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:28:42.979385 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0576e57a-1fbb-4da6-9e7a-d4c15a99607f None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:28:43.016903 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e86dc1-ea5d-46f6-943e-b9afbd241967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:28:43.017538 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e86dc1-ea5d-46f6-943e-b9afbd241967 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:28:43.017814 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e86dc1-ea5d-46f6-943e-b9afbd241967 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:28:43.018117 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e86dc1-ea5d-46f6-943e-b9afbd241967 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:28:43.028591 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e86dc1-ea5d-46f6-943e-b9afbd241967 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:28:43.030069 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e86dc1-ea5d-46f6-943e-b9afbd241967 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:28:43.045694 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-a1e86dc1-ea5d-46f6-943e-b9afbd241967 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:28:43.045694 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:28:43.045694 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:28:43.045694 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:28:43.045694 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:28:43.045694 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:28:43.045694 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:28:43.045694 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:28:43.045694 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:28:43.045694 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:28:43.045694 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:28:43.045694 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:28:43.045694 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:28:43.045694 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:28:43.045694 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:28:43.046836 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:28:43.046836 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:28:43.046836 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:28:43.046836 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:28:43.046836 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:28:43.046836 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:28:43.046836 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:28:43.046836 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:28:43.046836 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 01 15:28:43.046836 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:28:43.046836 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:28:43.046836 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:28:43.046836 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:28:43.046836 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:28:43.046836 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:28:43.046836 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:28:43.046836 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:28:43.047902 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:28:43.047902 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:28:43.047902 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:28:43.047902 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 01 15:28:43.047902 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 628/1237] 10.222.0.102 () {56 vars in 1113 bytes} [Mon Aug 1 15:28:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:28:43.052923 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6229c0e9-3828-4dfe-b00d-3489aca0feb8 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:28:43.153924 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6229c0e9-3828-4dfe-b00d-3489aca0feb8 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:28:43.162521 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:28:43.187392 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac180b32-bfd0-41f8-8049-9113b6176bd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:28:43.188002 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac180b32-bfd0-41f8-8049-9113b6176bd4 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:28:43.188280 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac180b32-bfd0-41f8-8049-9113b6176bd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:28:43.188552 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac180b32-bfd0-41f8-8049-9113b6176bd4 None admin] PATH_INFO: `/v3/domains` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:28:43.189266 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac180b32-bfd0-41f8-8049-9113b6176bd4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:28:43.189567 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac180b32-bfd0-41f8-8049-9113b6176bd4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:28:43.190925 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac180b32-bfd0-41f8-8049-9113b6176bd4 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:28:43.202477 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 610/1238] 10.222.0.102 () {56 vars in 1114 bytes} [Mon Aug 1 15:28:43 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:28:43.216349 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e86dc1-ea5d-46f6-943e-b9afbd241967 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:28:43.315084 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e86dc1-ea5d-46f6-943e-b9afbd241967 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:28:43.351275 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5d1c22-852e-4e1d-83a4-97a37f9ac10d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:28:43.351995 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5d1c22-852e-4e1d-83a4-97a37f9ac10d None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:28:43.352292 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5d1c22-852e-4e1d-83a4-97a37f9ac10d None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:28:43.363482 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5d1c22-852e-4e1d-83a4-97a37f9ac10d None admin] PATH_INFO: `/v3/users/placement` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:28:43.363482 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:28:43.363482 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5d1c22-852e-4e1d-83a4-97a37f9ac10d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:28:43.363482 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5d1c22-852e-4e1d-83a4-97a37f9ac10d None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:28:43.373262 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-df5d1c22-852e-4e1d-83a4-97a37f9ac10d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 01 15:28:43.373262 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:28:43.373262 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:28:43.373262 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:28:43.373262 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:28:43.373262 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:28:43.373262 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:28:43.373262 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:28:43.373262 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:28:43.373262 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:28:43.373262 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:28:43.373262 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:28:43.373262 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 15:28:43.373262 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 15:28:43.373262 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 15:28:43.373262 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 15:28:43.374406 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:28:43.374406 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:28:43.374406 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 15:28:43.374406 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 15:28:43.374406 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 15:28:43.374406 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 15:28:43.374406 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:28:43.374406 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:28:43.374406 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:28:43.374406 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:28:43.374406 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:28:43.374406 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 01 15:28:43.374406 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:28:43.374406 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:28:43.374406 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:28:43.374406 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:28:43.374406 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:28:43.374406 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:28:43.375507 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:28:43.375507 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:28:43.375507 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 15:28:43.375507 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 15:28:43.375507 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 15:28:43.375507 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 15:28:43.375507 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 15:28:43.375507 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 15:28:43.375507 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 01 15:28:43.375507 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 01 15:28:43.375507 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 629/1239] 10.222.0.102 () {56 vars in 1113 bytes} [Mon Aug 1 15:28:43 2022] GET /identity/v3/users/placement => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:28:43.380430 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac180b32-bfd0-41f8-8049-9113b6176bd4 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:28:43.479331 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac180b32-bfd0-41f8-8049-9113b6176bd4 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:28:43.513273 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca21931-4c02-46af-8c11-9e5366da793e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:28:43.513883 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca21931-4c02-46af-8c11-9e5366da793e None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:28:43.514181 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca21931-4c02-46af-8c11-9e5366da793e None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:28:43.514450 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca21931-4c02-46af-8c11-9e5366da793e None admin] PATH_INFO: `/v3/users` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:28:43.515235 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca21931-4c02-46af-8c11-9e5366da793e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:28:43.515536 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca21931-4c02-46af-8c11-9e5366da793e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:28:43.516982 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca21931-4c02-46af-8c11-9e5366da793e None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:28:43.534382 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 611/1240] 10.222.0.102 () {56 vars in 1148 bytes} [Mon Aug 1 15:28:43 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 380 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:28:43.540261 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5d1c22-852e-4e1d-83a4-97a37f9ac10d None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:28:43.646341 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5d1c22-852e-4e1d-83a4-97a37f9ac10d None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:28:43.681049 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2935db6-b84d-420c-8915-277ee1b798e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:28:43.681656 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2935db6-b84d-420c-8915-277ee1b798e8 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:28:43.681933 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2935db6-b84d-420c-8915-277ee1b798e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:28:43.682203 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2935db6-b84d-420c-8915-277ee1b798e8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:28:43.742871 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:28:43.749216 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2935db6-b84d-420c-8915-277ee1b798e8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:28:43.750670 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2935db6-b84d-420c-8915-277ee1b798e8 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:28:43.847457 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 630/1241] 10.222.0.102 () {58 vars in 1287 bytes} [Mon Aug 1 15:28:43 2022] GET /identity/v3/auth/tokens => generated 2113 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 01 15:28:43.853487 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca21931-4c02-46af-8c11-9e5366da793e None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:28:43.880440 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:28:43.958354 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca21931-4c02-46af-8c11-9e5366da793e None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:28:43.992728 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03db10c2-6b29-4106-bfe3-a5c2ee6c998f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:28:43.993469 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03db10c2-6b29-4106-bfe3-a5c2ee6c998f None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:28:43.993702 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03db10c2-6b29-4106-bfe3-a5c2ee6c998f None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:28:43.993986 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03db10c2-6b29-4106-bfe3-a5c2ee6c998f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:28:44.004535 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03db10c2-6b29-4106-bfe3-a5c2ee6c998f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:28:44.006019 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03db10c2-6b29-4106-bfe3-a5c2ee6c998f None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:28:44.020178 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-03db10c2-6b29-4106-bfe3-a5c2ee6c998f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:28:44.020178 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:28:44.020178 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:28:44.020178 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:28:44.020178 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:28:44.020178 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:28:44.020178 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:28:44.020178 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:28:44.020178 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:28:44.020178 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:28:44.020178 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:28:44.020178 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:28:44.020178 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:28:44.020178 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:28:44.020178 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:28:44.033056 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:28:44.033056 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:28:44.033056 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:28:44.033056 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:28:44.033056 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:28:44.033056 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:28:44.033056 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:28:44.033056 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:28:44.033056 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 01 15:28:44.033056 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:28:44.033056 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:28:44.033056 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:28:44.033056 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:28:44.033056 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:28:44.033056 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:28:44.033056 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:28:44.033056 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:28:44.034188 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:28:44.034188 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:28:44.034188 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:28:44.034188 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 01 15:28:44.034188 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 612/1242] 10.222.0.102 () {56 vars in 1113 bytes} [Mon Aug 1 15:28:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:28:44.034521 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2935db6-b84d-420c-8915-277ee1b798e8 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:28:44.119793 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:28:44.125998 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2935db6-b84d-420c-8915-277ee1b798e8 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:28:44.160413 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77175ef-982f-47c5-988f-cd935188d34b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:28:44.161042 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77175ef-982f-47c5-988f-cd935188d34b None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:28:44.161324 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77175ef-982f-47c5-988f-cd935188d34b None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:28:44.161595 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77175ef-982f-47c5-988f-cd935188d34b None admin] PATH_INFO: `/v3/domains` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:28:44.162273 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77175ef-982f-47c5-988f-cd935188d34b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:28:44.162573 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77175ef-982f-47c5-988f-cd935188d34b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:28:44.163934 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77175ef-982f-47c5-988f-cd935188d34b None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:28:44.174883 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 631/1243] 10.222.0.102 () {56 vars in 1114 bytes} [Mon Aug 1 15:28:44 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:28:44.180565 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03db10c2-6b29-4106-bfe3-a5c2ee6c998f None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:28:44.258116 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:28:44.279471 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03db10c2-6b29-4106-bfe3-a5c2ee6c998f None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:28:44.312074 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d0dea4-a717-4830-99c9-5e817e416f8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:28:44.312703 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d0dea4-a717-4830-99c9-5e817e416f8c None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:28:44.313029 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d0dea4-a717-4830-99c9-5e817e416f8c None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:28:44.313306 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d0dea4-a717-4830-99c9-5e817e416f8c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:28:44.319889 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d0dea4-a717-4830-99c9-5e817e416f8c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:28:44.321367 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d0dea4-a717-4830-99c9-5e817e416f8c None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:28:44.334775 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-26d0dea4-a717-4830-99c9-5e817e416f8c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 15:28:44.334775 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:28:44.334775 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:28:44.334775 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:28:44.334775 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:28:44.334775 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:28:44.334775 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:28:44.334775 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:28:44.334775 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:28:44.334775 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:28:44.334775 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:28:44.334775 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:28:44.334775 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 15:28:44.334775 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 15:28:44.334775 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 15:28:44.336095 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 15:28:44.336095 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:28:44.336095 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:28:44.336095 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:28:44.336095 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:28:44.336095 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:28:44.336095 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:28:44.336095 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:28:44.336095 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 01 15:28:44.336095 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:28:44.336095 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:28:44.336095 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:28:44.336095 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:28:44.336095 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:28:44.336095 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:28:44.336095 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:28:44.336095 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:28:44.337450 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 15:28:44.337450 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 15:28:44.337450 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 15:28:44.337450 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 15:28:44.337450 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 15:28:44.337450 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 15:28:44.337450 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 15:28:44.337450 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 01 15:28:44.337450 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 613/1244] 10.222.0.102 () {56 vars in 1116 bytes} [Mon Aug 1 15:28:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:28:44.342024 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77175ef-982f-47c5-988f-cd935188d34b None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:28:44.440652 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77175ef-982f-47c5-988f-cd935188d34b None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:28:44.474205 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a57ecb-edff-4374-a2d9-6f789823e0d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:28:44.474807 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a57ecb-edff-4374-a2d9-6f789823e0d4 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:28:44.475082 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a57ecb-edff-4374-a2d9-6f789823e0d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:28:44.475352 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a57ecb-edff-4374-a2d9-6f789823e0d4 None admin] PATH_INFO: `/v3/projects` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:28:44.476127 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a57ecb-edff-4374-a2d9-6f789823e0d4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:28:44.476430 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a57ecb-edff-4374-a2d9-6f789823e0d4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:28:44.477896 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a57ecb-edff-4374-a2d9-6f789823e0d4 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:28:44.490215 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 632/1245] 10.222.0.102 () {56 vars in 1153 bytes} [Mon Aug 1 15:28:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:28:44.497201 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d0dea4-a717-4830-99c9-5e817e416f8c None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:28:44.599601 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d0dea4-a717-4830-99c9-5e817e416f8c None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:28:44.633435 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa71264-0b98-4005-90fd-400a7b8b883e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:28:44.634044 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa71264-0b98-4005-90fd-400a7b8b883e None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:28:44.634321 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa71264-0b98-4005-90fd-400a7b8b883e None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:28:44.634591 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa71264-0b98-4005-90fd-400a7b8b883e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:28:44.635367 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa71264-0b98-4005-90fd-400a7b8b883e None admin] RBAC: Adding query filter params (role.id=3087c03acf8d44d9ae512385924c5d0d, scope.project.id=2eb32fbe631843d8be84d41f8ba88d6e, user.id=b78f5749fe9c46a389c88bb9c222cc73) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:28:44.635672 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa71264-0b98-4005-90fd-400a7b8b883e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:28:44.637168 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa71264-0b98-4005-90fd-400a7b8b883e None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:28:44.642936 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 614/1246] 10.222.0.102 () {56 vars in 1379 bytes} [Mon Aug 1 15:28:44 2022] GET /identity/v3/role_assignments?user.id=b78f5749fe9c46a389c88bb9c222cc73&scope.project.id=2eb32fbe631843d8be84d41f8ba88d6e&role.id=3087c03acf8d44d9ae512385924c5d0d => generated 610 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:28:46.741168 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db298f23-f894-44ec-91ba-5da3f3b4f988 None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:28:46.741747 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db298f23-f894-44ec-91ba-5da3f3b4f988 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:28:46.741747 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db298f23-f894-44ec-91ba-5da3f3b4f988 None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:28:46.743061 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 633/1247] 10.222.0.102 () {54 vars in 931 bytes} [Mon Aug 1 15:28:46 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 15:28:46.748177 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1e5c40-441c-4e30-ba1a-64514f2fec54 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:28:46.748603 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1e5c40-441c-4e30-ba1a-64514f2fec54 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:28:46.748723 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1e5c40-441c-4e30-ba1a-64514f2fec54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:28:46.755028 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:28:46.767318 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-bd1e5c40-441c-4e30-ba1a-64514f2fec54 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:28:46.768522 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-bd1e5c40-441c-4e30-ba1a-64514f2fec54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:28:46.832281 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 615/1248] 10.222.0.102 () {58 vars in 1028 bytes} [Mon Aug 1 15:28:46 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 15:28:46.856129 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db298f23-f894-44ec-91ba-5da3f3b4f988 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:28:46.875218 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:28:46.958940 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db298f23-f894-44ec-91ba-5da3f3b4f988 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:28:46.992325 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52603c31-d31f-420b-a69d-69f849e48003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:28:46.992900 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52603c31-d31f-420b-a69d-69f849e48003 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:28:46.993183 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52603c31-d31f-420b-a69d-69f849e48003 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:28:46.993455 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52603c31-d31f-420b-a69d-69f849e48003 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:28:47.003464 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52603c31-d31f-420b-a69d-69f849e48003 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:28:47.008319 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-52603c31-d31f-420b-a69d-69f849e48003 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 15:28:47.008319 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:28:47.008319 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:28:47.008319 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:28:47.008319 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:28:47.008319 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:28:47.008319 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:28:47.008319 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:28:47.008319 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:28:47.008319 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:28:47.008319 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:28:47.008319 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:28:47.008319 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:28:47.008319 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:28:47.008319 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:28:47.008319 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:28:47.014176 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:28:47.014176 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:28:47.014176 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:28:47.014176 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:28:47.014176 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:28:47.014176 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:28:47.014176 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:28:47.014176 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:28:47.014176 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:28:47.014176 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:28:47.014176 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:28:47.014176 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 01 15:28:47.014176 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:28:47.014176 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:28:47.014176 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:28:47.014176 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:28:47.015110 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:28:47.015110 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:28:47.015110 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:28:47.015110 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:28:47.015110 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:28:47.015110 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:28:47.015110 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:28:47.015110 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:28:47.015110 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:28:47.015110 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:28:47.015110 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 15:28:47.015110 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 01 15:28:47.015110 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 634/1249] 10.222.0.102 () {56 vars in 1101 bytes} [Mon Aug 1 15:28:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:28:47.016094 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1e5c40-441c-4e30-ba1a-64514f2fec54 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:28:47.113618 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1e5c40-441c-4e30-ba1a-64514f2fec54 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:28:47.142982 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:28:47.147796 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83cca1c-9ec2-413f-9459-75de0975c7c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:28:47.148413 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83cca1c-9ec2-413f-9459-75de0975c7c5 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:28:47.148691 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83cca1c-9ec2-413f-9459-75de0975c7c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:28:47.148988 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83cca1c-9ec2-413f-9459-75de0975c7c5 None admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:28:47.149696 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83cca1c-9ec2-413f-9459-75de0975c7c5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:28:47.149996 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83cca1c-9ec2-413f-9459-75de0975c7c5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:28:47.151433 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83cca1c-9ec2-413f-9459-75de0975c7c5 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:28:47.159391 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 616/1250] 10.222.0.102 () {56 vars in 1104 bytes} [Mon Aug 1 15:28:47 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:28:47.165167 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52603c31-d31f-420b-a69d-69f849e48003 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:28:47.249812 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:28:47.272118 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52603c31-d31f-420b-a69d-69f849e48003 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:28:47.304437 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce1effd-8e59-4eed-a326-41f4c340e458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:28:47.305094 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce1effd-8e59-4eed-a326-41f4c340e458 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:28:47.305364 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce1effd-8e59-4eed-a326-41f4c340e458 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:28:47.305632 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce1effd-8e59-4eed-a326-41f4c340e458 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:28:47.318393 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce1effd-8e59-4eed-a326-41f4c340e458 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:28:47.319828 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce1effd-8e59-4eed-a326-41f4c340e458 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:28:47.335768 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-dce1effd-8e59-4eed-a326-41f4c340e458 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:28:47.335768 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:28:47.335768 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:28:47.335768 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:28:47.335768 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:28:47.335768 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:28:47.335768 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:28:47.335768 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:28:47.335768 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:28:47.335768 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:28:47.335768 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:28:47.335768 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:28:47.335768 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:28:47.335768 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:28:47.335768 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:28:47.341173 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:28:47.341173 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:28:47.341173 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:28:47.341173 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:28:47.341173 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:28:47.341173 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:28:47.341173 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:28:47.341173 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:28:47.341173 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 01 15:28:47.341173 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:28:47.341173 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:28:47.341173 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:28:47.341173 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:28:47.341173 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:28:47.341173 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:28:47.341173 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:28:47.341173 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:28:47.342255 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:28:47.342255 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:28:47.342255 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:28:47.342255 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 01 15:28:47.342255 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 635/1251] 10.222.0.102 () {56 vars in 1113 bytes} [Mon Aug 1 15:28:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:28:47.343378 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83cca1c-9ec2-413f-9459-75de0975c7c5 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:28:47.440984 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83cca1c-9ec2-413f-9459-75de0975c7c5 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:28:47.474440 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a0583b-9585-4987-b82f-d999a3365525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:28:47.475049 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a0583b-9585-4987-b82f-d999a3365525 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:28:47.475332 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a0583b-9585-4987-b82f-d999a3365525 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:28:47.475610 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a0583b-9585-4987-b82f-d999a3365525 None admin] PATH_INFO: `/v3/domains` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:28:47.476293 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a0583b-9585-4987-b82f-d999a3365525 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:28:47.476597 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a0583b-9585-4987-b82f-d999a3365525 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:28:47.477986 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a0583b-9585-4987-b82f-d999a3365525 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:28:47.489424 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 617/1252] 10.222.0.102 () {56 vars in 1114 bytes} [Mon Aug 1 15:28:47 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:28:47.495119 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce1effd-8e59-4eed-a326-41f4c340e458 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:28:47.604324 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce1effd-8e59-4eed-a326-41f4c340e458 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:28:47.630163 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:28:47.638465 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa99be3-e290-4934-b67d-78a50bdad649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:28:47.639114 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa99be3-e290-4934-b67d-78a50bdad649 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:28:47.639396 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa99be3-e290-4934-b67d-78a50bdad649 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:28:47.639669 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa99be3-e290-4934-b67d-78a50bdad649 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:28:47.647397 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa99be3-e290-4934-b67d-78a50bdad649 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:28:47.648867 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa99be3-e290-4934-b67d-78a50bdad649 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:28:47.660452 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-8fa99be3-e290-4934-b67d-78a50bdad649 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 01 15:28:47.660452 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:28:47.660452 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:28:47.660452 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:28:47.660452 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:28:47.660452 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:28:47.660452 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:28:47.660452 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:28:47.660452 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:28:47.660452 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:28:47.660452 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:28:47.660452 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:28:47.660452 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 15:28:47.660452 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 15:28:47.660452 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 15:28:47.660452 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 15:28:47.661666 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:28:47.661666 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:28:47.661666 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 15:28:47.661666 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 15:28:47.661666 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 15:28:47.661666 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 15:28:47.661666 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:28:47.661666 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:28:47.661666 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:28:47.661666 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:28:47.661666 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:28:47.661666 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 01 15:28:47.661666 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:28:47.661666 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:28:47.661666 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:28:47.661666 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:28:47.661666 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:28:47.661666 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:28:47.662679 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:28:47.662679 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:28:47.662679 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 15:28:47.662679 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 15:28:47.662679 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 15:28:47.662679 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 15:28:47.662679 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 15:28:47.662679 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 15:28:47.662679 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 01 15:28:47.662679 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 01 15:28:47.662679 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 636/1253] 10.222.0.102 () {56 vars in 1113 bytes} [Mon Aug 1 15:28:47 2022] GET /identity/v3/users/placement => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:28:47.667670 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a0583b-9585-4987-b82f-d999a3365525 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:28:47.722697 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:28:47.765072 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a0583b-9585-4987-b82f-d999a3365525 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:28:47.798089 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44840e7a-0ed1-4f81-941a-60aa1e988025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:28:47.798707 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44840e7a-0ed1-4f81-941a-60aa1e988025 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:28:47.798991 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44840e7a-0ed1-4f81-941a-60aa1e988025 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:28:47.799262 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44840e7a-0ed1-4f81-941a-60aa1e988025 None admin] PATH_INFO: `/v3/users` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:28:47.800052 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44840e7a-0ed1-4f81-941a-60aa1e988025 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:28:47.800364 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44840e7a-0ed1-4f81-941a-60aa1e988025 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:28:47.801824 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44840e7a-0ed1-4f81-941a-60aa1e988025 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:28:47.819655 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 618/1254] 10.222.0.102 () {56 vars in 1148 bytes} [Mon Aug 1 15:28:47 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 380 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:28:47.825725 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa99be3-e290-4934-b67d-78a50bdad649 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:28:47.932088 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa99be3-e290-4934-b67d-78a50bdad649 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:28:47.965455 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c982745-3a2e-49fa-af16-c2b6a81cfd55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:28:47.966056 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c982745-3a2e-49fa-af16-c2b6a81cfd55 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:28:47.966333 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c982745-3a2e-49fa-af16-c2b6a81cfd55 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:28:47.966602 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c982745-3a2e-49fa-af16-c2b6a81cfd55 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:28:48.020069 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:28:48.033001 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c982745-3a2e-49fa-af16-c2b6a81cfd55 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:28:48.034470 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c982745-3a2e-49fa-af16-c2b6a81cfd55 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:28:48.131640 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 637/1255] 10.222.0.102 () {58 vars in 1287 bytes} [Mon Aug 1 15:28:47 2022] GET /identity/v3/auth/tokens => generated 2113 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 01 15:28:48.137652 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44840e7a-0ed1-4f81-941a-60aa1e988025 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:28:48.235376 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44840e7a-0ed1-4f81-941a-60aa1e988025 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:28:48.248420 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:28:48.268889 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8257699-e081-423b-8cde-8f2455fc5175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:28:48.269525 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8257699-e081-423b-8cde-8f2455fc5175 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:28:48.269801 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8257699-e081-423b-8cde-8f2455fc5175 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:28:48.270070 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8257699-e081-423b-8cde-8f2455fc5175 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:28:48.280484 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8257699-e081-423b-8cde-8f2455fc5175 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:28:48.282021 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8257699-e081-423b-8cde-8f2455fc5175 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:28:48.296196 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-f8257699-e081-423b-8cde-8f2455fc5175 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:28:48.296196 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:28:48.296196 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:28:48.296196 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:28:48.296196 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:28:48.296196 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:28:48.296196 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:28:48.296196 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:28:48.296196 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:28:48.296196 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:28:48.296196 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:28:48.296196 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:28:48.296196 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:28:48.296196 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:28:48.296196 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:28:48.297266 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:28:48.297266 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:28:48.297266 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:28:48.297266 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:28:48.297266 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:28:48.297266 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:28:48.297266 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:28:48.297266 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:28:48.297266 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 01 15:28:48.297266 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:28:48.297266 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:28:48.297266 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:28:48.297266 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:28:48.297266 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:28:48.297266 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:28:48.297266 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:28:48.297266 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:28:48.298219 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:28:48.298219 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:28:48.298219 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:28:48.298219 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 01 15:28:48.298219 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 619/1256] 10.222.0.102 () {56 vars in 1113 bytes} [Mon Aug 1 15:28:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:28:48.303194 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c982745-3a2e-49fa-af16-c2b6a81cfd55 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:28:48.388640 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:28:48.400071 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c982745-3a2e-49fa-af16-c2b6a81cfd55 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:28:48.434332 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6313019f-b09a-47c0-a982-086a5e86d719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:28:48.434927 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6313019f-b09a-47c0-a982-086a5e86d719 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:28:48.435219 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6313019f-b09a-47c0-a982-086a5e86d719 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:28:48.435468 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6313019f-b09a-47c0-a982-086a5e86d719 None admin] PATH_INFO: `/v3/domains` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:28:48.436140 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6313019f-b09a-47c0-a982-086a5e86d719 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:28:48.436437 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6313019f-b09a-47c0-a982-086a5e86d719 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:28:48.437819 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6313019f-b09a-47c0-a982-086a5e86d719 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:28:48.448622 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 638/1257] 10.222.0.102 () {56 vars in 1114 bytes} [Mon Aug 1 15:28:48 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:28:48.455257 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8257699-e081-423b-8cde-8f2455fc5175 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:28:48.553563 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8257699-e081-423b-8cde-8f2455fc5175 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:28:48.586408 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e2fa4a-b8f4-4737-bcb4-10cddac89deb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:28:48.587044 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e2fa4a-b8f4-4737-bcb4-10cddac89deb None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:28:48.587323 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e2fa4a-b8f4-4737-bcb4-10cddac89deb None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:28:48.587596 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e2fa4a-b8f4-4737-bcb4-10cddac89deb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:28:48.594755 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e2fa4a-b8f4-4737-bcb4-10cddac89deb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:28:48.596234 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e2fa4a-b8f4-4737-bcb4-10cddac89deb None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:28:48.608727 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-d5e2fa4a-b8f4-4737-bcb4-10cddac89deb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 15:28:48.608727 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:28:48.608727 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:28:48.608727 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:28:48.608727 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:28:48.608727 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:28:48.608727 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:28:48.608727 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:28:48.608727 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:28:48.608727 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:28:48.608727 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:28:48.608727 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:28:48.608727 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 15:28:48.608727 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 15:28:48.608727 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 15:28:48.613606 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 15:28:48.613606 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:28:48.613606 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:28:48.613606 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:28:48.613606 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:28:48.613606 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:28:48.613606 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:28:48.613606 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:28:48.613606 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 01 15:28:48.613606 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:28:48.613606 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:28:48.613606 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:28:48.613606 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:28:48.613606 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:28:48.613606 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:28:48.613606 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:28:48.613606 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:28:48.614828 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 15:28:48.614828 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 15:28:48.614828 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 15:28:48.614828 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 15:28:48.614828 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 15:28:48.614828 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 15:28:48.614828 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 15:28:48.614828 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 01 15:28:48.614828 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 620/1258] 10.222.0.102 () {56 vars in 1116 bytes} [Mon Aug 1 15:28:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:28:48.615982 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6313019f-b09a-47c0-a982-086a5e86d719 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:28:48.717334 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6313019f-b09a-47c0-a982-086a5e86d719 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:28:48.750692 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987de7d3-f4ff-4b76-807e-a99343cb954c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:28:48.751504 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987de7d3-f4ff-4b76-807e-a99343cb954c None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:28:48.751787 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987de7d3-f4ff-4b76-807e-a99343cb954c None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:28:48.752052 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987de7d3-f4ff-4b76-807e-a99343cb954c None admin] PATH_INFO: `/v3/projects` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:28:48.752820 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987de7d3-f4ff-4b76-807e-a99343cb954c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:28:48.753159 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987de7d3-f4ff-4b76-807e-a99343cb954c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:28:48.754644 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987de7d3-f4ff-4b76-807e-a99343cb954c None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:28:48.766763 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 639/1259] 10.222.0.102 () {56 vars in 1153 bytes} [Mon Aug 1 15:28:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:28:48.773083 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e2fa4a-b8f4-4737-bcb4-10cddac89deb None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:28:48.799324 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:28:48.870381 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e2fa4a-b8f4-4737-bcb4-10cddac89deb None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:28:48.903001 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303d3423-beda-4190-a2c7-3565eefad82c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:28:48.903615 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303d3423-beda-4190-a2c7-3565eefad82c None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:28:48.903913 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303d3423-beda-4190-a2c7-3565eefad82c None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:28:48.904164 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303d3423-beda-4190-a2c7-3565eefad82c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:28:48.905044 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303d3423-beda-4190-a2c7-3565eefad82c None admin] RBAC: Adding query filter params (role.id=de1374f966c04c27b579515b54334fd2, scope.project.id=2eb32fbe631843d8be84d41f8ba88d6e, user.id=b78f5749fe9c46a389c88bb9c222cc73) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:28:48.905352 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303d3423-beda-4190-a2c7-3565eefad82c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:28:48.906775 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303d3423-beda-4190-a2c7-3565eefad82c None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:28:48.915377 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 621/1260] 10.222.0.102 () {56 vars in 1379 bytes} [Mon Aug 1 15:28:48 2022] GET /identity/v3/role_assignments?user.id=b78f5749fe9c46a389c88bb9c222cc73&scope.project.id=2eb32fbe631843d8be84d41f8ba88d6e&role.id=de1374f966c04c27b579515b54334fd2 => generated 260 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:28:50.891966 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2afae4a-92af-4b44-b57c-45c68cbfb8ab None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:28:50.892432 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2afae4a-92af-4b44-b57c-45c68cbfb8ab None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:28:50.892553 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2afae4a-92af-4b44-b57c-45c68cbfb8ab None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:28:50.893985 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 640/1261] 10.222.0.102 () {54 vars in 931 bytes} [Mon Aug 1 15:28:50 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 15:28:50.899030 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283246b1-3c79-4c4e-8d3f-c6b627cd9bbe None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:28:50.899481 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283246b1-3c79-4c4e-8d3f-c6b627cd9bbe None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:28:50.899619 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283246b1-3c79-4c4e-8d3f-c6b627cd9bbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:28:50.918682 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-283246b1-3c79-4c4e-8d3f-c6b627cd9bbe None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:28:50.919875 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-283246b1-3c79-4c4e-8d3f-c6b627cd9bbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:28:50.985450 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 622/1262] 10.222.0.102 () {58 vars in 1028 bytes} [Mon Aug 1 15:28:50 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 15:28:51.007422 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2afae4a-92af-4b44-b57c-45c68cbfb8ab None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:28:51.018527 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:28:51.108939 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2afae4a-92af-4b44-b57c-45c68cbfb8ab None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:28:51.142984 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151071cd-d931-4bd5-a83c-12bf19ca336c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:28:51.143539 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151071cd-d931-4bd5-a83c-12bf19ca336c None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:28:51.143812 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151071cd-d931-4bd5-a83c-12bf19ca336c None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:28:51.144078 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151071cd-d931-4bd5-a83c-12bf19ca336c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:28:51.155598 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151071cd-d931-4bd5-a83c-12bf19ca336c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:28:51.160539 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-151071cd-d931-4bd5-a83c-12bf19ca336c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 15:28:51.160539 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:28:51.160539 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:28:51.160539 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:28:51.160539 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:28:51.160539 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:28:51.160539 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:28:51.160539 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:28:51.160539 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:28:51.160539 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:28:51.160539 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:28:51.160539 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:28:51.160539 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:28:51.160539 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:28:51.160539 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:28:51.160539 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:28:51.161720 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:28:51.161720 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:28:51.161720 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:28:51.161720 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:28:51.161720 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:28:51.161720 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:28:51.161720 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:28:51.161720 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:28:51.161720 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:28:51.161720 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:28:51.161720 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:28:51.161720 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 01 15:28:51.161720 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:28:51.161720 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:28:51.161720 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:28:51.161720 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:28:51.162923 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:28:51.162923 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:28:51.162923 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:28:51.162923 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:28:51.162923 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:28:51.162923 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:28:51.162923 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:28:51.162923 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:28:51.162923 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:28:51.162923 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:28:51.162923 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 15:28:51.162923 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 01 15:28:51.162923 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 641/1263] 10.222.0.102 () {56 vars in 1101 bytes} [Mon Aug 1 15:28:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:28:51.167812 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283246b1-3c79-4c4e-8d3f-c6b627cd9bbe None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:28:51.186790 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:28:51.266158 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283246b1-3c79-4c4e-8d3f-c6b627cd9bbe None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:28:51.299959 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c32d28a-b184-41f9-a2a6-e0bb8b332a2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:28:51.300568 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c32d28a-b184-41f9-a2a6-e0bb8b332a2b None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:28:51.300870 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c32d28a-b184-41f9-a2a6-e0bb8b332a2b None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:28:51.301148 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c32d28a-b184-41f9-a2a6-e0bb8b332a2b None admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:28:51.301856 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c32d28a-b184-41f9-a2a6-e0bb8b332a2b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:28:51.302162 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c32d28a-b184-41f9-a2a6-e0bb8b332a2b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:28:51.303540 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c32d28a-b184-41f9-a2a6-e0bb8b332a2b None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:28:51.312035 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 623/1264] 10.222.0.102 () {56 vars in 1104 bytes} [Mon Aug 1 15:28:51 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:28:51.317865 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151071cd-d931-4bd5-a83c-12bf19ca336c None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:28:51.387060 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:28:51.419448 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151071cd-d931-4bd5-a83c-12bf19ca336c None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:28:51.454141 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1429ab-7fd1-4996-9d6b-7402400f5ef3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:28:51.454798 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1429ab-7fd1-4996-9d6b-7402400f5ef3 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:28:51.455076 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1429ab-7fd1-4996-9d6b-7402400f5ef3 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:28:51.455351 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1429ab-7fd1-4996-9d6b-7402400f5ef3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:28:51.466440 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1429ab-7fd1-4996-9d6b-7402400f5ef3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:28:51.467925 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1429ab-7fd1-4996-9d6b-7402400f5ef3 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:28:51.482448 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-7f1429ab-7fd1-4996-9d6b-7402400f5ef3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:28:51.482448 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:28:51.482448 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:28:51.482448 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:28:51.482448 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:28:51.482448 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:28:51.482448 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:28:51.482448 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:28:51.482448 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:28:51.482448 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:28:51.482448 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:28:51.482448 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:28:51.482448 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:28:51.482448 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:28:51.482448 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:28:51.483664 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:28:51.483664 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:28:51.483664 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:28:51.483664 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:28:51.483664 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:28:51.483664 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:28:51.483664 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:28:51.483664 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:28:51.483664 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 01 15:28:51.483664 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:28:51.483664 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:28:51.483664 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:28:51.483664 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:28:51.483664 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:28:51.483664 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:28:51.483664 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:28:51.483664 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:28:51.484586 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:28:51.484586 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:28:51.484586 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:28:51.484586 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 01 15:28:51.484586 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 642/1265] 10.222.0.102 () {56 vars in 1113 bytes} [Mon Aug 1 15:28:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:28:51.489526 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c32d28a-b184-41f9-a2a6-e0bb8b332a2b None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:28:51.568945 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:28:51.587328 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c32d28a-b184-41f9-a2a6-e0bb8b332a2b None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:28:51.621034 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f7db27-5935-4e88-98e8-66df96e847bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:28:51.621644 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f7db27-5935-4e88-98e8-66df96e847bb None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:28:51.621916 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f7db27-5935-4e88-98e8-66df96e847bb None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:28:51.622178 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f7db27-5935-4e88-98e8-66df96e847bb None admin] PATH_INFO: `/v3/domains` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:28:51.622967 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f7db27-5935-4e88-98e8-66df96e847bb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:28:51.623262 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f7db27-5935-4e88-98e8-66df96e847bb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:28:51.624945 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f7db27-5935-4e88-98e8-66df96e847bb None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:28:51.636609 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 624/1266] 10.222.0.102 () {56 vars in 1114 bytes} [Mon Aug 1 15:28:51 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:28:51.642388 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1429ab-7fd1-4996-9d6b-7402400f5ef3 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:28:51.742689 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1429ab-7fd1-4996-9d6b-7402400f5ef3 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:28:51.761956 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:28:51.775528 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd68477-ef84-4c7d-a1df-6804f8fb6528 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:28:51.776158 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd68477-ef84-4c7d-a1df-6804f8fb6528 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:28:51.776436 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd68477-ef84-4c7d-a1df-6804f8fb6528 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:28:51.776706 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd68477-ef84-4c7d-a1df-6804f8fb6528 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:28:51.784457 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd68477-ef84-4c7d-a1df-6804f8fb6528 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:28:51.785917 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd68477-ef84-4c7d-a1df-6804f8fb6528 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:28:51.797407 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-7dd68477-ef84-4c7d-a1df-6804f8fb6528 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 01 15:28:51.797407 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:28:51.797407 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:28:51.797407 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:28:51.797407 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:28:51.797407 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:28:51.797407 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:28:51.797407 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:28:51.797407 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:28:51.797407 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:28:51.797407 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:28:51.797407 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:28:51.797407 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 15:28:51.797407 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 15:28:51.797407 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 15:28:51.797407 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 15:28:51.798370 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:28:51.798370 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:28:51.798370 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 15:28:51.798370 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 15:28:51.798370 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 15:28:51.798370 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 15:28:51.798370 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:28:51.798370 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:28:51.798370 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:28:51.798370 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:28:51.798370 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:28:51.798370 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 01 15:28:51.798370 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:28:51.798370 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:28:51.798370 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:28:51.798370 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:28:51.798370 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:28:51.798370 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:28:51.799320 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:28:51.799320 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:28:51.799320 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 15:28:51.799320 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 15:28:51.799320 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 15:28:51.799320 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 15:28:51.799320 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 15:28:51.799320 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 15:28:51.799320 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 01 15:28:51.799320 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 01 15:28:51.799320 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 643/1267] 10.222.0.102 () {56 vars in 1113 bytes} [Mon Aug 1 15:28:51 2022] GET /identity/v3/users/placement => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:28:51.804375 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f7db27-5935-4e88-98e8-66df96e847bb None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:28:51.904181 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f7db27-5935-4e88-98e8-66df96e847bb None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:28:51.937681 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039d6a7b-896d-44e2-b738-733829637a1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:28:51.938293 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039d6a7b-896d-44e2-b738-733829637a1d None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:28:51.938573 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039d6a7b-896d-44e2-b738-733829637a1d None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:28:51.938847 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039d6a7b-896d-44e2-b738-733829637a1d None admin] PATH_INFO: `/v3/users` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:28:51.939634 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039d6a7b-896d-44e2-b738-733829637a1d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:28:51.939940 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039d6a7b-896d-44e2-b738-733829637a1d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:28:51.941438 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039d6a7b-896d-44e2-b738-733829637a1d None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:28:51.950535 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:28:51.958806 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 625/1268] 10.222.0.102 () {56 vars in 1148 bytes} [Mon Aug 1 15:28:51 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 380 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:28:51.964487 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd68477-ef84-4c7d-a1df-6804f8fb6528 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:28:52.065559 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd68477-ef84-4c7d-a1df-6804f8fb6528 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:28:52.099562 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989e0916-ece0-4e44-8697-510e64f5f2a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:28:52.100228 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989e0916-ece0-4e44-8697-510e64f5f2a1 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:28:52.100506 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989e0916-ece0-4e44-8697-510e64f5f2a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:28:52.100777 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989e0916-ece0-4e44-8697-510e64f5f2a1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:28:52.111072 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989e0916-ece0-4e44-8697-510e64f5f2a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:28:52.112570 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989e0916-ece0-4e44-8697-510e64f5f2a1 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:28:52.126445 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-989e0916-ece0-4e44-8697-510e64f5f2a1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:28:52.126445 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:28:52.126445 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:28:52.126445 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:28:52.126445 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:28:52.126445 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:28:52.126445 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:28:52.126445 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:28:52.126445 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:28:52.126445 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:28:52.126445 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:28:52.126445 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:28:52.126445 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:28:52.126445 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:28:52.126445 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:28:52.131347 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:28:52.131347 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:28:52.131347 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:28:52.131347 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:28:52.131347 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:28:52.131347 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:28:52.131347 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:28:52.131347 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:28:52.131347 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 01 15:28:52.131347 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:28:52.131347 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:28:52.131347 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:28:52.131347 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:28:52.131347 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:28:52.131347 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:28:52.131347 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:28:52.131347 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:28:52.132460 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:28:52.132460 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:28:52.132460 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:28:52.132460 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 01 15:28:52.132460 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 644/1269] 10.222.0.102 () {56 vars in 1113 bytes} [Mon Aug 1 15:28:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:28:52.133454 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039d6a7b-896d-44e2-b738-733829637a1d None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:28:52.232950 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039d6a7b-896d-44e2-b738-733829637a1d None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:28:52.266143 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7994a7fb-91dc-4b23-b565-5e435f121fb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:28:52.266754 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7994a7fb-91dc-4b23-b565-5e435f121fb1 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:28:52.267034 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7994a7fb-91dc-4b23-b565-5e435f121fb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:28:52.267307 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7994a7fb-91dc-4b23-b565-5e435f121fb1 None admin] PATH_INFO: `/v3/domains` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:28:52.267996 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7994a7fb-91dc-4b23-b565-5e435f121fb1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:28:52.268301 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7994a7fb-91dc-4b23-b565-5e435f121fb1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:28:52.269782 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7994a7fb-91dc-4b23-b565-5e435f121fb1 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:28:52.280645 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 626/1270] 10.222.0.102 () {56 vars in 1114 bytes} [Mon Aug 1 15:28:52 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:28:52.286615 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989e0916-ece0-4e44-8697-510e64f5f2a1 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:28:52.320337 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:28:52.387897 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989e0916-ece0-4e44-8697-510e64f5f2a1 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:28:52.424401 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dcfe2e-1a6a-4c88-a911-0a3bc5fa3fa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:28:52.425089 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dcfe2e-1a6a-4c88-a911-0a3bc5fa3fa0 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:28:52.425370 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dcfe2e-1a6a-4c88-a911-0a3bc5fa3fa0 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:28:52.425639 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dcfe2e-1a6a-4c88-a911-0a3bc5fa3fa0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:28:52.432136 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dcfe2e-1a6a-4c88-a911-0a3bc5fa3fa0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:28:52.433611 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dcfe2e-1a6a-4c88-a911-0a3bc5fa3fa0 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:28:52.444958 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-01dcfe2e-1a6a-4c88-a911-0a3bc5fa3fa0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 15:28:52.444958 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:28:52.444958 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:28:52.444958 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:28:52.444958 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:28:52.444958 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:28:52.444958 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:28:52.444958 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:28:52.444958 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:28:52.444958 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:28:52.444958 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:28:52.444958 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:28:52.444958 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 15:28:52.444958 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 15:28:52.444958 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 15:28:52.446000 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 15:28:52.446000 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:28:52.446000 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:28:52.446000 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:28:52.446000 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:28:52.446000 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:28:52.446000 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:28:52.446000 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:28:52.446000 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 01 15:28:52.446000 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:28:52.446000 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:28:52.446000 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:28:52.446000 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:28:52.446000 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:28:52.446000 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:28:52.446000 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:28:52.446000 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:28:52.447294 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 15:28:52.447294 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 15:28:52.447294 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 15:28:52.447294 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 15:28:52.447294 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 15:28:52.447294 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 15:28:52.447294 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 15:28:52.447294 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 01 15:28:52.447294 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 645/1271] 10.222.0.102 () {56 vars in 1116 bytes} [Mon Aug 1 15:28:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:28:52.452195 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7994a7fb-91dc-4b23-b565-5e435f121fb1 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:28:52.510119 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:28:52.550868 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7994a7fb-91dc-4b23-b565-5e435f121fb1 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:28:52.582868 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b55c2f-66be-4db9-b534-7fa90f621793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:28:52.583417 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b55c2f-66be-4db9-b534-7fa90f621793 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:28:52.583698 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b55c2f-66be-4db9-b534-7fa90f621793 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:28:52.583969 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b55c2f-66be-4db9-b534-7fa90f621793 None admin] PATH_INFO: `/v3/projects` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:28:52.584710 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b55c2f-66be-4db9-b534-7fa90f621793 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:28:52.585117 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b55c2f-66be-4db9-b534-7fa90f621793 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:28:52.586556 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b55c2f-66be-4db9-b534-7fa90f621793 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:28:52.601955 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 627/1272] 10.222.0.102 () {56 vars in 1153 bytes} [Mon Aug 1 15:28:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:28:52.608599 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dcfe2e-1a6a-4c88-a911-0a3bc5fa3fa0 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:28:52.700154 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:28:52.709457 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dcfe2e-1a6a-4c88-a911-0a3bc5fa3fa0 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:28:52.743174 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0a8759-ba1d-4d1a-a646-75d6df682bda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:28:52.743833 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0a8759-ba1d-4d1a-a646-75d6df682bda None admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:28:52.744115 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0a8759-ba1d-4d1a-a646-75d6df682bda None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:28:52.744390 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0a8759-ba1d-4d1a-a646-75d6df682bda None admin] PATH_INFO: `/v3/projects/2eb32fbe631843d8be84d41f8ba88d6e/users/b78f5749fe9c46a389c88bb9c222cc73/roles/de1374f966c04c27b579515b54334fd2` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:28:52.746370 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0a8759-ba1d-4d1a-a646-75d6df682bda None admin] RBAC: Authorizing `identity:create_grant(project_id=2eb32fbe631843d8be84d41f8ba88d6e, user_id=b78f5749fe9c46a389c88bb9c222cc73, role_id=de1374f966c04c27b579515b54334fd2)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:28:52.747798 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0a8759-ba1d-4d1a-a646-75d6df682bda None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:28:52.884466 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 646/1273] 10.222.0.102 () {58 vars in 1444 bytes} [Mon Aug 1 15:28:52 2022] PUT /identity/v3/projects/2eb32fbe631843d8be84d41f8ba88d6e/users/b78f5749fe9c46a389c88bb9c222cc73/roles/de1374f966c04c27b579515b54334fd2 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:28:54.900746 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d054da-c80c-4241-adb2-77c7a68d7e08 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:28:54.901266 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d054da-c80c-4241-adb2-77c7a68d7e08 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:28:54.901379 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d054da-c80c-4241-adb2-77c7a68d7e08 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:28:54.902754 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 628/1274] 10.222.0.102 () {54 vars in 931 bytes} [Mon Aug 1 15:28:54 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 15:28:54.907925 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf1eb65-3e82-4b06-ad74-dd67c7386973 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:28:54.908369 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf1eb65-3e82-4b06-ad74-dd67c7386973 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:28:54.908462 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf1eb65-3e82-4b06-ad74-dd67c7386973 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:28:54.927377 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-fbf1eb65-3e82-4b06-ad74-dd67c7386973 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:28:54.928613 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-fbf1eb65-3e82-4b06-ad74-dd67c7386973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:28:54.994922 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 647/1275] 10.222.0.102 () {58 vars in 1028 bytes} [Mon Aug 1 15:28:54 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 15:28:55.019412 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d054da-c80c-4241-adb2-77c7a68d7e08 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:28:55.128645 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d054da-c80c-4241-adb2-77c7a68d7e08 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:28:55.155394 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:28:55.162311 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cc6ce5-2942-402c-a44d-05152da6b0b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:28:55.162948 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cc6ce5-2942-402c-a44d-05152da6b0b4 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:28:55.163229 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cc6ce5-2942-402c-a44d-05152da6b0b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:28:55.163501 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cc6ce5-2942-402c-a44d-05152da6b0b4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:28:55.174119 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cc6ce5-2942-402c-a44d-05152da6b0b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 15:28:55.179027 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-b9cc6ce5-2942-402c-a44d-05152da6b0b4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 15:28:55.179027 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:28:55.179027 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:28:55.179027 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:28:55.179027 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:28:55.179027 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:28:55.179027 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:28:55.179027 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:28:55.179027 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:28:55.179027 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:28:55.179027 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:28:55.179027 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:28:55.179027 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 15:28:55.179027 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 15:28:55.179027 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 15:28:55.179027 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 15:28:55.180135 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 15:28:55.180135 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 15:28:55.180135 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 15:28:55.180135 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 15:28:55.180135 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:28:55.180135 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:28:55.180135 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:28:55.180135 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:28:55.180135 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:28:55.180135 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:28:55.180135 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:28:55.180135 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 01 15:28:55.180135 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:28:55.180135 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:28:55.180135 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:28:55.180135 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:28:55.181070 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:28:55.181070 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:28:55.181070 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:28:55.181070 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:28:55.181070 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 15:28:55.181070 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 15:28:55.181070 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 15:28:55.181070 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 15:28:55.181070 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 15:28:55.181070 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 15:28:55.181070 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 15:28:55.181070 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 01 15:28:55.181070 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 629/1276] 10.222.0.102 () {56 vars in 1101 bytes} [Mon Aug 1 15:28:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:28:55.187052 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf1eb65-3e82-4b06-ad74-dd67c7386973 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:28:55.268472 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:28:55.285906 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf1eb65-3e82-4b06-ad74-dd67c7386973 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:28:55.320959 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f2e4c3-6182-4812-a537-d33dadfa9dae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:28:55.321569 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f2e4c3-6182-4812-a537-d33dadfa9dae None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:28:55.321849 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f2e4c3-6182-4812-a537-d33dadfa9dae None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:28:55.322122 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f2e4c3-6182-4812-a537-d33dadfa9dae None admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:28:55.322827 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f2e4c3-6182-4812-a537-d33dadfa9dae None admin] RBAC: Adding query filter params (name=admin) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:28:55.323199 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f2e4c3-6182-4812-a537-d33dadfa9dae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:28:55.324610 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f2e4c3-6182-4812-a537-d33dadfa9dae None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:28:55.332757 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 648/1277] 10.222.0.102 () {56 vars in 1104 bytes} [Mon Aug 1 15:28:55 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:28:55.338678 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cc6ce5-2942-402c-a44d-05152da6b0b4 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:28:55.445413 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cc6ce5-2942-402c-a44d-05152da6b0b4 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:28:55.478833 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc5229a-2e48-478e-98e1-3805b8eb2793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:28:55.481767 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc5229a-2e48-478e-98e1-3805b8eb2793 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:28:55.481767 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc5229a-2e48-478e-98e1-3805b8eb2793 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:28:55.481767 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc5229a-2e48-478e-98e1-3805b8eb2793 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:28:55.491336 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc5229a-2e48-478e-98e1-3805b8eb2793 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:28:55.492795 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc5229a-2e48-478e-98e1-3805b8eb2793 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:28:55.507759 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-ecc5229a-2e48-478e-98e1-3805b8eb2793 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:28:55.507759 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:28:55.507759 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:28:55.507759 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:28:55.507759 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:28:55.507759 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:28:55.507759 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:28:55.507759 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:28:55.507759 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:28:55.507759 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:28:55.507759 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:28:55.507759 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:28:55.507759 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:28:55.507759 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:28:55.507759 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:28:55.508860 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:28:55.508860 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:28:55.508860 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:28:55.508860 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:28:55.508860 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:28:55.508860 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:28:55.508860 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:28:55.508860 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:28:55.508860 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 01 15:28:55.508860 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:28:55.508860 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:28:55.508860 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:28:55.508860 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:28:55.508860 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:28:55.508860 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:28:55.508860 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:28:55.508860 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:28:55.510589 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:28:55.510589 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:28:55.510589 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:28:55.510589 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 01 15:28:55.510589 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 630/1278] 10.222.0.102 () {56 vars in 1113 bytes} [Mon Aug 1 15:28:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:28:55.514825 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f2e4c3-6182-4812-a537-d33dadfa9dae None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:28:55.616194 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f2e4c3-6182-4812-a537-d33dadfa9dae None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:28:55.649777 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab3be65-ecbb-49d7-8df3-c57bb2b3acae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:28:55.650397 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab3be65-ecbb-49d7-8df3-c57bb2b3acae None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:28:55.650671 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab3be65-ecbb-49d7-8df3-c57bb2b3acae None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:28:55.650960 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab3be65-ecbb-49d7-8df3-c57bb2b3acae None admin] PATH_INFO: `/v3/domains` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:28:55.651633 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab3be65-ecbb-49d7-8df3-c57bb2b3acae None admin] RBAC: Adding query filter params (name=Default) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:28:55.651928 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab3be65-ecbb-49d7-8df3-c57bb2b3acae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:28:55.653876 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab3be65-ecbb-49d7-8df3-c57bb2b3acae None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:28:55.665358 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 649/1279] 10.222.0.102 () {56 vars in 1114 bytes} [Mon Aug 1 15:28:55 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:28:55.671869 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc5229a-2e48-478e-98e1-3805b8eb2793 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:28:55.704668 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:28:55.779674 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc5229a-2e48-478e-98e1-3805b8eb2793 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:28:55.812974 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80ee6e3-d416-41fc-b004-103ee337701a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:28:55.813610 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80ee6e3-d416-41fc-b004-103ee337701a None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:28:55.813889 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80ee6e3-d416-41fc-b004-103ee337701a None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:28:55.814159 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80ee6e3-d416-41fc-b004-103ee337701a None admin] PATH_INFO: `/v3/users/placement` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:28:55.821823 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80ee6e3-d416-41fc-b004-103ee337701a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:28:55.823254 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80ee6e3-d416-41fc-b004-103ee337701a None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:28:55.835375 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-a80ee6e3-d416-41fc-b004-103ee337701a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 01 15:28:55.835375 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:28:55.835375 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:28:55.835375 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:28:55.835375 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:28:55.835375 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:28:55.835375 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:28:55.835375 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:28:55.835375 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:28:55.835375 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:28:55.835375 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:28:55.835375 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:28:55.835375 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 15:28:55.835375 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 15:28:55.835375 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 15:28:55.835375 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 15:28:55.836541 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:28:55.836541 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:28:55.836541 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 15:28:55.836541 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 15:28:55.836541 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 15:28:55.836541 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 15:28:55.836541 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:28:55.836541 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:28:55.836541 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:28:55.836541 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:28:55.836541 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:28:55.836541 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 01 15:28:55.836541 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:28:55.836541 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:28:55.836541 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:28:55.836541 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:28:55.836541 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:28:55.836541 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:28:55.837987 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:28:55.837987 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:28:55.837987 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 15:28:55.837987 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 15:28:55.837987 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 15:28:55.837987 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 15:28:55.837987 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 15:28:55.837987 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 15:28:55.837987 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 01 15:28:55.837987 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 01 15:28:55.837987 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 631/1280] 10.222.0.102 () {56 vars in 1113 bytes} [Mon Aug 1 15:28:55 2022] GET /identity/v3/users/placement => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:28:55.843394 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab3be65-ecbb-49d7-8df3-c57bb2b3acae None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:28:55.847217 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:28:55.945032 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab3be65-ecbb-49d7-8df3-c57bb2b3acae None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:28:55.979591 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c179236c-09f3-4c8f-8a15-90b6684503da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:28:55.980134 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c179236c-09f3-4c8f-8a15-90b6684503da None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:28:55.980926 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c179236c-09f3-4c8f-8a15-90b6684503da None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:28:55.981327 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c179236c-09f3-4c8f-8a15-90b6684503da None admin] PATH_INFO: `/v3/users` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:28:55.982111 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c179236c-09f3-4c8f-8a15-90b6684503da None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:28:55.982416 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c179236c-09f3-4c8f-8a15-90b6684503da None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:28:55.983841 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c179236c-09f3-4c8f-8a15-90b6684503da None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:28:56.001352 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 650/1281] 10.222.0.102 () {56 vars in 1148 bytes} [Mon Aug 1 15:28:55 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 380 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:28:56.007104 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80ee6e3-d416-41fc-b004-103ee337701a None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:28:56.100296 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:28:56.114699 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80ee6e3-d416-41fc-b004-103ee337701a None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:28:56.154534 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adab231-0d2b-4f03-8df7-886c9d8f7b0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:28:56.155163 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adab231-0d2b-4f03-8df7-886c9d8f7b0c None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:28:56.155440 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adab231-0d2b-4f03-8df7-886c9d8f7b0c None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:28:56.155714 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adab231-0d2b-4f03-8df7-886c9d8f7b0c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:28:56.224613 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adab231-0d2b-4f03-8df7-886c9d8f7b0c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:28:56.226100 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adab231-0d2b-4f03-8df7-886c9d8f7b0c None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:28:56.313561 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:28:56.323440 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 632/1282] 10.222.0.102 () {58 vars in 1287 bytes} [Mon Aug 1 15:28:56 2022] GET /identity/v3/auth/tokens => generated 2113 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 01 15:28:56.329545 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c179236c-09f3-4c8f-8a15-90b6684503da None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:28:56.391164 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:28:56.428511 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c179236c-09f3-4c8f-8a15-90b6684503da None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:28:56.463337 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990db7ad-33ea-4cbd-9fd6-9216c1290e5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:28:56.464006 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990db7ad-33ea-4cbd-9fd6-9216c1290e5d None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:28:56.464280 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990db7ad-33ea-4cbd-9fd6-9216c1290e5d None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:28:56.464550 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990db7ad-33ea-4cbd-9fd6-9216c1290e5d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:28:56.476188 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990db7ad-33ea-4cbd-9fd6-9216c1290e5d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:28:56.477683 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990db7ad-33ea-4cbd-9fd6-9216c1290e5d None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:28:56.492210 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-990db7ad-33ea-4cbd-9fd6-9216c1290e5d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:28:56.492210 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:28:56.492210 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:28:56.492210 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:28:56.492210 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:28:56.492210 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:28:56.492210 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:28:56.492210 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:28:56.492210 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:28:56.492210 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:28:56.492210 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:28:56.492210 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:28:56.492210 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 15:28:56.492210 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 15:28:56.492210 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 15:28:56.493869 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 15:28:56.493869 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:28:56.493869 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:28:56.493869 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:28:56.493869 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:28:56.493869 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:28:56.493869 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:28:56.493869 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:28:56.493869 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 01 15:28:56.493869 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:28:56.493869 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:28:56.493869 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:28:56.493869 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:28:56.493869 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:28:56.493869 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:28:56.493869 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:28:56.493869 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:28:56.495041 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 15:28:56.495041 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 15:28:56.495041 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 15:28:56.495041 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 01 15:28:56.495041 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 651/1283] 10.222.0.102 () {56 vars in 1113 bytes} [Mon Aug 1 15:28:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:28:56.499217 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adab231-0d2b-4f03-8df7-886c9d8f7b0c None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:28:56.599671 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adab231-0d2b-4f03-8df7-886c9d8f7b0c None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:28:56.635239 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b521ae4-5abf-44f9-98e2-7a38ea413c3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:28:56.635857 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b521ae4-5abf-44f9-98e2-7a38ea413c3f None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:28:56.636138 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b521ae4-5abf-44f9-98e2-7a38ea413c3f None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:28:56.636410 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b521ae4-5abf-44f9-98e2-7a38ea413c3f None admin] PATH_INFO: `/v3/domains` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:28:56.637137 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b521ae4-5abf-44f9-98e2-7a38ea413c3f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:28:56.637435 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b521ae4-5abf-44f9-98e2-7a38ea413c3f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:28:56.638807 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b521ae4-5abf-44f9-98e2-7a38ea413c3f None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:28:56.649989 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 633/1284] 10.222.0.102 () {56 vars in 1114 bytes} [Mon Aug 1 15:28:56 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:28:56.659390 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990db7ad-33ea-4cbd-9fd6-9216c1290e5d None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:28:56.754386 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990db7ad-33ea-4cbd-9fd6-9216c1290e5d None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:28:56.767734 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:28:56.787074 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf26515-43ff-4547-9315-31a32311c5f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:28:56.787705 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf26515-43ff-4547-9315-31a32311c5f1 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:28:56.787984 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf26515-43ff-4547-9315-31a32311c5f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:28:56.788258 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf26515-43ff-4547-9315-31a32311c5f1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:28:56.795239 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf26515-43ff-4547-9315-31a32311c5f1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:28:56.796910 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf26515-43ff-4547-9315-31a32311c5f1 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:28:56.807778 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-5cf26515-43ff-4547-9315-31a32311c5f1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 15:28:56.807778 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:28:56.807778 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:28:56.807778 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:28:56.807778 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:28:56.807778 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:28:56.807778 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:28:56.807778 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:28:56.807778 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:28:56.807778 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:28:56.807778 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:28:56.807778 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:28:56.807778 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 15:28:56.807778 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 15:28:56.807778 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 15:28:56.809492 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 15:28:56.809492 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:28:56.809492 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:28:56.809492 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:28:56.809492 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:28:56.809492 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:28:56.809492 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:28:56.809492 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:28:56.809492 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Aug 01 15:28:56.809492 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:28:56.809492 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:28:56.809492 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:28:56.809492 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:28:56.809492 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:28:56.809492 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:28:56.809492 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:28:56.809492 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:28:56.810604 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 15:28:56.810604 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 15:28:56.810604 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 15:28:56.810604 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 15:28:56.810604 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 15:28:56.810604 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 15:28:56.810604 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 15:28:56.810604 dv-cinder-843277-7-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Aug 01 15:28:56.810604 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 652/1285] 10.222.0.102 () {56 vars in 1116 bytes} [Mon Aug 1 15:28:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:28:56.815439 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b521ae4-5abf-44f9-98e2-7a38ea413c3f None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:28:56.865270 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:28:56.913674 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b521ae4-5abf-44f9-98e2-7a38ea413c3f None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:28:56.947264 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f580977a-34ec-41ac-8f06-220fc52af54e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:28:56.947879 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f580977a-34ec-41ac-8f06-220fc52af54e None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:28:56.948166 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f580977a-34ec-41ac-8f06-220fc52af54e None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:28:56.948440 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f580977a-34ec-41ac-8f06-220fc52af54e None admin] PATH_INFO: `/v3/projects` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:28:56.949296 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f580977a-34ec-41ac-8f06-220fc52af54e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:28:56.949595 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f580977a-34ec-41ac-8f06-220fc52af54e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:28:56.951016 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f580977a-34ec-41ac-8f06-220fc52af54e None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:28:56.963097 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 634/1286] 10.222.0.102 () {56 vars in 1153 bytes} [Mon Aug 1 15:28:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:28:56.969867 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf26515-43ff-4547-9315-31a32311c5f1 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:28:57.071694 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf26515-43ff-4547-9315-31a32311c5f1 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:28:57.106046 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b9efcd-0da8-4afe-9f33-fe2eb8bd11ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:28:57.106657 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b9efcd-0da8-4afe-9f33-fe2eb8bd11ac None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:28:57.106933 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b9efcd-0da8-4afe-9f33-fe2eb8bd11ac None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:28:57.107201 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b9efcd-0da8-4afe-9f33-fe2eb8bd11ac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:28:57.108069 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b9efcd-0da8-4afe-9f33-fe2eb8bd11ac None admin] RBAC: Adding query filter params (role.id=de1374f966c04c27b579515b54334fd2, scope.project.id=2eb32fbe631843d8be84d41f8ba88d6e, user.id=b78f5749fe9c46a389c88bb9c222cc73) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:28:57.108376 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b9efcd-0da8-4afe-9f33-fe2eb8bd11ac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:28:57.109836 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b9efcd-0da8-4afe-9f33-fe2eb8bd11ac None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:28:57.115735 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 653/1287] 10.222.0.102 () {56 vars in 1379 bytes} [Mon Aug 1 15:28:56 2022] GET /identity/v3/role_assignments?user.id=b78f5749fe9c46a389c88bb9c222cc73&scope.project.id=2eb32fbe631843d8be84d41f8ba88d6e&role.id=de1374f966c04c27b579515b54334fd2 => generated 610 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:28:59.150617 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46db3bd7-6e2f-41ec-b925-11ebfc2f58d8 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:28:59.151154 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46db3bd7-6e2f-41ec-b925-11ebfc2f58d8 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:28:59.151154 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46db3bd7-6e2f-41ec-b925-11ebfc2f58d8 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:28:59.153073 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 635/1288] 10.222.0.102 () {54 vars in 931 bytes} [Mon Aug 1 15:28:59 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 15:28:59.158708 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b451ed7c-0f9b-4b6c-b5b4-283d1751ca0d None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:28:59.159170 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b451ed7c-0f9b-4b6c-b5b4-283d1751ca0d None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:28:59.159332 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b451ed7c-0f9b-4b6c-b5b4-283d1751ca0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:28:59.178655 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-b451ed7c-0f9b-4b6c-b5b4-283d1751ca0d None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:28:59.179858 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-b451ed7c-0f9b-4b6c-b5b4-283d1751ca0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:28:59.209756 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:28:59.247936 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 654/1289] 10.222.0.102 () {58 vars in 1028 bytes} [Mon Aug 1 15:28:59 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 15:28:59.269566 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46db3bd7-6e2f-41ec-b925-11ebfc2f58d8 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:28:59.370295 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46db3bd7-6e2f-41ec-b925-11ebfc2f58d8 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:28:59.380907 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:28:59.406123 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498c0f1a-3208-455b-b164-ab757582bfe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:28:59.406777 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498c0f1a-3208-455b-b164-ab757582bfe3 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:28:59.407057 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498c0f1a-3208-455b-b164-ab757582bfe3 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:28:59.407332 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498c0f1a-3208-455b-b164-ab757582bfe3 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:28:59.407962 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498c0f1a-3208-455b-b164-ab757582bfe3 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:28:59.409511 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498c0f1a-3208-455b-b164-ab757582bfe3 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:28:59.419039 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-498c0f1a-3208-455b-b164-ab757582bfe3 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 01 15:28:59.419039 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:28:59.419039 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 01 15:28:59.419039 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 01 15:28:59.419039 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 01 15:28:59.419039 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 01 15:28:59.419039 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 01 15:28:59.419039 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 15:28:59.419039 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 01 15:28:59.419039 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 01 15:28:59.419039 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 15:28:59.419039 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 01 15:28:59.419039 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:28:59.419039 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:28:59.419039 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:28:59.419039 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:28:59.419039 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:28:59.420294 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:28:59.420294 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:28:59.420294 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:28:59.420294 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:28:59.420294 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:28:59.420294 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:28:59.420294 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 01 15:28:59.420294 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 01 15:28:59.420294 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 01 15:28:59.420294 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 01 15:28:59.420294 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:28:59.420294 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:28:59.420294 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:28:59.420294 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:28:59.420294 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:28:59.420294 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:28:59.421602 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:28:59.421602 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 01 15:28:59.421602 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:28:59.421602 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:28:59.421602 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:28:59.421602 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:28:59.421602 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:28:59.421602 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:28:59.421602 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:28:59.421602 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:28:59.421602 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 01 15:28:59.421602 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 15:28:59.421602 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 01 15:28:59.421602 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 01 15:28:59.421602 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 636/1290] 10.222.0.102 () {56 vars in 1122 bytes} [Mon Aug 1 15:28:59 2022] GET /identity/v3/services/placement => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:28:59.426148 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b451ed7c-0f9b-4b6c-b5b4-283d1751ca0d None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:28:59.528575 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b451ed7c-0f9b-4b6c-b5b4-283d1751ca0d None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:28:59.562828 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0512e6a4-14a1-47c7-b036-cc49fdf13b69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:28:59.563645 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0512e6a4-14a1-47c7-b036-cc49fdf13b69 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:28:59.564003 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0512e6a4-14a1-47c7-b036-cc49fdf13b69 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:28:59.564326 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0512e6a4-14a1-47c7-b036-cc49fdf13b69 None admin] PATH_INFO: `/v3/services` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:28:59.565221 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0512e6a4-14a1-47c7-b036-cc49fdf13b69 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:28:59.565528 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0512e6a4-14a1-47c7-b036-cc49fdf13b69 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:28:59.566903 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0512e6a4-14a1-47c7-b036-cc49fdf13b69 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:28:59.571907 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 655/1291] 10.222.0.102 () {56 vars in 1121 bytes} [Mon Aug 1 15:28:59 2022] GET /identity/v3/services?name=placement => generated 127 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:28:59.578680 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498c0f1a-3208-455b-b164-ab757582bfe3 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:28:59.680839 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498c0f1a-3208-455b-b164-ab757582bfe3 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:28:59.713862 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b77a94-de76-4b56-b426-1a55e67767fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:28:59.714466 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b77a94-de76-4b56-b426-1a55e67767fa None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:28:59.715367 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b77a94-de76-4b56-b426-1a55e67767fa None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:28:59.715647 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b77a94-de76-4b56-b426-1a55e67767fa None admin] PATH_INFO: `/v3/services` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:28:59.716313 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b77a94-de76-4b56-b426-1a55e67767fa None admin] RBAC: Adding query filter params (type=placement) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:28:59.716616 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b77a94-de76-4b56-b426-1a55e67767fa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:28:59.718048 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b77a94-de76-4b56-b426-1a55e67767fa None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:28:59.722332 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 637/1292] 10.222.0.102 () {56 vars in 1121 bytes} [Mon Aug 1 15:28:59 2022] GET /identity/v3/services?type=placement => generated 127 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:29:01.719545 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90918b66-91e0-44b8-a9db-156472295c72 None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:29:01.720075 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90918b66-91e0-44b8-a9db-156472295c72 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:29:01.720075 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90918b66-91e0-44b8-a9db-156472295c72 None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:29:01.721460 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 656/1293] 10.222.0.102 () {54 vars in 931 bytes} [Mon Aug 1 15:29:01 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 15:29:01.726621 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ef5573-d7ab-4750-9aa0-8ce17e59dbd6 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:29:01.727040 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ef5573-d7ab-4750-9aa0-8ce17e59dbd6 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:29:01.727192 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ef5573-d7ab-4750-9aa0-8ce17e59dbd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:29:01.745692 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-20ef5573-d7ab-4750-9aa0-8ce17e59dbd6 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:29:01.746927 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-20ef5573-d7ab-4750-9aa0-8ce17e59dbd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:29:01.778834 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:29:01.815859 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 638/1294] 10.222.0.102 () {58 vars in 1028 bytes} [Mon Aug 1 15:29:01 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 15:29:01.838459 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90918b66-91e0-44b8-a9db-156472295c72 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:29:01.870720 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:29:01.940944 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90918b66-91e0-44b8-a9db-156472295c72 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:29:01.974787 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8533a0f4-6b85-4ca7-a249-d0a3db9e457b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:29:01.975337 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8533a0f4-6b85-4ca7-a249-d0a3db9e457b None admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:29:01.975617 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8533a0f4-6b85-4ca7-a249-d0a3db9e457b None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:29:01.975892 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8533a0f4-6b85-4ca7-a249-d0a3db9e457b None admin] PATH_INFO: `/v3/services` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:29:01.976580 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8533a0f4-6b85-4ca7-a249-d0a3db9e457b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:29:01.977991 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8533a0f4-6b85-4ca7-a249-d0a3db9e457b None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:29:02.110862 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 657/1295] 10.222.0.102 () {60 vars in 1146 bytes} [Mon Aug 1 15:29:01 2022] POST /identity/v3/services => generated 247 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:29:04.140427 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e496e8-a365-4dfd-aeab-c0d474acfbb7 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:29:04.140997 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e496e8-a365-4dfd-aeab-c0d474acfbb7 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:29:04.140997 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e496e8-a365-4dfd-aeab-c0d474acfbb7 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:29:04.142263 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 639/1296] 10.222.0.102 () {54 vars in 931 bytes} [Mon Aug 1 15:29:04 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 15:29:04.147603 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78f0662-1e56-47f6-bd1b-ef5966ec6923 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:29:04.147994 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78f0662-1e56-47f6-bd1b-ef5966ec6923 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:29:04.148150 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78f0662-1e56-47f6-bd1b-ef5966ec6923 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:29:04.166242 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-e78f0662-1e56-47f6-bd1b-ef5966ec6923 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:29:04.167442 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-e78f0662-1e56-47f6-bd1b-ef5966ec6923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:29:04.239804 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 658/1297] 10.222.0.102 () {58 vars in 1028 bytes} [Mon Aug 1 15:29:04 2022] POST /identity/v3/auth/tokens => generated 2216 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 15:29:04.263279 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e496e8-a365-4dfd-aeab-c0d474acfbb7 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:29:04.364271 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e496e8-a365-4dfd-aeab-c0d474acfbb7 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:29:04.404947 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7f9b18-00eb-43ea-9237-2a160d7df0c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:29:04.404947 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7f9b18-00eb-43ea-9237-2a160d7df0c2 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:29:04.404947 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7f9b18-00eb-43ea-9237-2a160d7df0c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:29:04.404947 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7f9b18-00eb-43ea-9237-2a160d7df0c2 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:29:04.405359 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7f9b18-00eb-43ea-9237-2a160d7df0c2 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:29:04.405359 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7f9b18-00eb-43ea-9237-2a160d7df0c2 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:29:04.410091 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-1a7f9b18-00eb-43ea-9237-2a160d7df0c2 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 01 15:29:04.410091 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:29:04.410091 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 01 15:29:04.410091 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 01 15:29:04.410091 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 01 15:29:04.410091 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 01 15:29:04.410091 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 01 15:29:04.410091 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 15:29:04.410091 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 01 15:29:04.410091 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 01 15:29:04.410091 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 15:29:04.410091 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 01 15:29:04.410091 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:29:04.410091 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:29:04.410091 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:29:04.410091 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:29:04.410091 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:29:04.411223 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:29:04.411223 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:29:04.411223 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:29:04.411223 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:29:04.411223 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:29:04.411223 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:29:04.411223 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 01 15:29:04.411223 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 01 15:29:04.411223 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 01 15:29:04.411223 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 01 15:29:04.411223 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:29:04.411223 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:29:04.411223 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:29:04.411223 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:29:04.411223 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:29:04.411223 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:29:04.412381 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:29:04.412381 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 01 15:29:04.412381 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:29:04.412381 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:29:04.412381 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:29:04.412381 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:29:04.412381 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:29:04.412381 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:29:04.412381 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:29:04.412381 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:29:04.412381 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 01 15:29:04.412381 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 15:29:04.412381 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 01 15:29:04.412381 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 01 15:29:04.412381 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 640/1298] 10.222.0.102 () {56 vars in 1122 bytes} [Mon Aug 1 15:29:04 2022] GET /identity/v3/services/placement => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 15:29:04.417462 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78f0662-1e56-47f6-bd1b-ef5966ec6923 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:29:04.437038 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:29:04.519437 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78f0662-1e56-47f6-bd1b-ef5966ec6923 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:29:04.553801 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0e9ed9-3d49-4b16-91db-847aab255d5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:29:04.554413 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0e9ed9-3d49-4b16-91db-847aab255d5e None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:29:04.554694 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0e9ed9-3d49-4b16-91db-847aab255d5e None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:29:04.554972 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0e9ed9-3d49-4b16-91db-847aab255d5e None admin] PATH_INFO: `/v3/services` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:29:04.555643 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0e9ed9-3d49-4b16-91db-847aab255d5e None admin] RBAC: Adding query filter params (name=placement) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:29:04.555946 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0e9ed9-3d49-4b16-91db-847aab255d5e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:29:04.557362 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0e9ed9-3d49-4b16-91db-847aab255d5e None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:29:04.563199 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 659/1299] 10.222.0.102 () {56 vars in 1121 bytes} [Mon Aug 1 15:29:04 2022] GET /identity/v3/services?name=placement => generated 360 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:29:04.569448 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7f9b18-00eb-43ea-9237-2a160d7df0c2 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:29:04.600566 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:29:04.668785 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7f9b18-00eb-43ea-9237-2a160d7df0c2 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:29:04.701760 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a153bd-f1e4-43a9-b8fe-8fdde1213da2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:29:04.702369 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a153bd-f1e4-43a9-b8fe-8fdde1213da2 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:29:04.702642 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a153bd-f1e4-43a9-b8fe-8fdde1213da2 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:29:04.702905 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a153bd-f1e4-43a9-b8fe-8fdde1213da2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:29:04.703747 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a153bd-f1e4-43a9-b8fe-8fdde1213da2 None admin] RBAC: Adding query filter params (interface=public, service_id=d14f42001157430caad423e2921a449c, region_id=RegionOne) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:29:04.704038 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a153bd-f1e4-43a9-b8fe-8fdde1213da2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:29:04.705428 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a153bd-f1e4-43a9-b8fe-8fdde1213da2 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:29:04.710260 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 641/1300] 10.222.0.102 () {56 vars in 1256 bytes} [Mon Aug 1 15:29:04 2022] GET /identity/v3/endpoints?service_id=d14f42001157430caad423e2921a449c&interface=public®ion_id=RegionOne => generated 195 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:29:04.716537 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0e9ed9-3d49-4b16-91db-847aab255d5e None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:29:04.798426 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:29:04.815800 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0e9ed9-3d49-4b16-91db-847aab255d5e None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:29:04.848869 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2577894a-5613-46bd-8b38-7ce18a72bfff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:29:04.849497 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2577894a-5613-46bd-8b38-7ce18a72bfff None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:29:04.849776 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2577894a-5613-46bd-8b38-7ce18a72bfff None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:29:04.850053 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2577894a-5613-46bd-8b38-7ce18a72bfff None admin] PATH_INFO: `/v3/services` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:29:04.850697 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2577894a-5613-46bd-8b38-7ce18a72bfff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:29:04.852059 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2577894a-5613-46bd-8b38-7ce18a72bfff None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:29:04.859230 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 660/1301] 10.222.0.102 () {56 vars in 1092 bytes} [Mon Aug 1 15:29:04 2022] GET /identity/v3/services => generated 2201 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:29:06.841012 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e50591e-aac9-4c42-a713-068313b222e7 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:29:06.841539 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e50591e-aac9-4c42-a713-068313b222e7 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:29:06.841539 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e50591e-aac9-4c42-a713-068313b222e7 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:29:06.842913 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 642/1302] 10.222.0.102 () {54 vars in 931 bytes} [Mon Aug 1 15:29:06 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 15:29:06.847794 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef586f62-cd7a-47dd-898d-bfd76302828d None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:29:06.848203 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef586f62-cd7a-47dd-898d-bfd76302828d None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:29:06.849906 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef586f62-cd7a-47dd-898d-bfd76302828d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:29:06.866691 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-ef586f62-cd7a-47dd-898d-bfd76302828d None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:29:06.867896 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-ef586f62-cd7a-47dd-898d-bfd76302828d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:29:06.934578 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 661/1303] 10.222.0.102 () {58 vars in 1028 bytes} [Mon Aug 1 15:29:06 2022] POST /identity/v3/auth/tokens => generated 2216 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 15:29:06.958197 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e50591e-aac9-4c42-a713-068313b222e7 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:29:07.053425 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:29:07.060511 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e50591e-aac9-4c42-a713-068313b222e7 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:29:07.093944 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c6cfc9-9737-46ee-ad89-1c85723793f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:29:07.094510 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c6cfc9-9737-46ee-ad89-1c85723793f3 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:29:07.094783 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c6cfc9-9737-46ee-ad89-1c85723793f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:29:07.095053 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c6cfc9-9737-46ee-ad89-1c85723793f3 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:29:07.095662 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c6cfc9-9737-46ee-ad89-1c85723793f3 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:29:07.097043 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c6cfc9-9737-46ee-ad89-1c85723793f3 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:29:07.105609 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-69c6cfc9-9737-46ee-ad89-1c85723793f3 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 01 15:29:07.105609 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:29:07.105609 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 01 15:29:07.105609 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 01 15:29:07.105609 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 01 15:29:07.105609 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 01 15:29:07.105609 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 01 15:29:07.105609 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 15:29:07.105609 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 01 15:29:07.105609 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 01 15:29:07.105609 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 15:29:07.105609 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 01 15:29:07.105609 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 15:29:07.105609 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 15:29:07.105609 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 15:29:07.105609 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 15:29:07.105609 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 15:29:07.106662 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 15:29:07.106662 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 15:29:07.106662 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 15:29:07.106662 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 15:29:07.106662 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 15:29:07.106662 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 15:29:07.106662 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 01 15:29:07.106662 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 01 15:29:07.106662 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 01 15:29:07.106662 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 01 15:29:07.106662 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 15:29:07.106662 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 15:29:07.106662 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 15:29:07.106662 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 15:29:07.106662 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 15:29:07.106662 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 15:29:07.107542 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 15:29:07.107542 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Aug 01 15:29:07.107542 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 15:29:07.107542 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Aug 01 15:29:07.107542 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 15:29:07.107542 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 15:29:07.107542 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 15:29:07.107542 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Aug 01 15:29:07.107542 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 15:29:07.107542 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Aug 01 15:29:07.107542 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 01 15:29:07.107542 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 15:29:07.107542 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 01 15:29:07.107542 dv-cinder-843277-7-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Aug 01 15:29:07.108583 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 643/1304] 10.222.0.102 () {56 vars in 1122 bytes} [Mon Aug 1 15:29:06 2022] GET /identity/v3/services/placement => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 15:29:07.112975 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef586f62-cd7a-47dd-898d-bfd76302828d None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:29:07.187807 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:29:07.210866 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef586f62-cd7a-47dd-898d-bfd76302828d None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:29:07.244705 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3927344a-e07d-4cf1-a650-293519e1c730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:29:07.245345 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3927344a-e07d-4cf1-a650-293519e1c730 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:29:07.245629 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3927344a-e07d-4cf1-a650-293519e1c730 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:29:07.246382 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3927344a-e07d-4cf1-a650-293519e1c730 None admin] PATH_INFO: `/v3/services` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:29:07.247056 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3927344a-e07d-4cf1-a650-293519e1c730 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:29:07.247361 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3927344a-e07d-4cf1-a650-293519e1c730 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:29:07.248753 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3927344a-e07d-4cf1-a650-293519e1c730 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:29:07.253848 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 662/1305] 10.222.0.102 () {56 vars in 1121 bytes} [Mon Aug 1 15:29:07 2022] GET /identity/v3/services?name=placement => generated 360 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:29:07.259666 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c6cfc9-9737-46ee-ad89-1c85723793f3 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:29:07.358456 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c6cfc9-9737-46ee-ad89-1c85723793f3 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:29:07.391382 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63478f9-d10f-4356-92af-df6ccbab44ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:29:07.392048 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63478f9-d10f-4356-92af-df6ccbab44ac None admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:29:07.392326 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63478f9-d10f-4356-92af-df6ccbab44ac None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:29:07.392594 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63478f9-d10f-4356-92af-df6ccbab44ac None admin] PATH_INFO: `/v3/endpoints` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:29:07.393331 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63478f9-d10f-4356-92af-df6ccbab44ac None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:29:07.394683 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63478f9-d10f-4356-92af-df6ccbab44ac None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:29:07.490728 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 644/1306] 10.222.0.102 () {60 vars in 1149 bytes} [Mon Aug 1 15:29:07 2022] POST /identity/v3/endpoints => generated 333 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:29:17.250835 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=30 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:29:17.485870 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:35:40.186357 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9af57a-96a0-41d8-8d90-192d5e678b0a None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:40.187909 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9af57a-96a0-41d8-8d90-192d5e678b0a None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:40.188644 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9af57a-96a0-41d8-8d90-192d5e678b0a None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:40.199062 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a696a90-b6f2-41a7-9432-891857402a81 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:40.200311 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a696a90-b6f2-41a7-9432-891857402a81 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:40.201056 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a696a90-b6f2-41a7-9432-891857402a81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:40.205954 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 663/1307] 10.222.0.102 () {54 vars in 931 bytes} [Mon Aug 1 15:35:40 2022] GET /identity => generated 271 bytes in 21 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 15:35:40.354377 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-2a696a90-b6f2-41a7-9432-891857402a81 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:35:40.355835 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-2a696a90-b6f2-41a7-9432-891857402a81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:35:40.549728 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 645/1308] 10.222.0.102 () {58 vars in 1028 bytes} [Mon Aug 1 15:35:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 352 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:35:40.607471 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424e6ddf-f811-4966-aa58-ed516e5a21f8 None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:40.607852 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424e6ddf-f811-4966-aa58-ed516e5a21f8 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:40.608111 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424e6ddf-f811-4966-aa58-ed516e5a21f8 None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:40.609487 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 664/1309] 10.222.0.102 () {54 vars in 970 bytes} [Mon Aug 1 15:35:40 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 01 15:35:40.618000 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71d73d0-8a96-439d-9fad-5c0a118ea94f None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:40.618356 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71d73d0-8a96-439d-9fad-5c0a118ea94f None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:40.618765 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71d73d0-8a96-439d-9fad-5c0a118ea94f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:40.709696 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-e71d73d0-8a96-439d-9fad-5c0a118ea94f None None] MFA Rules not processed for user `a856a413100443939fe9b10daa868518`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:35:40.710904 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-e71d73d0-8a96-439d-9fad-5c0a118ea94f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:35:40.737356 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:35:40.794408 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 646/1310] 10.222.0.102 () {58 vars in 1067 bytes} [Mon Aug 1 15:35:40 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:35:40.803979 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424e6ddf-f811-4966-aa58-ed516e5a21f8 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:40.805977 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-424e6ddf-f811-4966-aa58-ed516e5a21f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:35:40.934363 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424e6ddf-f811-4966-aa58-ed516e5a21f8 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:41.016196 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993f7e9f-30f8-4380-a489-63cc26bc8f8b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a856a413100443939fe9b10daa868518', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:41.016743 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993f7e9f-30f8-4380-a489-63cc26bc8f8b service neutron] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:41.017065 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993f7e9f-30f8-4380-a489-63cc26bc8f8b service neutron] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:41.017338 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993f7e9f-30f8-4380-a489-63cc26bc8f8b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:41.018962 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-993f7e9f-30f8-4380-a489-63cc26bc8f8b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:35:41.080427 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:35:41.145491 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993f7e9f-30f8-4380-a489-63cc26bc8f8b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:35:41.147114 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993f7e9f-30f8-4380-a489-63cc26bc8f8b service neutron] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:35:41.169172 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 665/1311] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:35:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:35:43.488046 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f08612-1653-4838-be5f-c0f41e60a4da None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:43.488597 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f08612-1653-4838-be5f-c0f41e60a4da None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:43.488597 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f08612-1653-4838-be5f-c0f41e60a4da None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:43.490135 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 647/1312] 10.222.0.102 () {54 vars in 931 bytes} [Mon Aug 1 15:35:43 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 15:35:43.495059 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f9105b-e955-4fa4-b408-cdfa4a434d36 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:43.495468 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f9105b-e955-4fa4-b408-cdfa4a434d36 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:43.495663 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f9105b-e955-4fa4-b408-cdfa4a434d36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:43.582976 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-d5f9105b-e955-4fa4-b408-cdfa4a434d36 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:35:43.584209 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-d5f9105b-e955-4fa4-b408-cdfa4a434d36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:35:43.817583 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 666/1313] 10.222.0.102 () {58 vars in 1028 bytes} [Mon Aug 1 15:35:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 15:35:43.854986 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f08612-1653-4838-be5f-c0f41e60a4da None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:43.856522 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-29f08612-1653-4838-be5f-c0f41e60a4da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:35:43.961731 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f08612-1653-4838-be5f-c0f41e60a4da None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:44.034152 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:35:44.036751 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021aabe9-63cf-4846-be76-fa871cd96f3a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a856a413100443939fe9b10daa868518', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:44.037438 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021aabe9-63cf-4846-be76-fa871cd96f3a service neutron] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:44.037718 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021aabe9-63cf-4846-be76-fa871cd96f3a service neutron] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:44.037989 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021aabe9-63cf-4846-be76-fa871cd96f3a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:44.039628 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-021aabe9-63cf-4846-be76-fa871cd96f3a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:35:44.154624 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021aabe9-63cf-4846-be76-fa871cd96f3a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:35:44.156093 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021aabe9-63cf-4846-be76-fa871cd96f3a service neutron] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:35:44.174220 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 648/1314] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:35:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:35:46.848007 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3221f00-6c37-4199-a825-469a452e3e2f None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:46.848542 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3221f00-6c37-4199-a825-469a452e3e2f None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:46.848542 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3221f00-6c37-4199-a825-469a452e3e2f None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:46.849924 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 667/1315] 10.222.0.102 () {54 vars in 931 bytes} [Mon Aug 1 15:35:46 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 15:35:46.855180 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1305c472-a25c-478a-8896-174fbe422cb2 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:46.855559 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1305c472-a25c-478a-8896-174fbe422cb2 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:46.855719 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1305c472-a25c-478a-8896-174fbe422cb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:46.920041 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-1305c472-a25c-478a-8896-174fbe422cb2 None None] MFA Rules not processed for user `d63a704c427d4f18a40f7ba2bdc48254`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:35:46.921327 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-1305c472-a25c-478a-8896-174fbe422cb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:35:46.972077 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:35:47.015777 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 649/1316] 10.222.0.102 () {58 vars in 1028 bytes} [Mon Aug 1 15:35:46 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:35:47.054596 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3221f00-6c37-4199-a825-469a452e3e2f None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:47.056136 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-f3221f00-6c37-4199-a825-469a452e3e2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:35:47.066408 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:35:47.159051 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3221f00-6c37-4199-a825-469a452e3e2f None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:47.231022 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a31c06-da8b-459b-b3d6-1935bc439d9a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a856a413100443939fe9b10daa868518', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:47.231606 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a31c06-da8b-459b-b3d6-1935bc439d9a service neutron] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:47.231882 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a31c06-da8b-459b-b3d6-1935bc439d9a service neutron] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:47.232151 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a31c06-da8b-459b-b3d6-1935bc439d9a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:47.233837 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-63a31c06-da8b-459b-b3d6-1935bc439d9a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:35:47.300040 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:35:47.349243 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a31c06-da8b-459b-b3d6-1935bc439d9a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:35:47.350681 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a31c06-da8b-459b-b3d6-1935bc439d9a service neutron] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:35:47.368321 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 668/1317] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:35:47 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:35:50.282522 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8687b2-d80b-4784-86bd-42ca49e8d9ee None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:50.283086 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8687b2-d80b-4784-86bd-42ca49e8d9ee None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:50.283086 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8687b2-d80b-4784-86bd-42ca49e8d9ee None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:50.284435 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 650/1318] 10.222.0.102 () {54 vars in 931 bytes} [Mon Aug 1 15:35:50 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 15:35:50.289534 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ec33c6-5080-4661-b0c2-909676d422cf None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:50.289922 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ec33c6-5080-4661-b0c2-909676d422cf None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:50.290071 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ec33c6-5080-4661-b0c2-909676d422cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:50.355393 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-06ec33c6-5080-4661-b0c2-909676d422cf None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:35:50.356585 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-06ec33c6-5080-4661-b0c2-909676d422cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:35:50.457096 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 669/1319] 10.222.0.102 () {58 vars in 1028 bytes} [Mon Aug 1 15:35:50 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:35:50.495064 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8687b2-d80b-4784-86bd-42ca49e8d9ee None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:50.496596 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-5c8687b2-d80b-4784-86bd-42ca49e8d9ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:35:50.598260 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8687b2-d80b-4784-86bd-42ca49e8d9ee None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:50.669734 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4083ed23-32e9-45c1-b213-7a81e921397f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a856a413100443939fe9b10daa868518', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:50.670347 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4083ed23-32e9-45c1-b213-7a81e921397f service neutron] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:50.670625 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4083ed23-32e9-45c1-b213-7a81e921397f service neutron] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:50.670896 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4083ed23-32e9-45c1-b213-7a81e921397f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:50.672528 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-4083ed23-32e9-45c1-b213-7a81e921397f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:35:50.679848 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:35:50.779437 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4083ed23-32e9-45c1-b213-7a81e921397f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:35:50.781446 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4083ed23-32e9-45c1-b213-7a81e921397f service neutron] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:35:50.799590 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 651/1320] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:35:50 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:35:53.849229 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbe7238-95e6-403e-9bce-68b49a881429 None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:53.849771 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbe7238-95e6-403e-9bce-68b49a881429 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:53.850134 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbe7238-95e6-403e-9bce-68b49a881429 None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:53.851834 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 670/1321] 10.222.0.102 () {54 vars in 931 bytes} [Mon Aug 1 15:35:53 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 15:35:53.857029 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd3daf7-ca6e-496e-aeaf-e8284fac9f44 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:53.857745 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd3daf7-ca6e-496e-aeaf-e8284fac9f44 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:53.857745 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd3daf7-ca6e-496e-aeaf-e8284fac9f44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:53.925988 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-8dd3daf7-ca6e-496e-aeaf-e8284fac9f44 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:35:53.927206 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-8dd3daf7-ca6e-496e-aeaf-e8284fac9f44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:35:53.984211 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:35:54.024097 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 652/1322] 10.222.0.102 () {58 vars in 1028 bytes} [Mon Aug 1 15:35:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:35:54.075210 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19891a89-6d16-4528-a95d-af2ace1c5f9a None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:54.075604 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19891a89-6d16-4528-a95d-af2ace1c5f9a None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:54.075948 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19891a89-6d16-4528-a95d-af2ace1c5f9a None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:54.077949 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 671/1323] 10.222.0.102 () {54 vars in 970 bytes} [Mon Aug 1 15:35:54 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 15:35:54.084156 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614b8993-1974-4a83-ac62-95e02fac6b78 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:54.084443 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614b8993-1974-4a83-ac62-95e02fac6b78 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:54.084713 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614b8993-1974-4a83-ac62-95e02fac6b78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:54.169270 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-614b8993-1974-4a83-ac62-95e02fac6b78 None None] MFA Rules not processed for user `a856a413100443939fe9b10daa868518`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:35:54.170786 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-614b8993-1974-4a83-ac62-95e02fac6b78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:35:54.252980 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 653/1324] 10.222.0.102 () {58 vars in 1067 bytes} [Mon Aug 1 15:35:54 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:35:54.262534 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19891a89-6d16-4528-a95d-af2ace1c5f9a None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:54.265337 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-19891a89-6d16-4528-a95d-af2ace1c5f9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:35:54.284677 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:35:54.371585 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19891a89-6d16-4528-a95d-af2ace1c5f9a None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:54.447396 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78470695-8012-4bcf-bf2d-9206bd782f3f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a856a413100443939fe9b10daa868518', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:54.447933 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78470695-8012-4bcf-bf2d-9206bd782f3f service neutron] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:54.448209 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78470695-8012-4bcf-bf2d-9206bd782f3f service neutron] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:54.448474 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78470695-8012-4bcf-bf2d-9206bd782f3f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:54.450137 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-78470695-8012-4bcf-bf2d-9206bd782f3f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:35:54.524310 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:35:54.561924 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78470695-8012-4bcf-bf2d-9206bd782f3f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:35:54.563359 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78470695-8012-4bcf-bf2d-9206bd782f3f service neutron] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:35:54.582462 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 672/1325] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:35:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:35:56.896522 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e77a3c-f022-441e-8d2e-7c8d464ebdf2 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:56.896991 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e77a3c-f022-441e-8d2e-7c8d464ebdf2 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:56.897151 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e77a3c-f022-441e-8d2e-7c8d464ebdf2 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:56.898510 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 654/1326] 10.222.0.102 () {54 vars in 931 bytes} [Mon Aug 1 15:35:56 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 15:35:56.903696 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c812c8f0-6b50-43a8-9a0e-dfdb9e8ab51a None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:56.904103 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c812c8f0-6b50-43a8-9a0e-dfdb9e8ab51a None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:56.904246 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c812c8f0-6b50-43a8-9a0e-dfdb9e8ab51a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:56.972718 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-c812c8f0-6b50-43a8-9a0e-dfdb9e8ab51a None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:35:56.973991 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-c812c8f0-6b50-43a8-9a0e-dfdb9e8ab51a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:35:57.077441 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 673/1327] 10.222.0.102 () {58 vars in 1028 bytes} [Mon Aug 1 15:35:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:35:57.114104 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e77a3c-f022-441e-8d2e-7c8d464ebdf2 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:57.115817 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-e4e77a3c-f022-441e-8d2e-7c8d464ebdf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:35:57.178646 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:35:57.224729 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e77a3c-f022-441e-8d2e-7c8d464ebdf2 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:57.304592 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027c1266-7b5e-4388-906b-3de4a9b96789 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a856a413100443939fe9b10daa868518', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:57.305251 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027c1266-7b5e-4388-906b-3de4a9b96789 service neutron] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:57.305532 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027c1266-7b5e-4388-906b-3de4a9b96789 service neutron] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:57.305806 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027c1266-7b5e-4388-906b-3de4a9b96789 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:57.307418 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-027c1266-7b5e-4388-906b-3de4a9b96789 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:35:57.414072 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:35:57.416138 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027c1266-7b5e-4388-906b-3de4a9b96789 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:35:57.418845 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027c1266-7b5e-4388-906b-3de4a9b96789 service neutron] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:35:57.435928 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 655/1328] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:35:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:35:59.524423 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8d926c-0e81-4145-98a4-ba71eecaf6d6 None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:59.524979 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8d926c-0e81-4145-98a4-ba71eecaf6d6 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:59.524979 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8d926c-0e81-4145-98a4-ba71eecaf6d6 None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:59.526367 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 674/1329] 10.222.0.102 () {54 vars in 931 bytes} [Mon Aug 1 15:35:59 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 15:35:59.532119 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d719cc-6e2e-4406-98b9-4d9be2669e1a None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:59.532536 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d719cc-6e2e-4406-98b9-4d9be2669e1a None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:59.532667 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d719cc-6e2e-4406-98b9-4d9be2669e1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:59.598556 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-51d719cc-6e2e-4406-98b9-4d9be2669e1a None None] MFA Rules not processed for user `d63a704c427d4f18a40f7ba2bdc48254`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:35:59.599757 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-51d719cc-6e2e-4406-98b9-4d9be2669e1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:35:59.700513 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 656/1330] 10.222.0.102 () {58 vars in 1028 bytes} [Mon Aug 1 15:35:59 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:35:59.738847 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8d926c-0e81-4145-98a4-ba71eecaf6d6 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:35:59.740361 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-0a8d926c-0e81-4145-98a4-ba71eecaf6d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:35:59.772984 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:35:59.853328 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8d926c-0e81-4145-98a4-ba71eecaf6d6 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:35:59.939624 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157fb913-043a-480c-9864-4588f7e05738 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a856a413100443939fe9b10daa868518', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:35:59.940248 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157fb913-043a-480c-9864-4588f7e05738 service neutron] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:35:59.941118 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157fb913-043a-480c-9864-4588f7e05738 service neutron] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:35:59.941472 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157fb913-043a-480c-9864-4588f7e05738 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:35:59.943116 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-157fb913-043a-480c-9864-4588f7e05738 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:36:00.025098 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:00.057626 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157fb913-043a-480c-9864-4588f7e05738 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:00.059068 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157fb913-043a-480c-9864-4588f7e05738 service neutron] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:00.078034 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 675/1331] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:35:59 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:36:02.734290 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7328ca41-fa33-4ef8-812d-0a96cd7afeb5 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:02.734850 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7328ca41-fa33-4ef8-812d-0a96cd7afeb5 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:02.734850 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7328ca41-fa33-4ef8-812d-0a96cd7afeb5 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:02.736209 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 657/1332] 10.222.0.102 () {54 vars in 931 bytes} [Mon Aug 1 15:36:02 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 15:36:02.741434 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c3b470-9610-41f0-abbd-38de2affe807 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:02.741880 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c3b470-9610-41f0-abbd-38de2affe807 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:02.741993 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c3b470-9610-41f0-abbd-38de2affe807 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:02.809672 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-b3c3b470-9610-41f0-abbd-38de2affe807 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:36:02.810898 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-b3c3b470-9610-41f0-abbd-38de2affe807 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:36:02.912429 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 676/1333] 10.222.0.102 () {58 vars in 1028 bytes} [Mon Aug 1 15:36:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:36:02.953639 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7328ca41-fa33-4ef8-812d-0a96cd7afeb5 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:02.955183 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-7328ca41-fa33-4ef8-812d-0a96cd7afeb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:36:03.027924 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:03.062457 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7328ca41-fa33-4ef8-812d-0a96cd7afeb5 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:03.135010 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f64d73c-2dce-42c3-96d0-98d67740b296 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a856a413100443939fe9b10daa868518', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:03.135701 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f64d73c-2dce-42c3-96d0-98d67740b296 service neutron] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:03.135982 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f64d73c-2dce-42c3-96d0-98d67740b296 service neutron] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:03.136252 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f64d73c-2dce-42c3-96d0-98d67740b296 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:03.137923 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-3f64d73c-2dce-42c3-96d0-98d67740b296 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:36:03.247386 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f64d73c-2dce-42c3-96d0-98d67740b296 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:03.248815 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f64d73c-2dce-42c3-96d0-98d67740b296 service neutron] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:03.258739 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:03.267409 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 658/1334] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:36:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:36:05.301704 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195c9e55-e608-4ad8-aa5e-377b366d7b5e None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:05.302241 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195c9e55-e608-4ad8-aa5e-377b366d7b5e None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:05.302241 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195c9e55-e608-4ad8-aa5e-377b366d7b5e None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:05.303623 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 677/1335] 10.222.0.102 () {54 vars in 931 bytes} [Mon Aug 1 15:36:05 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 15:36:05.308787 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6abc1c9-906f-4d15-8b0a-63241816e0aa None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:05.309230 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6abc1c9-906f-4d15-8b0a-63241816e0aa None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:05.309363 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6abc1c9-906f-4d15-8b0a-63241816e0aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:05.378612 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-d6abc1c9-906f-4d15-8b0a-63241816e0aa None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:36:05.379842 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-d6abc1c9-906f-4d15-8b0a-63241816e0aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:36:05.474520 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 659/1336] 10.222.0.102 () {58 vars in 1028 bytes} [Mon Aug 1 15:36:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:36:05.513273 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195c9e55-e608-4ad8-aa5e-377b366d7b5e None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:05.515338 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-195c9e55-e608-4ad8-aa5e-377b366d7b5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:36:05.556306 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:05.618928 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195c9e55-e608-4ad8-aa5e-377b366d7b5e None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:05.690959 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5477f1cf-fe70-42df-a306-d82e4b244779 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a856a413100443939fe9b10daa868518', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:05.691558 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5477f1cf-fe70-42df-a306-d82e4b244779 service neutron] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:05.691829 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5477f1cf-fe70-42df-a306-d82e4b244779 service neutron] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:05.692093 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5477f1cf-fe70-42df-a306-d82e4b244779 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:05.693723 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-5477f1cf-fe70-42df-a306-d82e4b244779 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:36:05.775483 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:05.801450 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5477f1cf-fe70-42df-a306-d82e4b244779 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:05.802875 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5477f1cf-fe70-42df-a306-d82e4b244779 service neutron] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:05.821456 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 678/1337] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:36:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:36:08.711523 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e96078-260a-4fd1-9b32-b456d5cb3cfd None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:08.712095 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e96078-260a-4fd1-9b32-b456d5cb3cfd None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:08.712204 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e96078-260a-4fd1-9b32-b456d5cb3cfd None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:08.713563 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 660/1338] 10.222.0.102 () {54 vars in 931 bytes} [Mon Aug 1 15:36:08 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 15:36:08.719083 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d02921-e3df-4903-8248-e3fcdd2ea8af None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:08.719533 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d02921-e3df-4903-8248-e3fcdd2ea8af None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:08.719647 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d02921-e3df-4903-8248-e3fcdd2ea8af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:08.785641 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-92d02921-e3df-4903-8248-e3fcdd2ea8af None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:36:08.786855 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-92d02921-e3df-4903-8248-e3fcdd2ea8af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:36:08.882973 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 679/1339] 10.222.0.102 () {58 vars in 1028 bytes} [Mon Aug 1 15:36:08 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:36:08.922662 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e96078-260a-4fd1-9b32-b456d5cb3cfd None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:08.924202 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-c1e96078-260a-4fd1-9b32-b456d5cb3cfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:36:09.000945 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:09.028178 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e96078-260a-4fd1-9b32-b456d5cb3cfd None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:09.099941 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451b78f5-500f-4532-b7e9-f4e0ff710250 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a856a413100443939fe9b10daa868518', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:09.100557 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451b78f5-500f-4532-b7e9-f4e0ff710250 service neutron] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:09.100837 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451b78f5-500f-4532-b7e9-f4e0ff710250 service neutron] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:09.101146 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451b78f5-500f-4532-b7e9-f4e0ff710250 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:09.102772 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-451b78f5-500f-4532-b7e9-f4e0ff710250 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:36:09.210938 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451b78f5-500f-4532-b7e9-f4e0ff710250 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:09.212377 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451b78f5-500f-4532-b7e9-f4e0ff710250 service neutron] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:09.231110 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 661/1340] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:36:08 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:36:13.447073 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cfa2a7-b440-4503-a0d5-64bea4c823eb None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:13.447572 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cfa2a7-b440-4503-a0d5-64bea4c823eb None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:13.447668 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cfa2a7-b440-4503-a0d5-64bea4c823eb None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:13.449081 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 680/1341] 10.222.0.102 () {54 vars in 931 bytes} [Mon Aug 1 15:36:13 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 15:36:13.454483 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd58a72e-5002-4d66-bd5f-d698d313812c None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:13.454892 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd58a72e-5002-4d66-bd5f-d698d313812c None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:13.455040 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd58a72e-5002-4d66-bd5f-d698d313812c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:13.460802 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:13.524518 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-dd58a72e-5002-4d66-bd5f-d698d313812c None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:36:13.525760 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-dd58a72e-5002-4d66-bd5f-d698d313812c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:36:13.629445 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 662/1342] 10.222.0.102 () {58 vars in 1028 bytes} [Mon Aug 1 15:36:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:36:13.668524 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cfa2a7-b440-4503-a0d5-64bea4c823eb None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:13.670093 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-43cfa2a7-b440-4503-a0d5-64bea4c823eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:36:13.720284 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:13.776911 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cfa2a7-b440-4503-a0d5-64bea4c823eb None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:13.851168 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db61142-fefd-40c6-b567-ed2b4eca8db1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a856a413100443939fe9b10daa868518', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:13.851788 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db61142-fefd-40c6-b567-ed2b4eca8db1 service neutron] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:13.852064 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db61142-fefd-40c6-b567-ed2b4eca8db1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:13.852341 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db61142-fefd-40c6-b567-ed2b4eca8db1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:13.854005 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-9db61142-fefd-40c6-b567-ed2b4eca8db1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:36:13.950813 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:13.968593 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db61142-fefd-40c6-b567-ed2b4eca8db1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:13.970107 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db61142-fefd-40c6-b567-ed2b4eca8db1 service neutron] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:13.989409 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 681/1343] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:36:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:36:17.098019 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3f7792-3e68-4ad7-ad44-38ed34e8e77e None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:17.098556 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3f7792-3e68-4ad7-ad44-38ed34e8e77e None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:17.098556 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3f7792-3e68-4ad7-ad44-38ed34e8e77e None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:17.099938 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 663/1344] 10.222.0.102 () {54 vars in 931 bytes} [Mon Aug 1 15:36:17 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 15:36:17.105419 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e1a299-22b7-407a-95b1-69fd4503e4c9 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:17.105821 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e1a299-22b7-407a-95b1-69fd4503e4c9 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:17.105928 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e1a299-22b7-407a-95b1-69fd4503e4c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:17.174263 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-a2e1a299-22b7-407a-95b1-69fd4503e4c9 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:36:17.175486 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-a2e1a299-22b7-407a-95b1-69fd4503e4c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:36:17.272232 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 682/1345] 10.222.0.102 () {58 vars in 1028 bytes} [Mon Aug 1 15:36:17 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:36:17.311016 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3f7792-3e68-4ad7-ad44-38ed34e8e77e None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:17.312595 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-ab3f7792-3e68-4ad7-ad44-38ed34e8e77e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:36:17.399986 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:17.417061 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3f7792-3e68-4ad7-ad44-38ed34e8e77e None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:17.491892 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd132739-263b-4493-8302-8c668e2ab2d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a856a413100443939fe9b10daa868518', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:17.492592 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd132739-263b-4493-8302-8c668e2ab2d4 service neutron] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:17.492897 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd132739-263b-4493-8302-8c668e2ab2d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:17.493170 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd132739-263b-4493-8302-8c668e2ab2d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:17.495535 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-dd132739-263b-4493-8302-8c668e2ab2d4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:36:17.608949 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd132739-263b-4493-8302-8c668e2ab2d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:17.610414 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd132739-263b-4493-8302-8c668e2ab2d4 service neutron] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:17.629161 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 664/1346] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:36:17 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:36:22.069534 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bbd236-395e-42dc-b704-48bb62a31c7b None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:22.070081 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bbd236-395e-42dc-b704-48bb62a31c7b None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:22.070081 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bbd236-395e-42dc-b704-48bb62a31c7b None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:22.071581 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 683/1347] 10.222.0.102 () {54 vars in 931 bytes} [Mon Aug 1 15:36:22 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 15:36:22.078879 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e1e5de-3d07-4895-a673-ea8b78058c0e None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:22.079336 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e1e5de-3d07-4895-a673-ea8b78058c0e None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:22.079554 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e1e5de-3d07-4895-a673-ea8b78058c0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:22.097547 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:22.170401 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-26e1e5de-3d07-4895-a673-ea8b78058c0e None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:36:22.171900 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-26e1e5de-3d07-4895-a673-ea8b78058c0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:36:22.288738 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 665/1348] 10.222.0.102 () {58 vars in 1028 bytes} [Mon Aug 1 15:36:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:36:22.327275 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bbd236-395e-42dc-b704-48bb62a31c7b None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:22.329168 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-92bbd236-395e-42dc-b704-48bb62a31c7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:36:22.394440 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:22.444254 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bbd236-395e-42dc-b704-48bb62a31c7b None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:22.523851 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c892a1a-a1e0-4bbd-93a7-84d4148b5c10 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a856a413100443939fe9b10daa868518', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:22.524471 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c892a1a-a1e0-4bbd-93a7-84d4148b5c10 service neutron] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:22.524746 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c892a1a-a1e0-4bbd-93a7-84d4148b5c10 service neutron] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:22.525052 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c892a1a-a1e0-4bbd-93a7-84d4148b5c10 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:22.526694 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-3c892a1a-a1e0-4bbd-93a7-84d4148b5c10 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:36:22.653099 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:22.657710 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c892a1a-a1e0-4bbd-93a7-84d4148b5c10 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:22.659162 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c892a1a-a1e0-4bbd-93a7-84d4148b5c10 service neutron] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:22.677601 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 684/1349] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:36:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:36:27.569742 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbf7288-60ee-46bf-a7e6-a6f4196c9e09 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:27.570922 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbf7288-60ee-46bf-a7e6-a6f4196c9e09 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:27.571441 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbf7288-60ee-46bf-a7e6-a6f4196c9e09 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:27.573245 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 666/1350] 10.222.0.102 () {54 vars in 926 bytes} [Mon Aug 1 15:36:27 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 15:36:27.579836 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2952545e-65b8-4c01-abd9-1b36bba738f1 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:27.580721 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2952545e-65b8-4c01-abd9-1b36bba738f1 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:27.581495 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2952545e-65b8-4c01-abd9-1b36bba738f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:27.714433 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-2952545e-65b8-4c01-abd9-1b36bba738f1 None None] MFA Rules not processed for user `b78f5749fe9c46a389c88bb9c222cc73`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:36:27.716826 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-2952545e-65b8-4c01-abd9-1b36bba738f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:36:27.852641 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 685/1351] 10.222.0.102 () {58 vars in 1023 bytes} [Mon Aug 1 15:36:27 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:36:31.940513 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616f0906-5300-4c22-8b09-8336eed2532c None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:31.943270 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616f0906-5300-4c22-8b09-8336eed2532c None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:31.943270 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616f0906-5300-4c22-8b09-8336eed2532c None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:31.943270 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 667/1352] 10.222.0.102 () {54 vars in 926 bytes} [Mon Aug 1 15:36:31 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 15:36:31.948652 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7c0407-0657-4e9f-a1d5-e323c6d81d30 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:31.949149 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7c0407-0657-4e9f-a1d5-e323c6d81d30 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:31.949236 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7c0407-0657-4e9f-a1d5-e323c6d81d30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:32.020476 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:32.044749 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-5c7c0407-0657-4e9f-a1d5-e323c6d81d30 None None] MFA Rules not processed for user `b78f5749fe9c46a389c88bb9c222cc73`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:36:32.046847 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-5c7c0407-0657-4e9f-a1d5-e323c6d81d30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:36:32.160713 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 686/1353] 10.222.0.102 () {58 vars in 1023 bytes} [Mon Aug 1 15:36:31 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:36:32.286751 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=59 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:33.505553 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4b426e-7f53-4927-99b3-20cbc3f1afc3 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:33.506237 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4b426e-7f53-4927-99b3-20cbc3f1afc3 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:33.506237 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4b426e-7f53-4927-99b3-20cbc3f1afc3 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:33.507496 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 668/1354] 10.222.0.102 () {54 vars in 926 bytes} [Mon Aug 1 15:36:33 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 15:36:33.512702 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c903896-219e-4ae5-b6d3-41cdf18210a3 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:33.513156 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c903896-219e-4ae5-b6d3-41cdf18210a3 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:33.513357 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c903896-219e-4ae5-b6d3-41cdf18210a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:33.591576 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-1c903896-219e-4ae5-b6d3-41cdf18210a3 None None] MFA Rules not processed for user `b78f5749fe9c46a389c88bb9c222cc73`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:36:33.593448 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-1c903896-219e-4ae5-b6d3-41cdf18210a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:36:33.635407 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:33.701717 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 687/1355] 10.222.0.102 () {58 vars in 1023 bytes} [Mon Aug 1 15:36:33 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:36:37.063945 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166eee84-8199-405d-bec8-405e2662306a None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:37.064975 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166eee84-8199-405d-bec8-405e2662306a None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:37.065445 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166eee84-8199-405d-bec8-405e2662306a None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:37.071914 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 669/1356] 10.222.0.102 () {54 vars in 931 bytes} [Mon Aug 1 15:36:37 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 15:36:37.073969 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637c7568-0751-4f6d-92da-addfc2c6515b None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:37.074392 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637c7568-0751-4f6d-92da-addfc2c6515b None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:37.075373 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637c7568-0751-4f6d-92da-addfc2c6515b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:37.157110 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-637c7568-0751-4f6d-92da-addfc2c6515b None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:36:37.158315 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-637c7568-0751-4f6d-92da-addfc2c6515b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:36:37.266871 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 688/1357] 10.222.0.102 () {58 vars in 1028 bytes} [Mon Aug 1 15:36:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:36:37.327159 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4284a18d-8e65-43b9-9d3f-416113cdc701 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:37.327865 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4284a18d-8e65-43b9-9d3f-416113cdc701 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:37.328643 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4284a18d-8e65-43b9-9d3f-416113cdc701 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:37.331817 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 670/1358] 10.222.0.102 () {54 vars in 967 bytes} [Mon Aug 1 15:36:37 2022] GET /identity => generated 271 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 15:36:37.339969 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21a08f7-b247-4c0f-b491-a87c37bc440e None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:37.340254 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21a08f7-b247-4c0f-b491-a87c37bc440e None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:37.340597 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21a08f7-b247-4c0f-b491-a87c37bc440e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:37.357631 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:37.425337 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-b21a08f7-b247-4c0f-b491-a87c37bc440e None None] MFA Rules not processed for user `77b43f1ee8cc4be3907a494abe90c1cc`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:36:37.426526 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-b21a08f7-b247-4c0f-b491-a87c37bc440e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:36:37.550834 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 689/1359] 10.222.0.102 () {58 vars in 1064 bytes} [Mon Aug 1 15:36:37 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:36:37.558901 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4284a18d-8e65-43b9-9d3f-416113cdc701 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:37.560481 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-4284a18d-8e65-43b9-9d3f-416113cdc701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:36:37.713532 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4284a18d-8e65-43b9-9d3f-416113cdc701 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:37.792591 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:37.833783 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468588d0-92dc-404f-9c9f-f35fce7feddb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77b43f1ee8cc4be3907a494abe90c1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:37.834404 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468588d0-92dc-404f-9c9f-f35fce7feddb service nova] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:37.834790 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468588d0-92dc-404f-9c9f-f35fce7feddb service nova] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:37.835069 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468588d0-92dc-404f-9c9f-f35fce7feddb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:37.836705 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-468588d0-92dc-404f-9c9f-f35fce7feddb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:36:37.943784 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468588d0-92dc-404f-9c9f-f35fce7feddb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:37.945435 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468588d0-92dc-404f-9c9f-f35fce7feddb service nova] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:37.965560 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 671/1360] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:36:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:36:40.188130 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bc94d6-b72a-48a7-8319-d16c307f1773 None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:40.188682 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bc94d6-b72a-48a7-8319-d16c307f1773 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:40.188682 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bc94d6-b72a-48a7-8319-d16c307f1773 None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:40.190223 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 690/1361] 10.222.0.102 () {54 vars in 931 bytes} [Mon Aug 1 15:36:40 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 15:36:40.195134 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaab59b-4f4e-4a93-83a1-2a8a356ffc46 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:40.195520 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaab59b-4f4e-4a93-83a1-2a8a356ffc46 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:40.195683 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaab59b-4f4e-4a93-83a1-2a8a356ffc46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:40.275073 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-dcaab59b-4f4e-4a93-83a1-2a8a356ffc46 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:36:40.276434 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-dcaab59b-4f4e-4a93-83a1-2a8a356ffc46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:36:40.321084 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:40.383352 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 672/1362] 10.222.0.102 () {58 vars in 1028 bytes} [Mon Aug 1 15:36:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:36:40.427714 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bc94d6-b72a-48a7-8319-d16c307f1773 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:40.429296 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-91bc94d6-b72a-48a7-8319-d16c307f1773 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:36:40.503801 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:40.597476 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bc94d6-b72a-48a7-8319-d16c307f1773 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:40.739266 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783a81ea-d20f-49b6-811d-e6221fb91637 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77b43f1ee8cc4be3907a494abe90c1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:40.740070 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783a81ea-d20f-49b6-811d-e6221fb91637 service nova] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:40.740442 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783a81ea-d20f-49b6-811d-e6221fb91637 service nova] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:40.740907 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783a81ea-d20f-49b6-811d-e6221fb91637 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:40.743377 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-783a81ea-d20f-49b6-811d-e6221fb91637 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:36:40.774845 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:40.892276 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783a81ea-d20f-49b6-811d-e6221fb91637 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:40.893932 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783a81ea-d20f-49b6-811d-e6221fb91637 service nova] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:40.914427 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 691/1363] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:36:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 487 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:36:43.449796 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc7af15-2385-44c1-b785-950fa5c0e333 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:43.450775 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc7af15-2385-44c1-b785-950fa5c0e333 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:43.451213 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc7af15-2385-44c1-b785-950fa5c0e333 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:43.453564 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 673/1364] 10.222.0.102 () {54 vars in 931 bytes} [Mon Aug 1 15:36:43 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 15:36:43.459083 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1165a2ea-429d-44f0-a706-c5b84512005d None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:43.459547 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1165a2ea-429d-44f0-a706-c5b84512005d None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:43.459946 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1165a2ea-429d-44f0-a706-c5b84512005d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:43.567301 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-1165a2ea-429d-44f0-a706-c5b84512005d None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:36:43.568836 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-1165a2ea-429d-44f0-a706-c5b84512005d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:36:43.677103 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:43.680886 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 692/1365] 10.222.0.102 () {58 vars in 1028 bytes} [Mon Aug 1 15:36:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:36:43.726775 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cead8269-3a35-44db-b390-0bd55a6acdc4 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:43.727251 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cead8269-3a35-44db-b390-0bd55a6acdc4 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:43.727625 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cead8269-3a35-44db-b390-0bd55a6acdc4 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:43.729413 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 674/1366] 10.222.0.102 () {54 vars in 967 bytes} [Mon Aug 1 15:36:43 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 15:36:43.735519 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2ae5a6-9f4b-4b8e-bd83-9577b0841e7b None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:43.735894 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2ae5a6-9f4b-4b8e-bd83-9577b0841e7b None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:43.736219 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2ae5a6-9f4b-4b8e-bd83-9577b0841e7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:43.822411 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-5e2ae5a6-9f4b-4b8e-bd83-9577b0841e7b None None] MFA Rules not processed for user `77b43f1ee8cc4be3907a494abe90c1cc`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:36:43.823711 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-5e2ae5a6-9f4b-4b8e-bd83-9577b0841e7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:36:43.970357 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 693/1367] 10.222.0.102 () {58 vars in 1064 bytes} [Mon Aug 1 15:36:43 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:36:43.978756 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cead8269-3a35-44db-b390-0bd55a6acdc4 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:43.980281 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-cead8269-3a35-44db-b390-0bd55a6acdc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:36:44.134889 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cead8269-3a35-44db-b390-0bd55a6acdc4 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:44.156154 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:44.254904 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5dea37-9287-4d78-9600-e2192aab660e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77b43f1ee8cc4be3907a494abe90c1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:44.255598 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5dea37-9287-4d78-9600-e2192aab660e service nova] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:44.255972 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5dea37-9287-4d78-9600-e2192aab660e service nova] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:44.256331 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5dea37-9287-4d78-9600-e2192aab660e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:44.258155 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-ff5dea37-9287-4d78-9600-e2192aab660e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:36:44.357251 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5dea37-9287-4d78-9600-e2192aab660e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:44.359579 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5dea37-9287-4d78-9600-e2192aab660e service nova] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:44.379443 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 675/1368] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:36:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 15:36:45.300339 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67891d66-4b53-4cca-a34c-22c527cc9e0a None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:45.300963 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67891d66-4b53-4cca-a34c-22c527cc9e0a None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:45.300963 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67891d66-4b53-4cca-a34c-22c527cc9e0a None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:45.302287 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 694/1369] 10.222.0.102 () {54 vars in 931 bytes} [Mon Aug 1 15:36:45 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 15:36:45.307436 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a205cf1a-e68e-40b0-8a6b-53571a11d191 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:45.307874 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a205cf1a-e68e-40b0-8a6b-53571a11d191 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:45.307998 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a205cf1a-e68e-40b0-8a6b-53571a11d191 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:45.342127 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:45.379080 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-a205cf1a-e68e-40b0-8a6b-53571a11d191 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:36:45.380651 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-a205cf1a-e68e-40b0-8a6b-53571a11d191 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:36:45.484424 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 676/1370] 10.222.0.102 () {58 vars in 1028 bytes} [Mon Aug 1 15:36:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:36:45.840588 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a2d6a2-7599-41fb-bdba-80aac54106be None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:45.840588 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a2d6a2-7599-41fb-bdba-80aac54106be None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:45.840588 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a2d6a2-7599-41fb-bdba-80aac54106be None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:45.840588 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 695/1371] 10.222.0.102 () {54 vars in 969 bytes} [Mon Aug 1 15:36:45 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 15:36:45.845227 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f184daeb-d0f4-4939-b28f-1e5029651334 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:45.845617 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f184daeb-d0f4-4939-b28f-1e5029651334 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:45.845919 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f184daeb-d0f4-4939-b28f-1e5029651334 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:45.931561 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-f184daeb-d0f4-4939-b28f-1e5029651334 None None] MFA Rules not processed for user `ff810b37183c4729859c1b05edff1703`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:36:45.932771 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-f184daeb-d0f4-4939-b28f-1e5029651334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:36:45.982504 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:46.013952 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 677/1372] 10.222.0.102 () {58 vars in 1066 bytes} [Mon Aug 1 15:36:45 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:36:46.021925 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a2d6a2-7599-41fb-bdba-80aac54106be None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:46.023427 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-39a2d6a2-7599-41fb-bdba-80aac54106be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:36:46.079116 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:46.139354 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a2d6a2-7599-41fb-bdba-80aac54106be None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:46.219341 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d36e26-4422-4443-827e-accd8dc647ef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff810b37183c4729859c1b05edff1703', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:46.219938 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d36e26-4422-4443-827e-accd8dc647ef service cinder] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:46.220210 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d36e26-4422-4443-827e-accd8dc647ef service cinder] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:46.220473 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d36e26-4422-4443-827e-accd8dc647ef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:46.222118 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-f2d36e26-4422-4443-827e-accd8dc647ef service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:36:46.324438 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:46.345332 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d36e26-4422-4443-827e-accd8dc647ef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:46.345332 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d36e26-4422-4443-827e-accd8dc647ef service cinder] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:46.366053 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 696/1373] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:36:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:36:46.644143 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c714a5-9219-412d-9d62-c5bded475f25 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:46.644665 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c714a5-9219-412d-9d62-c5bded475f25 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:46.645285 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c714a5-9219-412d-9d62-c5bded475f25 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:46.646843 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 678/1374] 10.222.0.102 () {54 vars in 931 bytes} [Mon Aug 1 15:36:46 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 15:36:46.651313 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751ab85a-3cc2-4b74-a02f-6bab164e5a93 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:46.651489 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751ab85a-3cc2-4b74-a02f-6bab164e5a93 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:46.651949 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751ab85a-3cc2-4b74-a02f-6bab164e5a93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:46.740798 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-751ab85a-3cc2-4b74-a02f-6bab164e5a93 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:36:46.742274 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-751ab85a-3cc2-4b74-a02f-6bab164e5a93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:36:46.860131 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 697/1375] 10.222.0.102 () {58 vars in 1028 bytes} [Mon Aug 1 15:36:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:36:46.905155 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c714a5-9219-412d-9d62-c5bded475f25 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:46.906930 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-99c714a5-9219-412d-9d62-c5bded475f25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:36:47.056790 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c714a5-9219-412d-9d62-c5bded475f25 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:47.106932 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:47.169835 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de300c8-6db5-466c-9eac-5d40efbbdd75 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77b43f1ee8cc4be3907a494abe90c1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:47.170416 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de300c8-6db5-466c-9eac-5d40efbbdd75 service nova] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:47.171288 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de300c8-6db5-466c-9eac-5d40efbbdd75 service nova] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:47.171569 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de300c8-6db5-466c-9eac-5d40efbbdd75 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:47.173236 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-4de300c8-6db5-466c-9eac-5d40efbbdd75 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:36:47.261195 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de300c8-6db5-466c-9eac-5d40efbbdd75 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:47.262820 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de300c8-6db5-466c-9eac-5d40efbbdd75 service nova] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:47.281297 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 679/1376] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:36:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:36:49.471810 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddbcd03-03f7-4ee0-bec5-797d3ba0a586 None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:49.471810 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddbcd03-03f7-4ee0-bec5-797d3ba0a586 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:49.471810 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddbcd03-03f7-4ee0-bec5-797d3ba0a586 None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:49.472505 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 698/1377] 10.222.0.102 () {54 vars in 931 bytes} [Mon Aug 1 15:36:49 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 15:36:49.477300 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0774e6-be65-4daf-af89-b82e083a7e0a None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:49.477727 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0774e6-be65-4daf-af89-b82e083a7e0a None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:49.477862 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0774e6-be65-4daf-af89-b82e083a7e0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:49.557111 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-4e0774e6-be65-4daf-af89-b82e083a7e0a None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:36:49.558237 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-4e0774e6-be65-4daf-af89-b82e083a7e0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:36:49.564835 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:49.659008 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 680/1378] 10.222.0.102 () {58 vars in 1028 bytes} [Mon Aug 1 15:36:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:36:49.702643 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddbcd03-03f7-4ee0-bec5-797d3ba0a586 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:49.704168 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-3ddbcd03-03f7-4ee0-bec5-797d3ba0a586 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:36:49.766322 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:49.867345 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddbcd03-03f7-4ee0-bec5-797d3ba0a586 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:50.027440 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9b237c-50b8-4c49-9f1f-502d2b48af31 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77b43f1ee8cc4be3907a494abe90c1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:50.028633 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9b237c-50b8-4c49-9f1f-502d2b48af31 service nova] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:50.029016 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9b237c-50b8-4c49-9f1f-502d2b48af31 service nova] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:50.029357 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9b237c-50b8-4c49-9f1f-502d2b48af31 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:50.031444 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-9e9b237c-50b8-4c49-9f1f-502d2b48af31 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:36:50.057734 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:50.136122 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9b237c-50b8-4c49-9f1f-502d2b48af31 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:50.137842 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9b237c-50b8-4c49-9f1f-502d2b48af31 service nova] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:50.160777 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 699/1379] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:36:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:36:52.498980 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5013ef-fbb5-4a44-b0ad-22a646331d12 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:52.500030 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5013ef-fbb5-4a44-b0ad-22a646331d12 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:52.500030 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5013ef-fbb5-4a44-b0ad-22a646331d12 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:52.501546 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 681/1380] 10.222.0.102 () {54 vars in 931 bytes} [Mon Aug 1 15:36:52 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 15:36:52.506552 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455936b7-8615-46e4-a58b-a1a93b4316ed None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:52.506971 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455936b7-8615-46e4-a58b-a1a93b4316ed None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:52.507102 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455936b7-8615-46e4-a58b-a1a93b4316ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:52.576251 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-455936b7-8615-46e4-a58b-a1a93b4316ed None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:36:52.577766 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-455936b7-8615-46e4-a58b-a1a93b4316ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:36:52.675334 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:52.681713 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 700/1381] 10.222.0.102 () {58 vars in 1028 bytes} [Mon Aug 1 15:36:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:36:52.726733 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5013ef-fbb5-4a44-b0ad-22a646331d12 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:52.728392 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-5c5013ef-fbb5-4a44-b0ad-22a646331d12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:36:52.898354 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:52.909314 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5013ef-fbb5-4a44-b0ad-22a646331d12 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:53.033508 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f80958c-eca6-4e96-b348-9e340d848911 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77b43f1ee8cc4be3907a494abe90c1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:53.034515 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f80958c-eca6-4e96-b348-9e340d848911 service nova] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:53.035009 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f80958c-eca6-4e96-b348-9e340d848911 service nova] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:53.035499 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f80958c-eca6-4e96-b348-9e340d848911 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:53.037492 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-5f80958c-eca6-4e96-b348-9e340d848911 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:36:53.141471 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f80958c-eca6-4e96-b348-9e340d848911 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:53.143782 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f80958c-eca6-4e96-b348-9e340d848911 service nova] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:53.155468 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:53.164635 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 682/1382] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:36:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:36:55.757731 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5336151-71e3-451b-92f5-48b78b9f4d23 None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:55.758267 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5336151-71e3-451b-92f5-48b78b9f4d23 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:55.758267 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5336151-71e3-451b-92f5-48b78b9f4d23 None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:55.759625 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 701/1383] 10.222.0.102 () {54 vars in 931 bytes} [Mon Aug 1 15:36:55 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 15:36:55.766016 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1399bd25-a7af-4eef-8add-74f580df819a None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:55.766448 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1399bd25-a7af-4eef-8add-74f580df819a None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:55.766714 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1399bd25-a7af-4eef-8add-74f580df819a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:55.834144 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-1399bd25-a7af-4eef-8add-74f580df819a None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:36:55.835429 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-1399bd25-a7af-4eef-8add-74f580df819a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:36:55.937376 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 683/1384] 10.222.0.102 () {58 vars in 1028 bytes} [Mon Aug 1 15:36:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:36:55.981476 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5336151-71e3-451b-92f5-48b78b9f4d23 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:55.983601 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-c5336151-71e3-451b-92f5-48b78b9f4d23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:36:56.175623 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5336151-71e3-451b-92f5-48b78b9f4d23 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:56.297596 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:56.345917 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d9e02f-f762-4645-aafe-292946197246 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77b43f1ee8cc4be3907a494abe90c1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:56.346562 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d9e02f-f762-4645-aafe-292946197246 service nova] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:56.346864 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d9e02f-f762-4645-aafe-292946197246 service nova] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:56.347137 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d9e02f-f762-4645-aafe-292946197246 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:56.348824 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-c2d9e02f-f762-4645-aafe-292946197246 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:36:56.468481 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d9e02f-f762-4645-aafe-292946197246 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:56.471619 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d9e02f-f762-4645-aafe-292946197246 service nova] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:56.495267 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 702/1385] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:36:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 515 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:36:58.705784 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f42df60-cdee-4411-a63a-9d37bd611403 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:58.706426 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f42df60-cdee-4411-a63a-9d37bd611403 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:58.706426 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f42df60-cdee-4411-a63a-9d37bd611403 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:58.707895 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 684/1386] 10.222.0.102 () {54 vars in 931 bytes} [Mon Aug 1 15:36:58 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 15:36:58.713593 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534d4740-d7ff-4c2e-a80e-e11ab840a92d None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:58.714019 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534d4740-d7ff-4c2e-a80e-e11ab840a92d None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:58.714302 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534d4740-d7ff-4c2e-a80e-e11ab840a92d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:58.793278 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-534d4740-d7ff-4c2e-a80e-e11ab840a92d None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:36:58.794534 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-534d4740-d7ff-4c2e-a80e-e11ab840a92d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:36:58.828956 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:58.898110 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 703/1387] 10.222.0.102 () {58 vars in 1028 bytes} [Mon Aug 1 15:36:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:36:58.946010 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f42df60-cdee-4411-a63a-9d37bd611403 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:36:58.947569 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-0f42df60-cdee-4411-a63a-9d37bd611403 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:36:59.034283 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:59.108587 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f42df60-cdee-4411-a63a-9d37bd611403 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:36:59.254873 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3912394-e4ba-4221-bf05-ebc33d1da3f9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77b43f1ee8cc4be3907a494abe90c1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:36:59.255758 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3912394-e4ba-4221-bf05-ebc33d1da3f9 service nova] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:36:59.256106 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3912394-e4ba-4221-bf05-ebc33d1da3f9 service nova] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:36:59.256466 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3912394-e4ba-4221-bf05-ebc33d1da3f9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:36:59.258722 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-b3912394-e4ba-4221-bf05-ebc33d1da3f9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:36:59.301084 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:59.353320 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3912394-e4ba-4221-bf05-ebc33d1da3f9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:36:59.354958 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3912394-e4ba-4221-bf05-ebc33d1da3f9 service nova] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:36:59.377287 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 685/1388] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:36:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:37:01.542188 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8563ac09-2b20-4c8f-9268-e4ea90d59be7 None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:01.543013 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8563ac09-2b20-4c8f-9268-e4ea90d59be7 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:01.543199 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8563ac09-2b20-4c8f-9268-e4ea90d59be7 None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:01.544699 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 704/1389] 10.222.0.102 () {54 vars in 931 bytes} [Mon Aug 1 15:37:01 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 15:37:01.550157 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf81df6-8c7b-4187-9874-0b069837a72a None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:01.550571 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf81df6-8c7b-4187-9874-0b069837a72a None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:01.550779 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf81df6-8c7b-4187-9874-0b069837a72a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:01.617707 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-cbf81df6-8c7b-4187-9874-0b069837a72a None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:37:01.619184 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-cbf81df6-8c7b-4187-9874-0b069837a72a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:37:01.719558 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 686/1390] 10.222.0.102 () {58 vars in 1028 bytes} [Mon Aug 1 15:37:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:37:01.763150 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8563ac09-2b20-4c8f-9268-e4ea90d59be7 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:01.765447 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-8563ac09-2b20-4c8f-9268-e4ea90d59be7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:37:01.834907 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b7851e-8b4f-4b24-b26c-772a49da0ef8 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:01.835189 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b7851e-8b4f-4b24-b26c-772a49da0ef8 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:01.835471 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b7851e-8b4f-4b24-b26c-772a49da0ef8 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:01.836873 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 687/1391] 10.222.0.102 () {54 vars in 931 bytes} [Mon Aug 1 15:37:01 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 15:37:01.841638 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d95c46-3fbe-44c0-a1d2-e5d98ec99018 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:01.841921 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d95c46-3fbe-44c0-a1d2-e5d98ec99018 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:01.842715 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d95c46-3fbe-44c0-a1d2-e5d98ec99018 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:01.857986 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:01.910766 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-b0d95c46-3fbe-44c0-a1d2-e5d98ec99018 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:37:01.911994 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-b0d95c46-3fbe-44c0-a1d2-e5d98ec99018 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:37:01.921559 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8563ac09-2b20-4c8f-9268-e4ea90d59be7 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:01.941159 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:02.011798 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 688/1392] 10.222.0.102 () {58 vars in 1028 bytes} [Mon Aug 1 15:37:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 15:37:02.051760 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3da796-b763-4245-9102-0a394855a281 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77b43f1ee8cc4be3907a494abe90c1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:02.052400 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3da796-b763-4245-9102-0a394855a281 service nova] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:02.052659 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3da796-b763-4245-9102-0a394855a281 service nova] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:02.052968 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3da796-b763-4245-9102-0a394855a281 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:02.055263 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-7d3da796-b763-4245-9102-0a394855a281 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:37:02.068902 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1326fb-cbcf-492b-b94f-6786fa855295 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:02.069195 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1326fb-cbcf-492b-b94f-6786fa855295 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:02.069591 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1326fb-cbcf-492b-b94f-6786fa855295 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:02.070974 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 689/1393] 10.222.0.102 () {54 vars in 971 bytes} [Mon Aug 1 15:37:02 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 01 15:37:02.075974 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9052ce0e-e219-40d9-bb39-ce6640954252 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:02.076252 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9052ce0e-e219-40d9-bb39-ce6640954252 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:02.076882 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9052ce0e-e219-40d9-bb39-ce6640954252 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:02.152305 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-9052ce0e-e219-40d9-bb39-ce6640954252 None None] MFA Rules not processed for user `613da2657ae34558b355cac53c8bf29a`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:37:02.152632 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3da796-b763-4245-9102-0a394855a281 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:02.153548 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-9052ce0e-e219-40d9-bb39-ce6640954252 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:37:02.154273 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3da796-b763-4245-9102-0a394855a281 service nova] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:02.173230 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 705/1394] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:37:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:37:02.189696 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:02.230712 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 690/1395] 10.222.0.102 () {58 vars in 1068 bytes} [Mon Aug 1 15:37:02 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 15:37:02.239118 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3da796-b763-4245-9102-0a394855a281 service nova] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:02.240322 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-7d3da796-b763-4245-9102-0a394855a281 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:37:02.263129 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:02.318080 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3da796-b763-4245-9102-0a394855a281 service nova] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:02.393447 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9972ef-9af3-4821-94c2-39aaecefe11b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '613da2657ae34558b355cac53c8bf29a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:02.394081 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9972ef-9af3-4821-94c2-39aaecefe11b service glance] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:02.394397 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9972ef-9af3-4821-94c2-39aaecefe11b service glance] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:02.394656 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9972ef-9af3-4821-94c2-39aaecefe11b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:02.396297 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-cb9972ef-9af3-4821-94c2-39aaecefe11b service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:37:02.509738 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:02.529588 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9972ef-9af3-4821-94c2-39aaecefe11b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:02.529588 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9972ef-9af3-4821-94c2-39aaecefe11b service glance] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:02.545935 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 706/1396] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:37:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:37:03.404488 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c936083d-707a-4acf-a54e-b227c74d02b5 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:03.405172 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c936083d-707a-4acf-a54e-b227c74d02b5 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:03.405303 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c936083d-707a-4acf-a54e-b227c74d02b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:03.473946 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-c936083d-707a-4acf-a54e-b227c74d02b5 None None] MFA Rules not processed for user `ae8514df55144c9086ed98ba44efbbd4`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:37:03.475117 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-c936083d-707a-4acf-a54e-b227c74d02b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:37:03.572502 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 691/1397] 10.222.0.102 () {58 vars in 1014 bytes} [Mon Aug 1 15:37:03 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:37:03.615820 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7799231-b718-4908-b6f5-440c3ee2e9b1 None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:03.616326 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7799231-b718-4908-b6f5-440c3ee2e9b1 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:03.616429 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7799231-b718-4908-b6f5-440c3ee2e9b1 None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:03.617820 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 707/1398] 10.222.0.102 () {54 vars in 948 bytes} [Mon Aug 1 15:37:03 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 15:37:03.623960 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f311ddff-11c0-4b97-8357-d16b6fe30e8f None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:03.624244 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f311ddff-11c0-4b97-8357-d16b6fe30e8f None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:03.624516 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f311ddff-11c0-4b97-8357-d16b6fe30e8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:03.682141 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:03.700406 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-f311ddff-11c0-4b97-8357-d16b6fe30e8f None None] MFA Rules not processed for user `90673f47354f4403aa0e12e3658441c8`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:37:03.702448 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-f311ddff-11c0-4b97-8357-d16b6fe30e8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:37:03.809510 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 692/1399] 10.222.0.102 () {58 vars in 1045 bytes} [Mon Aug 1 15:37:03 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 15:37:03.818855 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7799231-b718-4908-b6f5-440c3ee2e9b1 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:03.820402 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-f7799231-b718-4908-b6f5-440c3ee2e9b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:37:03.962704 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7799231-b718-4908-b6f5-440c3ee2e9b1 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:04.029132 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:04.069681 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fb6338-942f-4a23-b3e6-6c0ff1c71efa service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90673f47354f4403aa0e12e3658441c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:04.070214 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fb6338-942f-4a23-b3e6-6c0ff1c71efa service swift] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:04.070486 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fb6338-942f-4a23-b3e6-6c0ff1c71efa service swift] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:04.070753 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fb6338-942f-4a23-b3e6-6c0ff1c71efa service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:04.072397 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-24fb6338-942f-4a23-b3e6-6c0ff1c71efa service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:37:04.160986 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fb6338-942f-4a23-b3e6-6c0ff1c71efa service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:04.162606 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fb6338-942f-4a23-b3e6-6c0ff1c71efa service swift] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:04.170764 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 708/1400] 10.222.0.102 () {60 vars in 1389 bytes} [Mon Aug 1 15:37:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 01 15:37:04.394720 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012ac0bb-8dea-4d68-9cb0-65c2e5373511 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:04.394924 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012ac0bb-8dea-4d68-9cb0-65c2e5373511 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:04.395181 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012ac0bb-8dea-4d68-9cb0-65c2e5373511 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:04.396586 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 693/1401] 10.222.0.102 () {54 vars in 931 bytes} [Mon Aug 1 15:37:04 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 15:37:04.402122 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010535c9-b314-44e2-ac22-68377f45752d None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:04.402415 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010535c9-b314-44e2-ac22-68377f45752d None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:04.402689 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010535c9-b314-44e2-ac22-68377f45752d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:04.473458 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-010535c9-b314-44e2-ac22-68377f45752d None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:37:04.474685 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-010535c9-b314-44e2-ac22-68377f45752d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:37:04.531310 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:04.577548 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 709/1402] 10.222.0.102 () {58 vars in 1028 bytes} [Mon Aug 1 15:37:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:37:04.621449 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012ac0bb-8dea-4d68-9cb0-65c2e5373511 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:04.623302 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-012ac0bb-8dea-4d68-9cb0-65c2e5373511 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:37:04.753326 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:04.806134 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012ac0bb-8dea-4d68-9cb0-65c2e5373511 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:04.946930 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0afe05-3216-489b-8491-bf1ac1b17e2a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77b43f1ee8cc4be3907a494abe90c1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:04.947549 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0afe05-3216-489b-8491-bf1ac1b17e2a service nova] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:04.947825 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0afe05-3216-489b-8491-bf1ac1b17e2a service nova] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:04.948096 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0afe05-3216-489b-8491-bf1ac1b17e2a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:04.949758 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-5d0afe05-3216-489b-8491-bf1ac1b17e2a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:37:05.040006 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:05.061568 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0afe05-3216-489b-8491-bf1ac1b17e2a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:05.063724 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0afe05-3216-489b-8491-bf1ac1b17e2a service nova] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:05.089287 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 694/1403] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:37:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 468 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:37:07.384330 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c4efb3-8955-490e-89bf-e711a2a9e66f None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:07.385035 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c4efb3-8955-490e-89bf-e711a2a9e66f None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:07.385035 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c4efb3-8955-490e-89bf-e711a2a9e66f None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:07.386672 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 710/1404] 10.222.0.102 () {54 vars in 931 bytes} [Mon Aug 1 15:37:07 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 15:37:07.391460 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd090ad-3267-4e5a-a39e-c03324bee3e4 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:07.391935 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd090ad-3267-4e5a-a39e-c03324bee3e4 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:07.392031 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd090ad-3267-4e5a-a39e-c03324bee3e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:07.468053 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-7fd090ad-3267-4e5a-a39e-c03324bee3e4 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:37:07.471120 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-7fd090ad-3267-4e5a-a39e-c03324bee3e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:37:07.599376 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 695/1405] 10.222.0.102 () {58 vars in 1028 bytes} [Mon Aug 1 15:37:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:37:07.645831 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c4efb3-8955-490e-89bf-e711a2a9e66f None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:07.647851 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-c0c4efb3-8955-490e-89bf-e711a2a9e66f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:37:07.828583 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c4efb3-8955-490e-89bf-e711a2a9e66f None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:07.870999 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:07.962610 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed4d105-c1b3-402f-b2ff-cb52f71e78bb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77b43f1ee8cc4be3907a494abe90c1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:07.963367 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed4d105-c1b3-402f-b2ff-cb52f71e78bb service nova] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:07.963643 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed4d105-c1b3-402f-b2ff-cb52f71e78bb service nova] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:07.963917 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed4d105-c1b3-402f-b2ff-cb52f71e78bb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:07.965700 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-0ed4d105-c1b3-402f-b2ff-cb52f71e78bb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:37:08.072118 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed4d105-c1b3-402f-b2ff-cb52f71e78bb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:08.073770 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed4d105-c1b3-402f-b2ff-cb52f71e78bb service nova] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:08.101067 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 711/1406] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:37:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 456 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:37:10.341410 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1854327-ae7c-47e8-aafa-f966961dd91f None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:10.341968 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1854327-ae7c-47e8-aafa-f966961dd91f None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:10.341968 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1854327-ae7c-47e8-aafa-f966961dd91f None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:10.343864 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 696/1407] 10.222.0.102 () {54 vars in 931 bytes} [Mon Aug 1 15:37:10 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 15:37:10.349082 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42e92d3-5683-47f6-84fb-2a3940c8c76c None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:10.349510 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42e92d3-5683-47f6-84fb-2a3940c8c76c None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:10.349604 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42e92d3-5683-47f6-84fb-2a3940c8c76c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:10.406647 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:10.422784 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-e42e92d3-5683-47f6-84fb-2a3940c8c76c None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:37:10.424014 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-e42e92d3-5683-47f6-84fb-2a3940c8c76c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:37:10.551322 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 712/1408] 10.222.0.102 () {58 vars in 1028 bytes} [Mon Aug 1 15:37:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 15:37:10.598805 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1854327-ae7c-47e8-aafa-f966961dd91f None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:10.600434 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-b1854327-ae7c-47e8-aafa-f966961dd91f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:37:10.657702 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:10.769351 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1854327-ae7c-47e8-aafa-f966961dd91f None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:10.897091 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff23a8f-b1b1-49d4-9b36-1fd90c4153e6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77b43f1ee8cc4be3907a494abe90c1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:10.897731 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff23a8f-b1b1-49d4-9b36-1fd90c4153e6 service nova] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:10.898012 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff23a8f-b1b1-49d4-9b36-1fd90c4153e6 service nova] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:10.898281 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff23a8f-b1b1-49d4-9b36-1fd90c4153e6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:10.899922 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-1ff23a8f-b1b1-49d4-9b36-1fd90c4153e6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:37:10.909499 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:11.000115 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff23a8f-b1b1-49d4-9b36-1fd90c4153e6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:11.002966 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff23a8f-b1b1-49d4-9b36-1fd90c4153e6 service nova] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:11.026656 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 697/1409] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:37:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:37:20.548894 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=46 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:21.023751 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=41 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:28.136877 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fc55c8-6537-4ea2-833c-5b1713259c61 None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:28.136877 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fc55c8-6537-4ea2-833c-5b1713259c61 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:28.136877 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fc55c8-6537-4ea2-833c-5b1713259c61 None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:28.140280 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 713/1410] 10.222.0.102 () {54 vars in 923 bytes} [Mon Aug 1 15:37:28 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 15:37:28.145489 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4479b2-b063-49b3-8d2c-c17c8952c82d None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:28.145967 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4479b2-b063-49b3-8d2c-c17c8952c82d None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:28.146083 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4479b2-b063-49b3-8d2c-c17c8952c82d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:28.230447 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-4a4479b2-b063-49b3-8d2c-c17c8952c82d None None] MFA Rules not processed for user `b78f5749fe9c46a389c88bb9c222cc73`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:37:28.231703 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-4a4479b2-b063-49b3-8d2c-c17c8952c82d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:37:28.337463 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 698/1411] 10.222.0.102 () {58 vars in 1020 bytes} [Mon Aug 1 15:37:28 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:37:28.352105 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88802012-81d7-474d-9c96-b2afc27bdf12 None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:28.352390 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88802012-81d7-474d-9c96-b2afc27bdf12 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:28.352693 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88802012-81d7-474d-9c96-b2afc27bdf12 None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:28.354078 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 714/1412] 10.222.0.102 () {54 vars in 923 bytes} [Mon Aug 1 15:37:28 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 15:37:28.359372 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2b6d90-320d-4d86-962c-c475f04beb67 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:28.359656 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2b6d90-320d-4d86-962c-c475f04beb67 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:28.359929 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2b6d90-320d-4d86-962c-c475f04beb67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:28.431554 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:28.434632 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-5c2b6d90-320d-4d86-962c-c475f04beb67 None None] MFA Rules not processed for user `77b43f1ee8cc4be3907a494abe90c1cc`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:37:28.435855 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-5c2b6d90-320d-4d86-962c-c475f04beb67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:37:28.553173 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 699/1413] 10.222.0.102 () {58 vars in 1020 bytes} [Mon Aug 1 15:37:28 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:37:31.060379 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957e6ad0-45e2-4e0f-a52a-61f00275a6a5 None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:31.061003 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957e6ad0-45e2-4e0f-a52a-61f00275a6a5 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:31.061003 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957e6ad0-45e2-4e0f-a52a-61f00275a6a5 None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:31.062315 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 715/1414] 127.0.0.1 () {54 vars in 916 bytes} [Mon Aug 1 15:37:31 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 15:37:31.067661 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d985977d-3d86-4a9a-89fb-38cbb2177af2 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:31.068097 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d985977d-3d86-4a9a-89fb-38cbb2177af2 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:31.068217 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d985977d-3d86-4a9a-89fb-38cbb2177af2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:31.134989 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-d985977d-3d86-4a9a-89fb-38cbb2177af2 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:37:31.136279 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-d985977d-3d86-4a9a-89fb-38cbb2177af2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:37:31.193919 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:31.236409 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 700/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Aug 1 15:37:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:37:31.279255 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957e6ad0-45e2-4e0f-a52a-61f00275a6a5 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:31.281433 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-957e6ad0-45e2-4e0f-a52a-61f00275a6a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:37:31.427909 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957e6ad0-45e2-4e0f-a52a-61f00275a6a5 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:31.500546 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:31.541330 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbefb6ba-241b-41f8-b624-19673dfd7725 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77b43f1ee8cc4be3907a494abe90c1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:31.541938 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbefb6ba-241b-41f8-b624-19673dfd7725 service nova] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:31.542217 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbefb6ba-241b-41f8-b624-19673dfd7725 service nova] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:31.542491 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbefb6ba-241b-41f8-b624-19673dfd7725 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:31.544137 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-dbefb6ba-241b-41f8-b624-19673dfd7725 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:37:31.634926 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbefb6ba-241b-41f8-b624-19673dfd7725 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:31.636523 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbefb6ba-241b-41f8-b624-19673dfd7725 service nova] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:31.655046 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 716/1416] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:37:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:37:32.552525 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2317ce00-bc2a-43cf-abe8-4eab4220547c None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:32.553129 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2317ce00-bc2a-43cf-abe8-4eab4220547c None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:32.553129 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2317ce00-bc2a-43cf-abe8-4eab4220547c None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:32.554474 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 701/1417] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 1 15:37:32 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 15:37:32.559441 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f565f222-c946-4a12-a934-422378d5616a None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:32.559904 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f565f222-c946-4a12-a934-422378d5616a None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:32.560011 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f565f222-c946-4a12-a934-422378d5616a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:32.636324 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-f565f222-c946-4a12-a934-422378d5616a None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:37:32.637606 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-f565f222-c946-4a12-a934-422378d5616a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:37:32.664202 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:32.736663 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 717/1418] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 1 15:37:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:37:32.887820 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2317ce00-bc2a-43cf-abe8-4eab4220547c None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:32.888964 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-2317ce00-bc2a-43cf-abe8-4eab4220547c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:37:33.031648 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2317ce00-bc2a-43cf-abe8-4eab4220547c None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:33.071610 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:33.143531 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1b2910-2340-4549-89e0-592c569d7558 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77b43f1ee8cc4be3907a494abe90c1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:33.144073 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1b2910-2340-4549-89e0-592c569d7558 service nova] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:33.144347 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1b2910-2340-4549-89e0-592c569d7558 service nova] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:33.144614 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1b2910-2340-4549-89e0-592c569d7558 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:33.146248 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-3d1b2910-2340-4549-89e0-592c569d7558 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:37:33.239706 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1b2910-2340-4549-89e0-592c569d7558 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:33.241346 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1b2910-2340-4549-89e0-592c569d7558 service nova] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:33.259217 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 702/1419] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:37:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:37:34.142646 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3c4465-a669-4e5d-bc74-94ad2099286e None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:34.143055 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3c4465-a669-4e5d-bc74-94ad2099286e None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:34.143255 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3c4465-a669-4e5d-bc74-94ad2099286e None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:34.144568 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 718/1420] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 1 15:37:34 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 15:37:34.149569 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bb0c3c-4b51-4305-a678-0690d49dae46 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:34.149997 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bb0c3c-4b51-4305-a678-0690d49dae46 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:34.150106 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bb0c3c-4b51-4305-a678-0690d49dae46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:34.204651 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:34.226507 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-08bb0c3c-4b51-4305-a678-0690d49dae46 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:37:34.227720 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-08bb0c3c-4b51-4305-a678-0690d49dae46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:37:34.323468 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 703/1421] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 1 15:37:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 15:37:34.474796 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3c4465-a669-4e5d-bc74-94ad2099286e None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:34.476305 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-bf3c4465-a669-4e5d-bc74-94ad2099286e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:37:34.622465 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3c4465-a669-4e5d-bc74-94ad2099286e None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:34.634636 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:34.735596 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080fc25b-5675-46e5-8f81-89ed4e19391e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77b43f1ee8cc4be3907a494abe90c1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:34.736108 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080fc25b-5675-46e5-8f81-89ed4e19391e service nova] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:34.736377 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080fc25b-5675-46e5-8f81-89ed4e19391e service nova] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:34.736641 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080fc25b-5675-46e5-8f81-89ed4e19391e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:34.738278 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-080fc25b-5675-46e5-8f81-89ed4e19391e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:37:34.829658 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080fc25b-5675-46e5-8f81-89ed4e19391e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:34.831252 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080fc25b-5675-46e5-8f81-89ed4e19391e service nova] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:34.849626 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 719/1422] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:37:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:37:35.710122 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2099959b-3204-4bb4-ab5b-4be070350ffe None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:35.710670 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2099959b-3204-4bb4-ab5b-4be070350ffe None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:35.710670 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2099959b-3204-4bb4-ab5b-4be070350ffe None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:35.712048 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 704/1423] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 1 15:37:35 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 15:37:35.717099 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6ac26e-e204-4cf4-8a56-758d2234b4e1 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:35.717507 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6ac26e-e204-4cf4-8a56-758d2234b4e1 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:35.717678 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6ac26e-e204-4cf4-8a56-758d2234b4e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:35.738305 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:35.794486 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-8a6ac26e-e204-4cf4-8a56-758d2234b4e1 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:37:35.796302 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-8a6ac26e-e204-4cf4-8a56-758d2234b4e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:37:35.895187 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 720/1424] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 1 15:37:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:37:36.047420 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2099959b-3204-4bb4-ab5b-4be070350ffe None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:36.049046 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-2099959b-3204-4bb4-ab5b-4be070350ffe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:37:36.155976 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:36.192182 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2099959b-3204-4bb4-ab5b-4be070350ffe None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:36.310380 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545fc64e-a95a-4d2f-9606-1c6ba9936e11 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77b43f1ee8cc4be3907a494abe90c1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:36.310944 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545fc64e-a95a-4d2f-9606-1c6ba9936e11 service nova] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:36.311221 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545fc64e-a95a-4d2f-9606-1c6ba9936e11 service nova] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:36.311524 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545fc64e-a95a-4d2f-9606-1c6ba9936e11 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:36.313235 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-545fc64e-a95a-4d2f-9606-1c6ba9936e11 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:37:36.388162 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:36.402102 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545fc64e-a95a-4d2f-9606-1c6ba9936e11 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:36.403742 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545fc64e-a95a-4d2f-9606-1c6ba9936e11 service nova] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:36.422690 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 705/1425] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:37:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:37:37.283921 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cc7ea2-5332-4265-97fa-6c712596fb07 None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:37.284379 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cc7ea2-5332-4265-97fa-6c712596fb07 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:37.284495 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cc7ea2-5332-4265-97fa-6c712596fb07 None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:37.285896 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 721/1426] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 1 15:37:37 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 15:37:37.291007 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb8a39a-d4e4-416a-83e0-429b2e87e6e1 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:37.291432 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb8a39a-d4e4-416a-83e0-429b2e87e6e1 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:37.291569 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb8a39a-d4e4-416a-83e0-429b2e87e6e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:37.369354 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-0bb8a39a-d4e4-416a-83e0-429b2e87e6e1 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:37:37.370577 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-0bb8a39a-d4e4-416a-83e0-429b2e87e6e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:37:37.587132 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 706/1427] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 1 15:37:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:37:37.738183 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cc7ea2-5332-4265-97fa-6c712596fb07 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:37.739775 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-23cc7ea2-5332-4265-97fa-6c712596fb07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:37:37.825946 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:37.888477 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cc7ea2-5332-4265-97fa-6c712596fb07 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:38.000593 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4465ad-a5ac-440d-be90-57d37c8ec600 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77b43f1ee8cc4be3907a494abe90c1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:38.001220 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4465ad-a5ac-440d-be90-57d37c8ec600 service nova] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:38.001809 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4465ad-a5ac-440d-be90-57d37c8ec600 service nova] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:38.001809 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4465ad-a5ac-440d-be90-57d37c8ec600 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:38.003371 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-6a4465ad-a5ac-440d-be90-57d37c8ec600 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:37:38.050471 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:38.092627 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4465ad-a5ac-440d-be90-57d37c8ec600 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:38.094273 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4465ad-a5ac-440d-be90-57d37c8ec600 service nova] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:38.112681 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 722/1428] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:37:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:37:39.009579 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d19eae7-b73e-4668-a027-3836c6e2f70f None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:39.010159 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d19eae7-b73e-4668-a027-3836c6e2f70f None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:39.010159 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d19eae7-b73e-4668-a027-3836c6e2f70f None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:39.011504 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 707/1429] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 1 15:37:39 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 15:37:39.016422 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99fc5bc-988d-4d95-9b50-86e4ade0eb79 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:39.016886 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99fc5bc-988d-4d95-9b50-86e4ade0eb79 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:39.017108 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99fc5bc-988d-4d95-9b50-86e4ade0eb79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:39.094114 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-a99fc5bc-988d-4d95-9b50-86e4ade0eb79 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:37:39.095307 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-a99fc5bc-988d-4d95-9b50-86e4ade0eb79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:37:39.194258 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 723/1430] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 1 15:37:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:37:39.350170 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d19eae7-b73e-4668-a027-3836c6e2f70f None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:39.351968 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-2d19eae7-b73e-4668-a027-3836c6e2f70f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:37:39.400715 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:39.496605 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d19eae7-b73e-4668-a027-3836c6e2f70f None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:39.608124 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984cacd9-c861-45d8-9931-92178f7f436e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77b43f1ee8cc4be3907a494abe90c1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:39.608734 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984cacd9-c861-45d8-9931-92178f7f436e service nova] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:39.609040 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984cacd9-c861-45d8-9931-92178f7f436e service nova] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:39.609310 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984cacd9-c861-45d8-9931-92178f7f436e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:39.610933 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-984cacd9-c861-45d8-9931-92178f7f436e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:37:39.617793 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:39.698499 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984cacd9-c861-45d8-9931-92178f7f436e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:39.700092 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984cacd9-c861-45d8-9931-92178f7f436e service nova] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:39.718609 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 708/1431] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:37:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:37:40.611304 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16f14df-f132-4696-aece-e46c328f4252 None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:40.611753 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16f14df-f132-4696-aece-e46c328f4252 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:40.611860 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16f14df-f132-4696-aece-e46c328f4252 None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:40.613261 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 724/1432] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 1 15:37:40 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 15:37:40.618402 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe7c3e5-b7d9-4c04-99d4-95bce121460c None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:40.626472 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe7c3e5-b7d9-4c04-99d4-95bce121460c None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:40.626472 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe7c3e5-b7d9-4c04-99d4-95bce121460c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:40.696390 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-6fe7c3e5-b7d9-4c04-99d4-95bce121460c None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:37:40.697637 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-6fe7c3e5-b7d9-4c04-99d4-95bce121460c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:37:40.767912 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:40.801324 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 709/1433] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 1 15:37:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:37:40.952075 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16f14df-f132-4696-aece-e46c328f4252 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:40.953899 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-e16f14df-f132-4696-aece-e46c328f4252 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:37:40.971493 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:41.101505 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16f14df-f132-4696-aece-e46c328f4252 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:41.189403 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:41.214997 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb3477b-c5e8-4ae7-8c78-6717f72ebea2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77b43f1ee8cc4be3907a494abe90c1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:41.215608 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb3477b-c5e8-4ae7-8c78-6717f72ebea2 service nova] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:41.215886 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb3477b-c5e8-4ae7-8c78-6717f72ebea2 service nova] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:41.216154 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb3477b-c5e8-4ae7-8c78-6717f72ebea2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:41.218336 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-3bb3477b-c5e8-4ae7-8c78-6717f72ebea2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:37:41.307202 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb3477b-c5e8-4ae7-8c78-6717f72ebea2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:41.308786 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb3477b-c5e8-4ae7-8c78-6717f72ebea2 service nova] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:41.327820 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 725/1434] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:37:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:37:42.186274 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe4751c-e389-4750-81ce-953615fa5963 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:42.186802 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe4751c-e389-4750-81ce-953615fa5963 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:42.186802 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe4751c-e389-4750-81ce-953615fa5963 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:42.188182 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 710/1435] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 1 15:37:42 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 01 15:37:42.193075 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caa9f23-b35f-4774-ac43-72a83bf8070e None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:42.193483 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caa9f23-b35f-4774-ac43-72a83bf8070e None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:42.193614 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caa9f23-b35f-4774-ac43-72a83bf8070e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:42.271876 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-5caa9f23-b35f-4774-ac43-72a83bf8070e None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:37:42.273102 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-5caa9f23-b35f-4774-ac43-72a83bf8070e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:37:42.315451 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:42.370589 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 726/1436] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 1 15:37:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:37:42.520956 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe4751c-e389-4750-81ce-953615fa5963 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:42.522459 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-4fe4751c-e389-4750-81ce-953615fa5963 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:37:42.666526 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe4751c-e389-4750-81ce-953615fa5963 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:42.721228 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:42.780241 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc99f8b-fa77-463a-bf88-50f8d67290bc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77b43f1ee8cc4be3907a494abe90c1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:42.780881 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc99f8b-fa77-463a-bf88-50f8d67290bc service nova] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:42.781168 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc99f8b-fa77-463a-bf88-50f8d67290bc service nova] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:42.781444 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc99f8b-fa77-463a-bf88-50f8d67290bc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:42.783075 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-7fc99f8b-fa77-463a-bf88-50f8d67290bc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:37:42.871777 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc99f8b-fa77-463a-bf88-50f8d67290bc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:42.873487 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc99f8b-fa77-463a-bf88-50f8d67290bc service nova] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:42.892343 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 711/1437] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:37:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:37:43.791887 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba81cb0-cb70-4b2c-af35-74d1da58440b None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:43.792423 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba81cb0-cb70-4b2c-af35-74d1da58440b None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:43.792423 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba81cb0-cb70-4b2c-af35-74d1da58440b None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:43.793730 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 727/1438] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 1 15:37:43 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 15:37:43.799138 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdda7ea5-37ba-4219-9ce6-48b6a6868b98 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:43.799550 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdda7ea5-37ba-4219-9ce6-48b6a6868b98 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:43.799687 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdda7ea5-37ba-4219-9ce6-48b6a6868b98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:43.877347 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-fdda7ea5-37ba-4219-9ce6-48b6a6868b98 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:37:43.878544 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-fdda7ea5-37ba-4219-9ce6-48b6a6868b98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:37:43.880655 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:43.975716 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 712/1439] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 1 15:37:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:37:44.139197 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba81cb0-cb70-4b2c-af35-74d1da58440b None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:44.140640 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-dba81cb0-cb70-4b2c-af35-74d1da58440b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:37:44.288592 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba81cb0-cb70-4b2c-af35-74d1da58440b None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:44.316681 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:44.403531 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e6b3af-b21e-491f-9cf1-76b452ad2a1d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77b43f1ee8cc4be3907a494abe90c1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:44.404060 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e6b3af-b21e-491f-9cf1-76b452ad2a1d service nova] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:44.404816 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e6b3af-b21e-491f-9cf1-76b452ad2a1d service nova] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:44.405126 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e6b3af-b21e-491f-9cf1-76b452ad2a1d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:44.406748 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-b8e6b3af-b21e-491f-9cf1-76b452ad2a1d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:37:44.502015 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e6b3af-b21e-491f-9cf1-76b452ad2a1d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:44.503614 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e6b3af-b21e-491f-9cf1-76b452ad2a1d service nova] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:44.521983 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 728/1440] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:37:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:37:46.456611 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5be078d-5aad-4dea-8843-fe6fb9e4b00e None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:46.457220 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5be078d-5aad-4dea-8843-fe6fb9e4b00e None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:46.457220 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5be078d-5aad-4dea-8843-fe6fb9e4b00e None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:46.458581 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 713/1441] 127.0.0.1 () {54 vars in 916 bytes} [Mon Aug 1 15:37:46 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 15:37:46.464151 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71122e3-acc3-47a6-be66-b5777228dd89 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:46.464563 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71122e3-acc3-47a6-be66-b5777228dd89 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:46.464685 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71122e3-acc3-47a6-be66-b5777228dd89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:46.507115 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:46.532242 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-a71122e3-acc3-47a6-be66-b5777228dd89 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:37:46.533488 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-a71122e3-acc3-47a6-be66-b5777228dd89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:37:46.632528 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 729/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Aug 1 15:37:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:37:46.671233 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5be078d-5aad-4dea-8843-fe6fb9e4b00e None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:46.672828 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-c5be078d-5aad-4dea-8843-fe6fb9e4b00e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:37:46.775954 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5be078d-5aad-4dea-8843-fe6fb9e4b00e None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:46.809164 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:46.850590 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7d8c7f-1dd4-487d-8a99-16bd257e38c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a856a413100443939fe9b10daa868518', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:46.851233 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7d8c7f-1dd4-487d-8a99-16bd257e38c0 service neutron] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:46.851512 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7d8c7f-1dd4-487d-8a99-16bd257e38c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:46.851784 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7d8c7f-1dd4-487d-8a99-16bd257e38c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:46.853439 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-ea7d8c7f-1dd4-487d-8a99-16bd257e38c0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:37:46.965146 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7d8c7f-1dd4-487d-8a99-16bd257e38c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:46.966582 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7d8c7f-1dd4-487d-8a99-16bd257e38c0 service neutron] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:46.985384 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 714/1443] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:37:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:37:49.128361 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a232e43a-2140-4c0b-8a58-b582ca448d86 None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:49.129023 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a232e43a-2140-4c0b-8a58-b582ca448d86 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:49.129023 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a232e43a-2140-4c0b-8a58-b582ca448d86 None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:49.130283 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 730/1444] 127.0.0.1 () {54 vars in 916 bytes} [Mon Aug 1 15:37:49 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 15:37:49.135672 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bab6d4-2682-489c-9fe6-4234fa21849b None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:49.136098 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bab6d4-2682-489c-9fe6-4234fa21849b None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:49.136250 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bab6d4-2682-489c-9fe6-4234fa21849b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:49.211166 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-d6bab6d4-2682-489c-9fe6-4234fa21849b None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:37:49.212401 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-d6bab6d4-2682-489c-9fe6-4234fa21849b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:37:49.226031 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:49.307212 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 715/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Aug 1 15:37:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:37:49.345726 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a232e43a-2140-4c0b-8a58-b582ca448d86 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:49.347260 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-a232e43a-2140-4c0b-8a58-b582ca448d86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:37:49.450406 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a232e43a-2140-4c0b-8a58-b582ca448d86 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:49.463250 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:49.524809 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd81018-7714-432a-b5c7-1e642fd67dde service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a856a413100443939fe9b10daa868518', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:49.525454 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd81018-7714-432a-b5c7-1e642fd67dde service neutron] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:49.525732 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd81018-7714-432a-b5c7-1e642fd67dde service neutron] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:49.526002 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd81018-7714-432a-b5c7-1e642fd67dde service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:49.527686 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-fdd81018-7714-432a-b5c7-1e642fd67dde service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:37:49.636049 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd81018-7714-432a-b5c7-1e642fd67dde service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:49.637520 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd81018-7714-432a-b5c7-1e642fd67dde service neutron] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:49.655767 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 731/1446] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:37:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:37:52.155067 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4595aa97-8c01-4721-aa89-6a8a9867faf2 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:52.155523 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4595aa97-8c01-4721-aa89-6a8a9867faf2 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:52.155619 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4595aa97-8c01-4721-aa89-6a8a9867faf2 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:52.157003 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 716/1447] 127.0.0.1 () {54 vars in 916 bytes} [Mon Aug 1 15:37:52 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 15:37:52.162150 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cb844b-ab67-47a0-8871-86ac1f0aa8f7 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:52.162543 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cb844b-ab67-47a0-8871-86ac1f0aa8f7 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:52.162686 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cb844b-ab67-47a0-8871-86ac1f0aa8f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:52.211849 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:52.229847 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-a2cb844b-ab67-47a0-8871-86ac1f0aa8f7 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:37:52.231059 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-a2cb844b-ab67-47a0-8871-86ac1f0aa8f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:37:52.327780 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 732/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Aug 1 15:37:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:37:52.368244 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4595aa97-8c01-4721-aa89-6a8a9867faf2 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:52.369862 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-4595aa97-8c01-4721-aa89-6a8a9867faf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:37:52.471346 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4595aa97-8c01-4721-aa89-6a8a9867faf2 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:52.510956 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:52.544211 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9453b507-e71c-4b5d-a1b1-5abd46b3fe1d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a856a413100443939fe9b10daa868518', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:52.544824 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9453b507-e71c-4b5d-a1b1-5abd46b3fe1d service neutron] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:52.545685 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9453b507-e71c-4b5d-a1b1-5abd46b3fe1d service neutron] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:52.545959 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9453b507-e71c-4b5d-a1b1-5abd46b3fe1d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:52.547587 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-9453b507-e71c-4b5d-a1b1-5abd46b3fe1d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:37:52.654177 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9453b507-e71c-4b5d-a1b1-5abd46b3fe1d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:52.656133 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9453b507-e71c-4b5d-a1b1-5abd46b3fe1d service neutron] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:52.675117 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 717/1449] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:37:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:37:54.815440 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864eabf4-b08b-4253-a5f9-48d9c7a1200a None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:54.816015 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864eabf4-b08b-4253-a5f9-48d9c7a1200a None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:54.816126 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864eabf4-b08b-4253-a5f9-48d9c7a1200a None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:54.817437 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 733/1450] 127.0.0.1 () {54 vars in 916 bytes} [Mon Aug 1 15:37:54 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 15:37:54.822674 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d511bb-28a7-43bc-a700-2cb7aae40315 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:54.823067 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d511bb-28a7-43bc-a700-2cb7aae40315 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:54.823226 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d511bb-28a7-43bc-a700-2cb7aae40315 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:54.889553 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-53d511bb-28a7-43bc-a700-2cb7aae40315 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:37:54.891330 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-53d511bb-28a7-43bc-a700-2cb7aae40315 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:37:54.922140 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:55.004214 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 718/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Aug 1 15:37:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:37:55.043280 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864eabf4-b08b-4253-a5f9-48d9c7a1200a None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:55.044782 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-864eabf4-b08b-4253-a5f9-48d9c7a1200a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:37:55.147785 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864eabf4-b08b-4253-a5f9-48d9c7a1200a None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:55.167096 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:55.227355 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921acba4-5f18-428a-bda2-7aef0a6ceda7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a856a413100443939fe9b10daa868518', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:55.227960 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921acba4-5f18-428a-bda2-7aef0a6ceda7 service neutron] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:55.228236 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921acba4-5f18-428a-bda2-7aef0a6ceda7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:55.228507 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921acba4-5f18-428a-bda2-7aef0a6ceda7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:55.230157 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-921acba4-5f18-428a-bda2-7aef0a6ceda7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:37:55.338848 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921acba4-5f18-428a-bda2-7aef0a6ceda7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:55.340273 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921acba4-5f18-428a-bda2-7aef0a6ceda7 service neutron] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:55.360060 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 734/1452] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:37:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:37:57.416237 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a640555-29b0-4429-b253-39335aad1773 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:57.416804 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a640555-29b0-4429-b253-39335aad1773 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:57.416804 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a640555-29b0-4429-b253-39335aad1773 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:57.418185 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 719/1453] 127.0.0.1 () {54 vars in 916 bytes} [Mon Aug 1 15:37:57 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 15:37:57.424051 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56500bf8-c13c-471f-87de-d35d556e003b None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:57.424503 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56500bf8-c13c-471f-87de-d35d556e003b None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:57.424601 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56500bf8-c13c-471f-87de-d35d556e003b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:57.488023 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:57.491050 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-56500bf8-c13c-471f-87de-d35d556e003b None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:37:57.492306 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-56500bf8-c13c-471f-87de-d35d556e003b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:37:57.589689 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 735/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Aug 1 15:37:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:37:57.629229 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a640555-29b0-4429-b253-39335aad1773 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:37:57.630751 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-9a640555-29b0-4429-b253-39335aad1773 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:37:57.732444 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a640555-29b0-4429-b253-39335aad1773 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:37:57.783659 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:57.808449 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489490ae-d443-499a-afb3-ee3f42876ef4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a856a413100443939fe9b10daa868518', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:37:57.809099 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489490ae-d443-499a-afb3-ee3f42876ef4 service neutron] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:37:57.809376 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489490ae-d443-499a-afb3-ee3f42876ef4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:37:57.809643 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489490ae-d443-499a-afb3-ee3f42876ef4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:37:57.811256 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-489490ae-d443-499a-afb3-ee3f42876ef4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:37:57.919056 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489490ae-d443-499a-afb3-ee3f42876ef4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:37:57.920530 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489490ae-d443-499a-afb3-ee3f42876ef4 service neutron] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:37:57.939779 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 720/1455] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:37:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:38:00.018703 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300dcc4c-7360-4e4c-be8c-ee4e5af68186 None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:00.019284 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300dcc4c-7360-4e4c-be8c-ee4e5af68186 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:00.019284 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300dcc4c-7360-4e4c-be8c-ee4e5af68186 None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:00.020793 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 736/1456] 127.0.0.1 () {54 vars in 916 bytes} [Mon Aug 1 15:38:00 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 15:38:00.025901 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17a221e-58d9-48ed-b2cc-941e2b58ed31 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:00.026317 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17a221e-58d9-48ed-b2cc-941e2b58ed31 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:00.026495 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17a221e-58d9-48ed-b2cc-941e2b58ed31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:00.092078 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-a17a221e-58d9-48ed-b2cc-941e2b58ed31 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:38:00.093362 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-a17a221e-58d9-48ed-b2cc-941e2b58ed31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:38:00.121220 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:38:00.189863 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 721/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Aug 1 15:38:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:38:00.227749 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300dcc4c-7360-4e4c-be8c-ee4e5af68186 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:38:00.229315 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-300dcc4c-7360-4e4c-be8c-ee4e5af68186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:38:00.333816 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300dcc4c-7360-4e4c-be8c-ee4e5af68186 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:38:00.362133 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:38:00.407470 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f89d6d2-c128-4386-95e0-690ac92c220e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a856a413100443939fe9b10daa868518', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:38:00.408009 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f89d6d2-c128-4386-95e0-690ac92c220e service neutron] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:00.408287 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f89d6d2-c128-4386-95e0-690ac92c220e service neutron] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:00.408559 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f89d6d2-c128-4386-95e0-690ac92c220e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:00.410207 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-0f89d6d2-c128-4386-95e0-690ac92c220e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:38:00.518543 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f89d6d2-c128-4386-95e0-690ac92c220e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:38:00.519977 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f89d6d2-c128-4386-95e0-690ac92c220e service neutron] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:38:00.538638 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 737/1458] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:38:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:38:02.599423 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321cc82d-f07e-4f31-b88d-3ff9dc1dbfc3 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:02.599987 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321cc82d-f07e-4f31-b88d-3ff9dc1dbfc3 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:02.599987 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321cc82d-f07e-4f31-b88d-3ff9dc1dbfc3 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:02.601281 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 722/1459] 127.0.0.1 () {54 vars in 916 bytes} [Mon Aug 1 15:38:02 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 15:38:02.606497 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda4d8d8-a499-4e0c-8630-d8ac716f5d48 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:02.606913 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda4d8d8-a499-4e0c-8630-d8ac716f5d48 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:02.607031 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda4d8d8-a499-4e0c-8630-d8ac716f5d48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:02.673538 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-eda4d8d8-a499-4e0c-8630-d8ac716f5d48 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:38:02.674749 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-eda4d8d8-a499-4e0c-8630-d8ac716f5d48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:38:02.683119 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:38:02.771506 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 738/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Aug 1 15:38:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:38:02.808806 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321cc82d-f07e-4f31-b88d-3ff9dc1dbfc3 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:38:02.810378 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-321cc82d-f07e-4f31-b88d-3ff9dc1dbfc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:38:02.913981 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321cc82d-f07e-4f31-b88d-3ff9dc1dbfc3 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:38:02.969122 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:38:02.987684 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f7e5dc-e51b-4e17-8798-59bd6c8ab25d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a856a413100443939fe9b10daa868518', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:38:02.988295 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f7e5dc-e51b-4e17-8798-59bd6c8ab25d service neutron] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:02.988588 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f7e5dc-e51b-4e17-8798-59bd6c8ab25d service neutron] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:02.988833 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f7e5dc-e51b-4e17-8798-59bd6c8ab25d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:02.990489 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-b7f7e5dc-e51b-4e17-8798-59bd6c8ab25d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:38:03.101683 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f7e5dc-e51b-4e17-8798-59bd6c8ab25d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:38:03.103123 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f7e5dc-e51b-4e17-8798-59bd6c8ab25d service neutron] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:38:03.121824 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 723/1461] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:38:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:38:05.217397 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65279da1-e16f-47a9-b8ea-423b7feb1175 None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:05.217936 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65279da1-e16f-47a9-b8ea-423b7feb1175 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:05.217936 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65279da1-e16f-47a9-b8ea-423b7feb1175 None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:05.219294 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 739/1462] 127.0.0.1 () {54 vars in 916 bytes} [Mon Aug 1 15:38:05 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 15:38:05.224390 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac633307-8333-4023-8b44-c69989c92b55 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:05.224789 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac633307-8333-4023-8b44-c69989c92b55 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:05.224956 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac633307-8333-4023-8b44-c69989c92b55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:05.290526 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-ac633307-8333-4023-8b44-c69989c92b55 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:38:05.291752 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-ac633307-8333-4023-8b44-c69989c92b55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:38:05.330909 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:38:05.388101 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 724/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Aug 1 15:38:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:38:05.425817 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65279da1-e16f-47a9-b8ea-423b7feb1175 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:38:05.427391 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-65279da1-e16f-47a9-b8ea-423b7feb1175 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:38:05.532356 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65279da1-e16f-47a9-b8ea-423b7feb1175 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:38:05.569608 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:38:05.606558 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c4e00f-4a90-40cc-8f38-6952149ed301 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a856a413100443939fe9b10daa868518', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:38:05.607166 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c4e00f-4a90-40cc-8f38-6952149ed301 service neutron] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:05.607445 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c4e00f-4a90-40cc-8f38-6952149ed301 service neutron] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:05.607713 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c4e00f-4a90-40cc-8f38-6952149ed301 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:05.609390 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-c0c4e00f-4a90-40cc-8f38-6952149ed301 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:38:05.718741 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c4e00f-4a90-40cc-8f38-6952149ed301 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:38:05.720221 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c4e00f-4a90-40cc-8f38-6952149ed301 service neutron] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:38:05.739314 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 740/1464] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:38:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:38:07.752777 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69964353-da74-4dc6-84f4-635f13ee150d None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:07.753397 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69964353-da74-4dc6-84f4-635f13ee150d None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:07.753397 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69964353-da74-4dc6-84f4-635f13ee150d None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:07.754739 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 725/1465] 127.0.0.1 () {54 vars in 916 bytes} [Mon Aug 1 15:38:07 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 15:38:07.760061 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817dcca8-76ed-4dc8-9d30-ce65c4c1ce3f None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:07.760522 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817dcca8-76ed-4dc8-9d30-ce65c4c1ce3f None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:07.760621 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817dcca8-76ed-4dc8-9d30-ce65c4c1ce3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:07.827830 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-817dcca8-76ed-4dc8-9d30-ce65c4c1ce3f None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:38:07.829161 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-817dcca8-76ed-4dc8-9d30-ce65c4c1ce3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:38:07.847701 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:38:07.926755 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 741/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Aug 1 15:38:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:38:07.963418 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69964353-da74-4dc6-84f4-635f13ee150d None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:38:07.965064 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-69964353-da74-4dc6-84f4-635f13ee150d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:38:08.069854 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69964353-da74-4dc6-84f4-635f13ee150d None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:38:08.135960 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:38:08.143354 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6582ee18-80b6-44e1-a339-b7eb66fac449 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a856a413100443939fe9b10daa868518', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:38:08.143969 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6582ee18-80b6-44e1-a339-b7eb66fac449 service neutron] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:08.144244 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6582ee18-80b6-44e1-a339-b7eb66fac449 service neutron] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:08.144513 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6582ee18-80b6-44e1-a339-b7eb66fac449 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:08.146166 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-6582ee18-80b6-44e1-a339-b7eb66fac449 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:38:08.253516 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6582ee18-80b6-44e1-a339-b7eb66fac449 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:38:08.254973 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6582ee18-80b6-44e1-a339-b7eb66fac449 service neutron] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:38:08.273640 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 726/1467] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:38:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:38:10.277672 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d564f199-616d-45ac-a1e4-03a6a6a705a1 None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:10.278284 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d564f199-616d-45ac-a1e4-03a6a6a705a1 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:10.278284 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d564f199-616d-45ac-a1e4-03a6a6a705a1 None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:10.279588 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 742/1468] 127.0.0.1 () {54 vars in 916 bytes} [Mon Aug 1 15:38:10 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 15:38:10.285480 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef82f4e2-608d-4a24-9ce4-c1e788263bb3 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:10.285899 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef82f4e2-608d-4a24-9ce4-c1e788263bb3 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:10.286059 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef82f4e2-608d-4a24-9ce4-c1e788263bb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:10.351692 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-ef82f4e2-608d-4a24-9ce4-c1e788263bb3 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:38:10.352907 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-ef82f4e2-608d-4a24-9ce4-c1e788263bb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:38:10.400054 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:38:10.447448 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 727/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Aug 1 15:38:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:38:10.484739 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d564f199-616d-45ac-a1e4-03a6a6a705a1 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:38:10.486298 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-d564f199-616d-45ac-a1e4-03a6a6a705a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:38:10.598887 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d564f199-616d-45ac-a1e4-03a6a6a705a1 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:38:10.649812 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:38:10.676083 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ad52a0-1002-43ca-9617-19e09eac5d8c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a856a413100443939fe9b10daa868518', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:38:10.676693 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ad52a0-1002-43ca-9617-19e09eac5d8c service neutron] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:10.677018 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ad52a0-1002-43ca-9617-19e09eac5d8c service neutron] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:10.677290 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ad52a0-1002-43ca-9617-19e09eac5d8c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:10.678936 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-c5ad52a0-1002-43ca-9617-19e09eac5d8c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:38:10.787403 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ad52a0-1002-43ca-9617-19e09eac5d8c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:38:10.788769 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ad52a0-1002-43ca-9617-19e09eac5d8c service neutron] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:38:10.813347 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 743/1470] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:38:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:38:20.445579 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=22 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:38:20.810290 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=66 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:38:30.333956 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd9d190-8514-4373-b7e2-ca199b323995 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:30.334521 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd9d190-8514-4373-b7e2-ca199b323995 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:30.334521 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd9d190-8514-4373-b7e2-ca199b323995 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:30.336078 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 728/1471] 10.222.0.102 () {54 vars in 931 bytes} [Mon Aug 1 15:38:30 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 15:38:30.341932 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433f7753-20b3-49eb-b7d3-04c36fc66a61 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:30.342560 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433f7753-20b3-49eb-b7d3-04c36fc66a61 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:30.343166 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433f7753-20b3-49eb-b7d3-04c36fc66a61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:30.430648 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-433f7753-20b3-49eb-b7d3-04c36fc66a61 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:38:30.431771 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-433f7753-20b3-49eb-b7d3-04c36fc66a61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:38:30.527109 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 744/1472] 10.222.0.102 () {58 vars in 1028 bytes} [Mon Aug 1 15:38:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:38:30.610034 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1315bc28-9f47-44e1-8dc1-aa039ef191e6 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:30.610314 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1315bc28-9f47-44e1-8dc1-aa039ef191e6 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:30.610585 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1315bc28-9f47-44e1-8dc1-aa039ef191e6 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:30.611976 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 729/1473] 10.222.0.102 () {54 vars in 971 bytes} [Mon Aug 1 15:38:30 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 15:38:30.616960 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8291052-714a-47e6-9005-5d796d23a4e2 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:30.617278 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8291052-714a-47e6-9005-5d796d23a4e2 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:30.617558 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8291052-714a-47e6-9005-5d796d23a4e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:30.694022 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-b8291052-714a-47e6-9005-5d796d23a4e2 None None] MFA Rules not processed for user `613da2657ae34558b355cac53c8bf29a`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:38:30.695165 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-b8291052-714a-47e6-9005-5d796d23a4e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:38:30.716256 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:38:30.778492 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 745/1474] 10.222.0.102 () {58 vars in 1068 bytes} [Mon Aug 1 15:38:30 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:38:30.786074 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1315bc28-9f47-44e1-8dc1-aa039ef191e6 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:38:30.787627 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-1315bc28-9f47-44e1-8dc1-aa039ef191e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:38:30.892099 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1315bc28-9f47-44e1-8dc1-aa039ef191e6 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:38:30.965322 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7556861d-d2ef-4bc7-8785-d5fae4c0e158 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '613da2657ae34558b355cac53c8bf29a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:38:30.965861 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7556861d-d2ef-4bc7-8785-d5fae4c0e158 service glance] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:30.966139 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7556861d-d2ef-4bc7-8785-d5fae4c0e158 service glance] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:30.966410 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7556861d-d2ef-4bc7-8785-d5fae4c0e158 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:30.968054 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-7556861d-d2ef-4bc7-8785-d5fae4c0e158 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:38:31.021253 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:38:31.076620 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7556861d-d2ef-4bc7-8785-d5fae4c0e158 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:38:31.078133 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7556861d-d2ef-4bc7-8785-d5fae4c0e158 service glance] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:38:31.097857 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 730/1475] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:38:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:38:33.207739 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981861f6-393d-4a6c-b434-3ecafbde22f9 None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:33.208313 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981861f6-393d-4a6c-b434-3ecafbde22f9 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:33.208313 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981861f6-393d-4a6c-b434-3ecafbde22f9 None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:33.209725 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 746/1476] 10.222.0.102 () {54 vars in 931 bytes} [Mon Aug 1 15:38:33 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 15:38:33.215153 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1028e326-acbd-4079-86ef-9ca3b02cabb7 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:33.215568 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1028e326-acbd-4079-86ef-9ca3b02cabb7 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:33.215684 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1028e326-acbd-4079-86ef-9ca3b02cabb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:33.281405 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-1028e326-acbd-4079-86ef-9ca3b02cabb7 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:38:33.282601 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-1028e326-acbd-4079-86ef-9ca3b02cabb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:38:33.385624 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 731/1477] 10.222.0.102 () {58 vars in 1028 bytes} [Mon Aug 1 15:38:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:38:33.410006 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981861f6-393d-4a6c-b434-3ecafbde22f9 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:38:33.411547 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-981861f6-393d-4a6c-b434-3ecafbde22f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:38:33.539273 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981861f6-393d-4a6c-b434-3ecafbde22f9 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:38:33.589345 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:38:33.633380 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91667699-229c-457c-ba5d-3885d30c3928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:38:33.634002 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91667699-229c-457c-ba5d-3885d30c3928 admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:33.634277 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91667699-229c-457c-ba5d-3885d30c3928 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:33.634543 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91667699-229c-457c-ba5d-3885d30c3928 admin admin] PATH_INFO: `/v3/projects` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:33.635226 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91667699-229c-457c-ba5d-3885d30c3928 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:38:33.637027 dv-cinder-843277-7-smb devstack@keystone.service[80352]: WARNING py.warnings [None req-91667699-229c-457c-ba5d-3885d30c3928 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 01 15:38:33.637027 dv-cinder-843277-7-smb devstack@keystone.service[80352]: warnings.warn(msg) Aug 01 15:38:33.637027 dv-cinder-843277-7-smb devstack@keystone.service[80352]: Aug 01 15:38:33.638153 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91667699-229c-457c-ba5d-3885d30c3928 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:38:33.657289 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 747/1478] 10.222.0.102 () {56 vars in 1113 bytes} [Mon Aug 1 15:38:33 2022] GET /identity/v3/projects => generated 2562 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:38:35.692693 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44d89af-54bc-4012-9d2d-694200bd5123 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:35.694123 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44d89af-54bc-4012-9d2d-694200bd5123 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:35.694123 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44d89af-54bc-4012-9d2d-694200bd5123 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:35.694635 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 732/1479] 10.222.0.102 () {54 vars in 931 bytes} [Mon Aug 1 15:38:35 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 15:38:35.699881 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb55967d-4be4-4dc1-b6cb-47a898385b5c None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:35.700331 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb55967d-4be4-4dc1-b6cb-47a898385b5c None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:35.700438 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb55967d-4be4-4dc1-b6cb-47a898385b5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:35.767411 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-eb55967d-4be4-4dc1-b6cb-47a898385b5c None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:38:35.768631 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-eb55967d-4be4-4dc1-b6cb-47a898385b5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:38:35.867745 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 748/1480] 10.222.0.102 () {58 vars in 1028 bytes} [Mon Aug 1 15:38:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:38:35.910118 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44d89af-54bc-4012-9d2d-694200bd5123 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:38:35.911674 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-a44d89af-54bc-4012-9d2d-694200bd5123 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:38:35.922133 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:38:36.056673 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44d89af-54bc-4012-9d2d-694200bd5123 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:38:36.137230 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:38:36.171292 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e823870-c09b-41a1-965c-858dc3ec5339 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77b43f1ee8cc4be3907a494abe90c1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:38:36.171909 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e823870-c09b-41a1-965c-858dc3ec5339 service nova] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:36.172183 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e823870-c09b-41a1-965c-858dc3ec5339 service nova] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:36.172452 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e823870-c09b-41a1-965c-858dc3ec5339 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:36.174118 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-7e823870-c09b-41a1-965c-858dc3ec5339 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:38:36.261318 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e823870-c09b-41a1-965c-858dc3ec5339 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:38:36.262939 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e823870-c09b-41a1-965c-858dc3ec5339 service nova] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:38:36.281817 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 733/1481] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:38:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:38:38.474541 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e539a7d3-344a-4e9a-ac74-ef1fd1bdb7d1 None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:38.475070 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e539a7d3-344a-4e9a-ac74-ef1fd1bdb7d1 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:38.475070 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e539a7d3-344a-4e9a-ac74-ef1fd1bdb7d1 None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:38.476408 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 749/1482] 10.222.0.102 () {54 vars in 931 bytes} [Mon Aug 1 15:38:38 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 15:38:38.481802 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0810f6cb-0979-4514-8995-3244b9026f2b None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:38.482210 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0810f6cb-0979-4514-8995-3244b9026f2b None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:38.482325 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0810f6cb-0979-4514-8995-3244b9026f2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:38.547615 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-0810f6cb-0979-4514-8995-3244b9026f2b None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:38:38.548814 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-0810f6cb-0979-4514-8995-3244b9026f2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:38:38.594698 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:38:38.645150 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 734/1483] 10.222.0.102 () {58 vars in 1028 bytes} [Mon Aug 1 15:38:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:38:38.682578 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e539a7d3-344a-4e9a-ac74-ef1fd1bdb7d1 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:38:38.684121 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-e539a7d3-344a-4e9a-ac74-ef1fd1bdb7d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:38:38.708632 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:38:38.788891 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e539a7d3-344a-4e9a-ac74-ef1fd1bdb7d1 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:38:38.862903 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e59da0a-6317-4927-86ae-734d2716dd6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a856a413100443939fe9b10daa868518', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:38:38.863515 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e59da0a-6317-4927-86ae-734d2716dd6f service neutron] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:38.863800 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e59da0a-6317-4927-86ae-734d2716dd6f service neutron] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:38.864074 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e59da0a-6317-4927-86ae-734d2716dd6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:38.865766 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-1e59da0a-6317-4927-86ae-734d2716dd6f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:38:38.941429 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:38:38.977669 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e59da0a-6317-4927-86ae-734d2716dd6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:38:38.979105 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e59da0a-6317-4927-86ae-734d2716dd6f service neutron] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:38:38.998292 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 750/1484] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:38:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:38:41.067401 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249a87a9-0ad8-454a-92c2-a43e68ae7b49 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:41.067991 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249a87a9-0ad8-454a-92c2-a43e68ae7b49 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:41.067991 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249a87a9-0ad8-454a-92c2-a43e68ae7b49 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:41.069366 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 735/1485] 10.222.0.102 () {54 vars in 931 bytes} [Mon Aug 1 15:38:41 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 15:38:41.074727 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f3fec2-ffeb-4ef3-8d4e-4931c3ab2d8a None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:41.075138 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f3fec2-ffeb-4ef3-8d4e-4931c3ab2d8a None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:41.075259 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f3fec2-ffeb-4ef3-8d4e-4931c3ab2d8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:41.140838 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-06f3fec2-ffeb-4ef3-8d4e-4931c3ab2d8a None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:38:41.142021 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-06f3fec2-ffeb-4ef3-8d4e-4931c3ab2d8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:38:41.238986 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 751/1486] 10.222.0.102 () {58 vars in 1028 bytes} [Mon Aug 1 15:38:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 15:38:41.276197 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249a87a9-0ad8-454a-92c2-a43e68ae7b49 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:38:41.277764 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-249a87a9-0ad8-454a-92c2-a43e68ae7b49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:38:41.382009 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249a87a9-0ad8-454a-92c2-a43e68ae7b49 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:38:41.454809 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:38:41.456605 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bbc469-99f6-4271-9c7e-23c8ee39e2f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a856a413100443939fe9b10daa868518', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:38:41.457262 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bbc469-99f6-4271-9c7e-23c8ee39e2f9 service neutron] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:41.457582 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bbc469-99f6-4271-9c7e-23c8ee39e2f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:41.457866 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bbc469-99f6-4271-9c7e-23c8ee39e2f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:41.459514 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-49bbc469-99f6-4271-9c7e-23c8ee39e2f9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:38:41.570199 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bbc469-99f6-4271-9c7e-23c8ee39e2f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:38:41.571674 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bbc469-99f6-4271-9c7e-23c8ee39e2f9 service neutron] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:38:41.590189 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 736/1487] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:38:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:38:43.714910 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13981786-28b4-4b16-9d4f-fcc8a0007fa2 None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:43.715455 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13981786-28b4-4b16-9d4f-fcc8a0007fa2 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:43.715455 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13981786-28b4-4b16-9d4f-fcc8a0007fa2 None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:43.716707 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 752/1488] 10.222.0.102 () {54 vars in 931 bytes} [Mon Aug 1 15:38:43 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 15:38:43.722725 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae194b1e-9b46-4c70-ba3d-3a7c012319bf None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:43.723129 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae194b1e-9b46-4c70-ba3d-3a7c012319bf None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:43.723261 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae194b1e-9b46-4c70-ba3d-3a7c012319bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:43.788193 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-ae194b1e-9b46-4c70-ba3d-3a7c012319bf None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:38:43.789426 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-ae194b1e-9b46-4c70-ba3d-3a7c012319bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:38:43.840506 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:38:43.884507 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 737/1489] 10.222.0.102 () {58 vars in 1028 bytes} [Mon Aug 1 15:38:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:38:43.925626 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13981786-28b4-4b16-9d4f-fcc8a0007fa2 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:38:43.927206 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-13981786-28b4-4b16-9d4f-fcc8a0007fa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:38:43.963827 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:38:44.033012 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13981786-28b4-4b16-9d4f-fcc8a0007fa2 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:38:44.105868 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45360c41-f2c8-469d-b8a5-d6b62e90513b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a856a413100443939fe9b10daa868518', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:38:44.106480 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45360c41-f2c8-469d-b8a5-d6b62e90513b service neutron] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:44.106756 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45360c41-f2c8-469d-b8a5-d6b62e90513b service neutron] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:44.107027 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45360c41-f2c8-469d-b8a5-d6b62e90513b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:44.108717 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-45360c41-f2c8-469d-b8a5-d6b62e90513b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:38:44.188415 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:38:44.219354 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45360c41-f2c8-469d-b8a5-d6b62e90513b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:38:44.220916 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45360c41-f2c8-469d-b8a5-d6b62e90513b service neutron] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:38:44.238636 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 753/1490] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:38:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 15:38:46.640512 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08299884-69b7-4cad-bf1a-356989dcbfb7 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:46.641078 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08299884-69b7-4cad-bf1a-356989dcbfb7 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:46.641078 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08299884-69b7-4cad-bf1a-356989dcbfb7 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:46.642389 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 738/1491] 10.222.0.102 () {54 vars in 931 bytes} [Mon Aug 1 15:38:46 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 15:38:46.647528 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6b9021-f00e-41cd-a546-00ea250dc3be None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:46.647915 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6b9021-f00e-41cd-a546-00ea250dc3be None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:46.648079 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6b9021-f00e-41cd-a546-00ea250dc3be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:46.713644 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-3c6b9021-f00e-41cd-a546-00ea250dc3be None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:38:46.714828 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-3c6b9021-f00e-41cd-a546-00ea250dc3be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:38:46.809326 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 754/1492] 10.222.0.102 () {58 vars in 1028 bytes} [Mon Aug 1 15:38:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:38:46.848912 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08299884-69b7-4cad-bf1a-356989dcbfb7 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:38:46.850460 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-08299884-69b7-4cad-bf1a-356989dcbfb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:38:46.961108 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08299884-69b7-4cad-bf1a-356989dcbfb7 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:38:47.035788 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947b4de5-7228-461e-98f3-bc6946fce1cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a856a413100443939fe9b10daa868518', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:38:47.036420 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947b4de5-7228-461e-98f3-bc6946fce1cd service neutron] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:38:47.036701 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947b4de5-7228-461e-98f3-bc6946fce1cd service neutron] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:38:47.037009 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947b4de5-7228-461e-98f3-bc6946fce1cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:38:47.038656 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-947b4de5-7228-461e-98f3-bc6946fce1cd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:38:47.048553 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:38:47.152787 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947b4de5-7228-461e-98f3-bc6946fce1cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:38:47.154238 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947b4de5-7228-461e-98f3-bc6946fce1cd service neutron] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:38:47.173373 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 739/1493] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:38:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:38:56.807485 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=82 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:38:57.170761 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=50 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:40:27.066902 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b17293e-cefb-4b82-be02-7eaf21e0b2ea None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:40:27.067559 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b17293e-cefb-4b82-be02-7eaf21e0b2ea None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:40:27.067559 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b17293e-cefb-4b82-be02-7eaf21e0b2ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:40:27.144448 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-6b17293e-cefb-4b82-be02-7eaf21e0b2ea None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:40:27.145631 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-6b17293e-cefb-4b82-be02-7eaf21e0b2ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:40:27.243605 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 755/1494] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:40:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:40:27.252286 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1c1cf5-77db-415a-be92-8dfc21707399 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:40:27.252774 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1c1cf5-77db-415a-be92-8dfc21707399 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:40:27.252918 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1c1cf5-77db-415a-be92-8dfc21707399 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:40:27.332165 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-9e1c1cf5-77db-415a-be92-8dfc21707399 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:40:27.333468 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-9e1c1cf5-77db-415a-be92-8dfc21707399 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:40:27.428661 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 740/1495] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:40:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:40:27.433368 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b17293e-cefb-4b82-be02-7eaf21e0b2ea None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:40:27.434581 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-6b17293e-cefb-4b82-be02-7eaf21e0b2ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:40:27.446721 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b17293e-cefb-4b82-be02-7eaf21e0b2ea None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:40:27.508070 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:40:27.541012 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca376260-78df-41ee-abd4-46b80365dc0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:40:27.541629 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca376260-78df-41ee-abd4-46b80365dc0c admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:40:27.541907 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca376260-78df-41ee-abd4-46b80365dc0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:40:27.542180 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca376260-78df-41ee-abd4-46b80365dc0c admin admin] PATH_INFO: `/v3/domains` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:40:27.542863 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca376260-78df-41ee-abd4-46b80365dc0c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:40:27.543168 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca376260-78df-41ee-abd4-46b80365dc0c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:40:27.544186 dv-cinder-843277-7-smb devstack@keystone.service[80352]: WARNING py.warnings [None req-ca376260-78df-41ee-abd4-46b80365dc0c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 01 15:40:27.544186 dv-cinder-843277-7-smb devstack@keystone.service[80352]: warnings.warn(msg) Aug 01 15:40:27.544186 dv-cinder-843277-7-smb devstack@keystone.service[80352]: Aug 01 15:40:27.545110 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca376260-78df-41ee-abd4-46b80365dc0c admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:40:27.557462 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 756/1496] 10.222.0.102 () {58 vars in 1158 bytes} [Mon Aug 1 15:40:27 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:40:27.565763 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1c1cf5-77db-415a-be92-8dfc21707399 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:40:27.574858 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1c1cf5-77db-415a-be92-8dfc21707399 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:40:27.634744 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:40:27.667149 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf49120d-e6a5-4120-a5f1-56143ea785ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:40:27.667753 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf49120d-e6a5-4120-a5f1-56143ea785ff admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:40:27.668033 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf49120d-e6a5-4120-a5f1-56143ea785ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:40:27.668300 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf49120d-e6a5-4120-a5f1-56143ea785ff admin admin] PATH_INFO: `/v3/projects` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:40:27.668982 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf49120d-e6a5-4120-a5f1-56143ea785ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:40:27.670699 dv-cinder-843277-7-smb devstack@keystone.service[80353]: WARNING py.warnings [None req-cf49120d-e6a5-4120-a5f1-56143ea785ff admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 01 15:40:27.670699 dv-cinder-843277-7-smb devstack@keystone.service[80353]: warnings.warn(msg) Aug 01 15:40:27.670699 dv-cinder-843277-7-smb devstack@keystone.service[80353]: Aug 01 15:40:27.671958 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf49120d-e6a5-4120-a5f1-56143ea785ff admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:40:27.800724 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 741/1497] 10.222.0.102 () {60 vars in 1158 bytes} [Mon Aug 1 15:40:27 2022] POST /identity/v3/projects => generated 378 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:40:27.804989 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca376260-78df-41ee-abd4-46b80365dc0c admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:40:27.806525 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-ca376260-78df-41ee-abd4-46b80365dc0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:40:27.841393 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca376260-78df-41ee-abd4-46b80365dc0c admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:40:27.934994 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba073244-79b7-48a8-bdff-54e04947d391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:40:27.935625 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba073244-79b7-48a8-bdff-54e04947d391 admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:40:27.935899 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba073244-79b7-48a8-bdff-54e04947d391 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:40:27.936169 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba073244-79b7-48a8-bdff-54e04947d391 admin admin] PATH_INFO: `/v3/users` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:40:27.936826 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba073244-79b7-48a8-bdff-54e04947d391 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:40:27.937851 dv-cinder-843277-7-smb devstack@keystone.service[80352]: WARNING py.warnings [None req-ba073244-79b7-48a8-bdff-54e04947d391 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 01 15:40:27.937851 dv-cinder-843277-7-smb devstack@keystone.service[80352]: warnings.warn(msg) Aug 01 15:40:27.937851 dv-cinder-843277-7-smb devstack@keystone.service[80352]: Aug 01 15:40:27.939105 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba073244-79b7-48a8-bdff-54e04947d391 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:40:28.099560 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 757/1498] 10.222.0.102 () {60 vars in 1149 bytes} [Mon Aug 1 15:40:27 2022] POST /identity/v3/users => generated 290 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:40:28.102801 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf49120d-e6a5-4120-a5f1-56143ea785ff admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:40:28.104327 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-cf49120d-e6a5-4120-a5f1-56143ea785ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:40:28.165998 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf49120d-e6a5-4120-a5f1-56143ea785ff admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:40:28.248668 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:40:28.259541 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d055ea-d1fc-47b3-83d5-817e5a5322aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:40:28.260214 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d055ea-d1fc-47b3-83d5-817e5a5322aa admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:40:28.260495 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d055ea-d1fc-47b3-83d5-817e5a5322aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:40:28.260768 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d055ea-d1fc-47b3-83d5-817e5a5322aa admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:40:28.261523 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d055ea-d1fc-47b3-83d5-817e5a5322aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:40:28.262529 dv-cinder-843277-7-smb devstack@keystone.service[80353]: WARNING py.warnings [None req-38d055ea-d1fc-47b3-83d5-817e5a5322aa admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 01 15:40:28.262529 dv-cinder-843277-7-smb devstack@keystone.service[80353]: warnings.warn(msg) Aug 01 15:40:28.262529 dv-cinder-843277-7-smb devstack@keystone.service[80353]: Aug 01 15:40:28.263420 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d055ea-d1fc-47b3-83d5-817e5a5322aa admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:40:28.276472 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 742/1499] 10.222.0.102 () {58 vars in 1127 bytes} [Mon Aug 1 15:40:28 2022] GET /identity/v3/roles => generated 1427 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 15:40:28.280590 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba073244-79b7-48a8-bdff-54e04947d391 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:40:28.282115 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-ba073244-79b7-48a8-bdff-54e04947d391 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:40:28.293883 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba073244-79b7-48a8-bdff-54e04947d391 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:40:28.328817 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:40:28.401784 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3c4f1c-7d53-4d49-a3bd-3f593f8e3dca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:40:28.402328 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3c4f1c-7d53-4d49-a3bd-3f593f8e3dca admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:40:28.402604 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3c4f1c-7d53-4d49-a3bd-3f593f8e3dca admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:40:28.402873 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3c4f1c-7d53-4d49-a3bd-3f593f8e3dca admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:40:28.403565 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3c4f1c-7d53-4d49-a3bd-3f593f8e3dca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:40:28.404595 dv-cinder-843277-7-smb devstack@keystone.service[80352]: WARNING py.warnings [None req-3a3c4f1c-7d53-4d49-a3bd-3f593f8e3dca admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 01 15:40:28.404595 dv-cinder-843277-7-smb devstack@keystone.service[80352]: warnings.warn(msg) Aug 01 15:40:28.404595 dv-cinder-843277-7-smb devstack@keystone.service[80352]: Aug 01 15:40:28.405600 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3c4f1c-7d53-4d49-a3bd-3f593f8e3dca admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:40:28.423599 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 758/1500] 10.222.0.102 () {58 vars in 1127 bytes} [Mon Aug 1 15:40:28 2022] GET /identity/v3/roles => generated 1427 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:40:28.424814 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d055ea-d1fc-47b3-83d5-817e5a5322aa admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:40:28.426611 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-38d055ea-d1fc-47b3-83d5-817e5a5322aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:40:28.462913 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d055ea-d1fc-47b3-83d5-817e5a5322aa admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:40:28.558418 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793c6ff5-8031-45b9-ab64-e7e73d159bf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:40:28.559090 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793c6ff5-8031-45b9-ab64-e7e73d159bf2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:40:28.559365 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793c6ff5-8031-45b9-ab64-e7e73d159bf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:40:28.559635 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793c6ff5-8031-45b9-ab64-e7e73d159bf2 admin admin] PATH_INFO: `/v3/projects/9ced4efcb2ab46509acafe097b5fbba8/users/33fb2d6f9a72464ab3da5d7e09564189/roles/27f5093ac0674d799cdbd17c68482e32` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:40:28.582611 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793c6ff5-8031-45b9-ab64-e7e73d159bf2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ced4efcb2ab46509acafe097b5fbba8, user_id=33fb2d6f9a72464ab3da5d7e09564189, role_id=27f5093ac0674d799cdbd17c68482e32)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:40:28.583825 dv-cinder-843277-7-smb devstack@keystone.service[80353]: WARNING py.warnings [None req-793c6ff5-8031-45b9-ab64-e7e73d159bf2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 01 15:40:28.583825 dv-cinder-843277-7-smb devstack@keystone.service[80353]: warnings.warn(msg) Aug 01 15:40:28.583825 dv-cinder-843277-7-smb devstack@keystone.service[80353]: Aug 01 15:40:28.587054 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793c6ff5-8031-45b9-ab64-e7e73d159bf2 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:40:28.692492 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 743/1501] 10.222.0.102 () {60 vars in 1488 bytes} [Mon Aug 1 15:40:28 2022] PUT /identity/v3/projects/9ced4efcb2ab46509acafe097b5fbba8/users/33fb2d6f9a72464ab3da5d7e09564189/roles/27f5093ac0674d799cdbd17c68482e32 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:40:28.705096 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51985cfe-adb0-4cb0-9c10-d5c56d3f9497 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:40:28.705412 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51985cfe-adb0-4cb0-9c10-d5c56d3f9497 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:40:28.705741 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51985cfe-adb0-4cb0-9c10-d5c56d3f9497 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:40:28.762843 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-51985cfe-adb0-4cb0-9c10-d5c56d3f9497 None None] MFA Rules not processed for user `33fb2d6f9a72464ab3da5d7e09564189`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:40:28.764174 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-51985cfe-adb0-4cb0-9c10-d5c56d3f9497 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:40:28.839834 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 759/1502] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:40:28 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:40:28.853012 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084a9cd4-e6be-4cc9-bc5f-b5a2c85cbccc None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:40:28.853297 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084a9cd4-e6be-4cc9-bc5f-b5a2c85cbccc None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:40:28.853570 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084a9cd4-e6be-4cc9-bc5f-b5a2c85cbccc None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:40:28.854916 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 744/1503] 10.222.0.102 () {54 vars in 969 bytes} [Mon Aug 1 15:40:28 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 15:40:28.859890 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6702358a-d0ec-4c40-8139-9d8898deec36 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:40:28.860181 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6702358a-d0ec-4c40-8139-9d8898deec36 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:40:28.860457 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6702358a-d0ec-4c40-8139-9d8898deec36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:40:28.892823 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:40:28.938192 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-6702358a-d0ec-4c40-8139-9d8898deec36 None None] MFA Rules not processed for user `ff810b37183c4729859c1b05edff1703`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:40:28.939404 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-6702358a-d0ec-4c40-8139-9d8898deec36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:40:29.015077 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 760/1504] 10.222.0.102 () {58 vars in 1066 bytes} [Mon Aug 1 15:40:28 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:40:29.022893 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084a9cd4-e6be-4cc9-bc5f-b5a2c85cbccc None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:40:29.024395 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-084a9cd4-e6be-4cc9-bc5f-b5a2c85cbccc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:40:29.078677 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:40:29.132042 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084a9cd4-e6be-4cc9-bc5f-b5a2c85cbccc None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:40:29.206725 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807b130e-2d23-4d88-884d-d0e5280e4d99 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff810b37183c4729859c1b05edff1703', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:40:29.207379 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807b130e-2d23-4d88-884d-d0e5280e4d99 service cinder] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:40:29.207696 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807b130e-2d23-4d88-884d-d0e5280e4d99 service cinder] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:40:29.207966 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807b130e-2d23-4d88-884d-d0e5280e4d99 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:40:29.209625 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-807b130e-2d23-4d88-884d-d0e5280e4d99 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:40:29.308638 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807b130e-2d23-4d88-884d-d0e5280e4d99 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:40:29.310048 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807b130e-2d23-4d88-884d-d0e5280e4d99 service cinder] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:40:29.313569 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:40:29.327915 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 745/1505] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:40:29 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:40:29.374549 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8848b504-f05c-4233-a3be-d99966b58448 None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:40:29.374998 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8848b504-f05c-4233-a3be-d99966b58448 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:40:29.375106 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8848b504-f05c-4233-a3be-d99966b58448 None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:40:29.376363 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 761/1506] 10.222.0.102 () {52 vars in 835 bytes} [Mon Aug 1 15:40:29 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 15:40:29.379879 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807b130e-2d23-4d88-884d-d0e5280e4d99 service cinder] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:40:29.381163 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-807b130e-2d23-4d88-884d-d0e5280e4d99 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:40:29.481078 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807b130e-2d23-4d88-884d-d0e5280e4d99 service cinder] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:40:29.573071 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93395e0-6598-4428-a5f6-ffed02499e60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:40:29.573626 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93395e0-6598-4428-a5f6-ffed02499e60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:40:29.573906 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93395e0-6598-4428-a5f6-ffed02499e60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:40:29.574178 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93395e0-6598-4428-a5f6-ffed02499e60 admin admin] PATH_INFO: `/v3/users/33fb2d6f9a72464ab3da5d7e09564189` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:40:29.587230 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93395e0-6598-4428-a5f6-ffed02499e60 admin admin] RBAC: Authorizing `identity:delete_user(user_id=33fb2d6f9a72464ab3da5d7e09564189)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:40:29.588248 dv-cinder-843277-7-smb devstack@keystone.service[80353]: WARNING py.warnings [None req-d93395e0-6598-4428-a5f6-ffed02499e60 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 01 15:40:29.588248 dv-cinder-843277-7-smb devstack@keystone.service[80353]: warnings.warn(msg) Aug 01 15:40:29.588248 dv-cinder-843277-7-smb devstack@keystone.service[80353]: Aug 01 15:40:29.589518 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93395e0-6598-4428-a5f6-ffed02499e60 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:40:29.599561 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:40:29.832320 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-d93395e0-6598-4428-a5f6-ffed02499e60 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33fb2d6f9a72464ab3da5d7e09564189'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:40:29.908195 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-d93395e0-6598-4428-a5f6-ffed02499e60 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33fb2d6f9a72464ab3da5d7e09564189'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:40:29.931356 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-d93395e0-6598-4428-a5f6-ffed02499e60 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33fb2d6f9a72464ab3da5d7e09564189'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:40:29.931819 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-d93395e0-6598-4428-a5f6-ffed02499e60 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33fb2d6f9a72464ab3da5d7e09564189'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:40:29.932324 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-d93395e0-6598-4428-a5f6-ffed02499e60 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33fb2d6f9a72464ab3da5d7e09564189'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:40:29.952003 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 746/1507] 10.222.0.102 () {58 vars in 1229 bytes} [Mon Aug 1 15:40:29 2022] DELETE /identity/v3/users/33fb2d6f9a72464ab3da5d7e09564189 => generated 0 bytes in 573 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:40:29.957057 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41eef24f-9ad0-4b13-8818-6d6317309f7f None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:40:29.957349 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41eef24f-9ad0-4b13-8818-6d6317309f7f None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:40:29.957626 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41eef24f-9ad0-4b13-8818-6d6317309f7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:40:30.014451 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-41eef24f-9ad0-4b13-8818-6d6317309f7f None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:40:30.015648 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-41eef24f-9ad0-4b13-8818-6d6317309f7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:40:30.090499 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:40:30.103189 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 762/1508] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:40:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:40:30.113789 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93395e0-6598-4428-a5f6-ffed02499e60 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:40:30.115094 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-d93395e0-6598-4428-a5f6-ffed02499e60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:40:30.214688 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93395e0-6598-4428-a5f6-ffed02499e60 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:40:30.271331 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:40:30.290137 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912bed16-cf14-4ec5-996d-e87cffbcbf63 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a856a413100443939fe9b10daa868518', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:40:30.290763 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912bed16-cf14-4ec5-996d-e87cffbcbf63 service neutron] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:40:30.291047 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912bed16-cf14-4ec5-996d-e87cffbcbf63 service neutron] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:40:30.291346 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912bed16-cf14-4ec5-996d-e87cffbcbf63 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:40:30.293006 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-912bed16-cf14-4ec5-996d-e87cffbcbf63 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:40:30.403469 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912bed16-cf14-4ec5-996d-e87cffbcbf63 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:40:30.404883 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912bed16-cf14-4ec5-996d-e87cffbcbf63 service neutron] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:40:30.423700 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 747/1509] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:40:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:40:30.979998 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41eef24f-9ad0-4b13-8818-6d6317309f7f None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:40:30.981384 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-41eef24f-9ad0-4b13-8818-6d6317309f7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:40:30.993967 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41eef24f-9ad0-4b13-8818-6d6317309f7f None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:40:31.089419 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70c48c6-7ad9-4f78-b772-47b33dc5858a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:40:31.090060 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70c48c6-7ad9-4f78-b772-47b33dc5858a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:40:31.090339 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70c48c6-7ad9-4f78-b772-47b33dc5858a admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:40:31.090614 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70c48c6-7ad9-4f78-b772-47b33dc5858a admin admin] PATH_INFO: `/v3/projects/9ced4efcb2ab46509acafe097b5fbba8` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:40:31.101254 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70c48c6-7ad9-4f78-b772-47b33dc5858a admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ced4efcb2ab46509acafe097b5fbba8)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:40:31.102289 dv-cinder-843277-7-smb devstack@keystone.service[80352]: WARNING py.warnings [None req-f70c48c6-7ad9-4f78-b772-47b33dc5858a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 01 15:40:31.102289 dv-cinder-843277-7-smb devstack@keystone.service[80352]: warnings.warn(msg) Aug 01 15:40:31.102289 dv-cinder-843277-7-smb devstack@keystone.service[80352]: Aug 01 15:40:31.103502 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70c48c6-7ad9-4f78-b772-47b33dc5858a admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:40:31.222654 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-f70c48c6-7ad9-4f78-b772-47b33dc5858a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ced4efcb2ab46509acafe097b5fbba8', 'request_id': 'req-f70c48c6-7ad9-4f78-b772-47b33dc5858a'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:40:31.237133 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-f70c48c6-7ad9-4f78-b772-47b33dc5858a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ced4efcb2ab46509acafe097b5fbba8', 'request_id': 'req-f70c48c6-7ad9-4f78-b772-47b33dc5858a'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:40:31.331415 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-f70c48c6-7ad9-4f78-b772-47b33dc5858a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ced4efcb2ab46509acafe097b5fbba8', 'request_id': 'req-f70c48c6-7ad9-4f78-b772-47b33dc5858a'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:40:31.356125 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-f70c48c6-7ad9-4f78-b772-47b33dc5858a admin admin] The token cache is being invalidate because project 9ced4efcb2ab46509acafe097b5fbba8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80352) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 15:40:31.356413 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-f70c48c6-7ad9-4f78-b772-47b33dc5858a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:40:31.356973 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-f70c48c6-7ad9-4f78-b772-47b33dc5858a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:40:31.358321 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 763/1510] 10.222.0.102 () {58 vars in 1238 bytes} [Mon Aug 1 15:40:30 2022] DELETE /identity/v3/projects/9ced4efcb2ab46509acafe097b5fbba8 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:40:40.421373 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=62 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:40:41.354083 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:42:25.823386 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c7c9b2-cc64-404a-8614-7f998bbdc061 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:42:25.824023 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c7c9b2-cc64-404a-8614-7f998bbdc061 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:42:25.824023 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c7c9b2-cc64-404a-8614-7f998bbdc061 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:42:25.825360 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 748/1511] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 1 15:42:25 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 15:42:25.830291 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fe432c-b9e4-4881-9087-286cde0707a2 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:42:25.830740 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fe432c-b9e4-4881-9087-286cde0707a2 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:42:25.830867 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fe432c-b9e4-4881-9087-286cde0707a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:42:25.918628 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-a6fe432c-b9e4-4881-9087-286cde0707a2 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:42:25.919846 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-a6fe432c-b9e4-4881-9087-286cde0707a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:42:26.030347 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 764/1512] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 1 15:42:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:42:26.193298 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c7c9b2-cc64-404a-8614-7f998bbdc061 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:42:26.195439 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-c6c7c9b2-cc64-404a-8614-7f998bbdc061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:42:26.314338 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c7c9b2-cc64-404a-8614-7f998bbdc061 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:42:26.320080 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f3ba41-83af-438d-a4d7-a36f08f7abf7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77b43f1ee8cc4be3907a494abe90c1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:42:26.321355 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f3ba41-83af-438d-a4d7-a36f08f7abf7 service nova] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:42:26.321647 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f3ba41-83af-438d-a4d7-a36f08f7abf7 service nova] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:42:26.321923 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f3ba41-83af-438d-a4d7-a36f08f7abf7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:42:26.330656 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f3ba41-83af-438d-a4d7-a36f08f7abf7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:42:26.332267 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f3ba41-83af-438d-a4d7-a36f08f7abf7 service nova] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:42:26.342175 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 749/1513] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:42:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:42:27.175613 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a8fb4c-d57d-42f0-ac45-b788e376dd30 None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:42:27.176163 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a8fb4c-d57d-42f0-ac45-b788e376dd30 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:42:27.176272 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a8fb4c-d57d-42f0-ac45-b788e376dd30 None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:42:27.177688 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 765/1514] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 1 15:42:27 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 15:42:27.183079 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b801d00-472c-4874-93ab-7be34181bc00 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:42:27.183488 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b801d00-472c-4874-93ab-7be34181bc00 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:42:27.183631 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b801d00-472c-4874-93ab-7be34181bc00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:42:27.203782 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-3b801d00-472c-4874-93ab-7be34181bc00 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:42:27.205021 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-3b801d00-472c-4874-93ab-7be34181bc00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:42:27.212814 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 750/1515] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 1 15:42:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:42:27.364200 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a8fb4c-d57d-42f0-ac45-b788e376dd30 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:42:27.378834 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a8fb4c-d57d-42f0-ac45-b788e376dd30 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:42:27.384768 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a320e8-9f08-4980-8c09-492ca77eb370 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77b43f1ee8cc4be3907a494abe90c1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:42:27.385406 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a320e8-9f08-4980-8c09-492ca77eb370 service nova] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:42:27.385688 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a320e8-9f08-4980-8c09-492ca77eb370 service nova] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:42:27.385962 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a320e8-9f08-4980-8c09-492ca77eb370 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:42:27.394431 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a320e8-9f08-4980-8c09-492ca77eb370 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:42:27.396057 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a320e8-9f08-4980-8c09-492ca77eb370 service nova] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:42:27.408582 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 766/1516] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:42:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:42:27.502818 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ad1df5-7c41-413f-8107-72a92814d338 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:42:27.503103 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ad1df5-7c41-413f-8107-72a92814d338 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:42:27.503382 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ad1df5-7c41-413f-8107-72a92814d338 None None] PATH_INFO: `/v3` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:42:27.504693 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 751/1517] 10.222.0.65 () {54 vars in 929 bytes} [Mon Aug 1 15:42:27 2022] GET /identity/v3 => generated 256 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:42:27.512445 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148b5d24-9ee9-4570-bac8-ac91ab62e023 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:42:27.512728 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148b5d24-9ee9-4570-bac8-ac91ab62e023 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:42:27.513069 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148b5d24-9ee9-4570-bac8-ac91ab62e023 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:42:27.573735 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-148b5d24-9ee9-4570-bac8-ac91ab62e023 None None] MFA Rules not processed for user `b78f5749fe9c46a389c88bb9c222cc73`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:42:27.574935 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-148b5d24-9ee9-4570-bac8-ac91ab62e023 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:42:27.592389 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:42:27.648544 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 767/1518] 10.222.0.65 () {58 vars in 1019 bytes} [Mon Aug 1 15:42:27 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 15:42:37.120024 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c092f7-b227-42e8-b887-365876e335cb None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:42:37.120536 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c092f7-b227-42e8-b887-365876e335cb None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:42:37.120536 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c092f7-b227-42e8-b887-365876e335cb None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:42:37.121937 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 752/1519] 10.222.0.102 () {54 vars in 966 bytes} [Mon Aug 1 15:42:37 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 15:42:37.126913 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc617e9-8365-44ce-90f9-63147aa6926a None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:42:37.127330 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc617e9-8365-44ce-90f9-63147aa6926a None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:42:37.127511 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc617e9-8365-44ce-90f9-63147aa6926a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:42:37.147029 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-3fc617e9-8365-44ce-90f9-63147aa6926a None None] MFA Rules not processed for user `b78f5749fe9c46a389c88bb9c222cc73`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:42:37.148250 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-3fc617e9-8365-44ce-90f9-63147aa6926a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:42:37.157343 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 768/1520] 10.222.0.102 () {58 vars in 1063 bytes} [Mon Aug 1 15:42:37 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:42:37.164720 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c092f7-b227-42e8-b887-365876e335cb None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:42:37.177991 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c092f7-b227-42e8-b887-365876e335cb None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:42:37.182893 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2a4fd3-2849-41e5-a70a-1f2e2fbb3448 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b78f5749fe9c46a389c88bb9c222cc73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:42:37.183486 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2a4fd3-2849-41e5-a70a-1f2e2fbb3448 service placement] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:42:37.183765 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2a4fd3-2849-41e5-a70a-1f2e2fbb3448 service placement] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:42:37.184035 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2a4fd3-2849-41e5-a70a-1f2e2fbb3448 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:42:37.192145 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2a4fd3-2849-41e5-a70a-1f2e2fbb3448 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:42:37.193748 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2a4fd3-2849-41e5-a70a-1f2e2fbb3448 service placement] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:42:37.204018 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 753/1521] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:42:37 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 15:42:38.651738 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee5567a-ac21-4c5b-ab4f-887a34d43cdf None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:42:38.652261 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee5567a-ac21-4c5b-ab4f-887a34d43cdf None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:42:38.652261 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee5567a-ac21-4c5b-ab4f-887a34d43cdf None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:42:38.653589 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 769/1522] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 1 15:42:38 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 15:42:38.658478 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb82333-7df4-4447-91ab-a69aa0fb8365 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:42:38.658881 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb82333-7df4-4447-91ab-a69aa0fb8365 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:42:38.659014 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb82333-7df4-4447-91ab-a69aa0fb8365 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:42:38.677935 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-6cb82333-7df4-4447-91ab-a69aa0fb8365 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:42:38.679168 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-6cb82333-7df4-4447-91ab-a69aa0fb8365 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:42:38.686972 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 754/1523] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 1 15:42:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:42:38.842629 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee5567a-ac21-4c5b-ab4f-887a34d43cdf None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:42:38.856806 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee5567a-ac21-4c5b-ab4f-887a34d43cdf None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:42:38.862168 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a28446d-cc73-4e42-b47e-44712a25d999 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77b43f1ee8cc4be3907a494abe90c1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:42:38.862766 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a28446d-cc73-4e42-b47e-44712a25d999 service nova] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:42:38.863042 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a28446d-cc73-4e42-b47e-44712a25d999 service nova] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:42:38.863314 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a28446d-cc73-4e42-b47e-44712a25d999 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:42:38.871351 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a28446d-cc73-4e42-b47e-44712a25d999 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:42:38.872982 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a28446d-cc73-4e42-b47e-44712a25d999 service nova] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:42:38.882550 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 770/1524] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:42:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:42:39.721530 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86109f97-83d7-4966-adcd-5622f0ead87d None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:42:39.722069 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86109f97-83d7-4966-adcd-5622f0ead87d None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:42:39.722069 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86109f97-83d7-4966-adcd-5622f0ead87d None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:42:39.723485 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 755/1525] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 1 15:42:39 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 15:42:39.728796 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee29aa1-b58e-40d2-be25-9ce094069ca4 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:42:39.729303 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee29aa1-b58e-40d2-be25-9ce094069ca4 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:42:39.729409 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee29aa1-b58e-40d2-be25-9ce094069ca4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:42:39.749608 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-6ee29aa1-b58e-40d2-be25-9ce094069ca4 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:42:39.750822 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-6ee29aa1-b58e-40d2-be25-9ce094069ca4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:42:39.758722 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 771/1526] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 1 15:42:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:42:39.910574 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86109f97-83d7-4966-adcd-5622f0ead87d None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:42:39.925588 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86109f97-83d7-4966-adcd-5622f0ead87d None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:42:39.930872 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fb4c55-f0ff-4937-8e91-17c107b0299e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77b43f1ee8cc4be3907a494abe90c1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:42:39.931495 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fb4c55-f0ff-4937-8e91-17c107b0299e service nova] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:42:39.931996 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fb4c55-f0ff-4937-8e91-17c107b0299e service nova] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:42:39.932273 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fb4c55-f0ff-4937-8e91-17c107b0299e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:42:39.940345 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fb4c55-f0ff-4937-8e91-17c107b0299e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:42:39.942000 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fb4c55-f0ff-4937-8e91-17c107b0299e service nova] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:42:39.951654 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 756/1527] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:42:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:42:43.810389 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4f2753-3931-4903-aa40-2b0455b83461 None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:42:43.810920 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4f2753-3931-4903-aa40-2b0455b83461 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:42:43.810920 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4f2753-3931-4903-aa40-2b0455b83461 None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:42:43.812198 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 772/1528] 127.0.0.1 () {54 vars in 916 bytes} [Mon Aug 1 15:42:43 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 15:42:43.817745 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbf7415-eac3-44d7-b18e-62267d87243b None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:42:43.818171 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbf7415-eac3-44d7-b18e-62267d87243b None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:42:43.818314 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbf7415-eac3-44d7-b18e-62267d87243b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:42:43.838064 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-0dbf7415-eac3-44d7-b18e-62267d87243b None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:42:43.839272 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-0dbf7415-eac3-44d7-b18e-62267d87243b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:42:43.846961 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 757/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Aug 1 15:42:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:42:43.918976 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4f2753-3931-4903-aa40-2b0455b83461 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:42:43.920779 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-bf4f2753-3931-4903-aa40-2b0455b83461 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:42:43.998816 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4f2753-3931-4903-aa40-2b0455b83461 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:42:44.002332 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f69fb2-d03e-4fc2-b2e1-1927fd282e83 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a856a413100443939fe9b10daa868518', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:42:44.002936 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f69fb2-d03e-4fc2-b2e1-1927fd282e83 service neutron] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:42:44.003214 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f69fb2-d03e-4fc2-b2e1-1927fd282e83 service neutron] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:42:44.003486 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f69fb2-d03e-4fc2-b2e1-1927fd282e83 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:42:44.012816 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f69fb2-d03e-4fc2-b2e1-1927fd282e83 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:42:44.014359 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f69fb2-d03e-4fc2-b2e1-1927fd282e83 service neutron] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:42:44.023589 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 773/1530] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:42:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:42:46.022761 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c94d873-8222-4767-839a-413726221fd7 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:42:46.023315 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c94d873-8222-4767-839a-413726221fd7 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:42:46.023315 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c94d873-8222-4767-839a-413726221fd7 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:42:46.024684 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 758/1531] 127.0.0.1 () {54 vars in 916 bytes} [Mon Aug 1 15:42:46 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 15:42:46.030466 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfca5e1-9d4f-473a-8d10-eda5762c65a6 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:42:46.030893 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfca5e1-9d4f-473a-8d10-eda5762c65a6 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:42:46.031008 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfca5e1-9d4f-473a-8d10-eda5762c65a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:42:46.050325 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-ccfca5e1-9d4f-473a-8d10-eda5762c65a6 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:42:46.051567 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-ccfca5e1-9d4f-473a-8d10-eda5762c65a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:42:46.059785 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 774/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Aug 1 15:42:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:42:46.095374 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c94d873-8222-4767-839a-413726221fd7 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:42:46.106205 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c94d873-8222-4767-839a-413726221fd7 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:42:46.109720 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8b6746-6127-4ae2-b0c6-52df0a3a6c34 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a856a413100443939fe9b10daa868518', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:42:46.110318 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8b6746-6127-4ae2-b0c6-52df0a3a6c34 service neutron] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:42:46.110600 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8b6746-6127-4ae2-b0c6-52df0a3a6c34 service neutron] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:42:46.110876 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8b6746-6127-4ae2-b0c6-52df0a3a6c34 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:42:46.120227 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8b6746-6127-4ae2-b0c6-52df0a3a6c34 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:42:46.121754 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8b6746-6127-4ae2-b0c6-52df0a3a6c34 service neutron] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:42:46.131396 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 759/1533] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:42:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:42:49.868764 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466ad759-ae7b-4d67-9ca3-4d229437be45 None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:42:49.869410 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466ad759-ae7b-4d67-9ca3-4d229437be45 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:42:49.869410 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466ad759-ae7b-4d67-9ca3-4d229437be45 None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:42:49.871209 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 775/1534] 127.0.0.1 () {54 vars in 916 bytes} [Mon Aug 1 15:42:49 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 15:42:49.876499 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bb3ff3-9ebe-4b33-816f-ec3fc5523a50 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:42:49.876974 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bb3ff3-9ebe-4b33-816f-ec3fc5523a50 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:42:49.877225 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bb3ff3-9ebe-4b33-816f-ec3fc5523a50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:42:49.897169 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-94bb3ff3-9ebe-4b33-816f-ec3fc5523a50 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:42:49.898384 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-94bb3ff3-9ebe-4b33-816f-ec3fc5523a50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:42:49.906192 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 760/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Aug 1 15:42:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:42:50.210029 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466ad759-ae7b-4d67-9ca3-4d229437be45 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:42:50.211717 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-466ad759-ae7b-4d67-9ca3-4d229437be45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:42:50.277617 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:42:50.290406 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466ad759-ae7b-4d67-9ca3-4d229437be45 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:42:50.294181 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2b898b-ebc4-4749-bb12-4f7251581806 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff810b37183c4729859c1b05edff1703', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:42:50.294789 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2b898b-ebc4-4749-bb12-4f7251581806 service cinder] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:42:50.295068 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2b898b-ebc4-4749-bb12-4f7251581806 service cinder] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:42:50.295345 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2b898b-ebc4-4749-bb12-4f7251581806 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:42:50.304301 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2b898b-ebc4-4749-bb12-4f7251581806 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:42:50.305761 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2b898b-ebc4-4749-bb12-4f7251581806 service cinder] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:42:50.315040 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 776/1536] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:42:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:42:52.339289 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da05e5e-8a7c-439c-9573-305646fa4579 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:42:52.339730 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da05e5e-8a7c-439c-9573-305646fa4579 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:42:52.339839 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da05e5e-8a7c-439c-9573-305646fa4579 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:42:52.341241 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 761/1537] 127.0.0.1 () {54 vars in 916 bytes} [Mon Aug 1 15:42:52 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 15:42:52.346392 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada5b0ea-d3ec-4513-92fd-14659caee617 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:42:52.346792 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada5b0ea-d3ec-4513-92fd-14659caee617 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:42:52.346937 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada5b0ea-d3ec-4513-92fd-14659caee617 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:42:52.366699 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-ada5b0ea-d3ec-4513-92fd-14659caee617 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:42:52.367889 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-ada5b0ea-d3ec-4513-92fd-14659caee617 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:42:52.376275 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 777/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Aug 1 15:42:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:42:52.679738 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da05e5e-8a7c-439c-9573-305646fa4579 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:42:52.681454 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-1da05e5e-8a7c-439c-9573-305646fa4579 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:42:52.689265 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=84 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:42:52.695452 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da05e5e-8a7c-439c-9573-305646fa4579 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:42:52.699795 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9446acd0-6937-4747-a679-a0f5b572223e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff810b37183c4729859c1b05edff1703', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:42:52.700465 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9446acd0-6937-4747-a679-a0f5b572223e service cinder] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:42:52.700744 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9446acd0-6937-4747-a679-a0f5b572223e service cinder] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:42:52.701048 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9446acd0-6937-4747-a679-a0f5b572223e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:42:52.710197 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9446acd0-6937-4747-a679-a0f5b572223e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:42:52.711613 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9446acd0-6937-4747-a679-a0f5b572223e service cinder] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:42:52.722112 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 762/1539] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:42:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:43:02.362136 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=11 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:43:02.747632 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=5 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:44:34.906855 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629cae73-536d-4bce-93a8-56601ccf778c None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:34.908065 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629cae73-536d-4bce-93a8-56601ccf778c None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:34.908578 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629cae73-536d-4bce-93a8-56601ccf778c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:34.941738 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-629cae73-536d-4bce-93a8-56601ccf778c None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:44:34.943408 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-629cae73-536d-4bce-93a8-56601ccf778c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:44:34.956651 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 778/1540] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:44:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:44:34.966116 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c1144d-4a6c-4aa6-829f-e141e9c8c722 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:34.966680 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c1144d-4a6c-4aa6-829f-e141e9c8c722 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:34.966680 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c1144d-4a6c-4aa6-829f-e141e9c8c722 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:34.991056 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-38c1144d-4a6c-4aa6-829f-e141e9c8c722 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:44:34.992267 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-38c1144d-4a6c-4aa6-829f-e141e9c8c722 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:44:35.010277 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 763/1541] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:44:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:44:35.015177 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629cae73-536d-4bce-93a8-56601ccf778c None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:44:35.030371 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629cae73-536d-4bce-93a8-56601ccf778c None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:44:35.041717 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fe1277-48e8-4810-90b3-2984df17f63d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:44:35.042753 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fe1277-48e8-4810-90b3-2984df17f63d admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:35.043281 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fe1277-48e8-4810-90b3-2984df17f63d admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:35.043867 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fe1277-48e8-4810-90b3-2984df17f63d admin admin] PATH_INFO: `/v3/domains` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:35.044796 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fe1277-48e8-4810-90b3-2984df17f63d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:44:35.045364 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fe1277-48e8-4810-90b3-2984df17f63d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:44:35.047221 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fe1277-48e8-4810-90b3-2984df17f63d admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:44:35.078273 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 779/1542] 10.222.0.102 () {58 vars in 1158 bytes} [Mon Aug 1 15:44:35 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:44:35.086470 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c1144d-4a6c-4aa6-829f-e141e9c8c722 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:44:35.097156 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c1144d-4a6c-4aa6-829f-e141e9c8c722 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:44:35.111749 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393f783c-3d50-4947-bf5f-24ed5d345f21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:44:35.112788 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393f783c-3d50-4947-bf5f-24ed5d345f21 admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:35.113101 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393f783c-3d50-4947-bf5f-24ed5d345f21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:35.113378 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393f783c-3d50-4947-bf5f-24ed5d345f21 admin admin] PATH_INFO: `/v3/projects` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:35.114081 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393f783c-3d50-4947-bf5f-24ed5d345f21 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:44:35.116030 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393f783c-3d50-4947-bf5f-24ed5d345f21 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:44:35.128219 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e71f75-3fe9-49c9-80d5-a5f4bc173b9d None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:35.128966 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e71f75-3fe9-49c9-80d5-a5f4bc173b9d None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:35.129501 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e71f75-3fe9-49c9-80d5-a5f4bc173b9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:35.174716 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-c6e71f75-3fe9-49c9-80d5-a5f4bc173b9d None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:44:35.176498 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-c6e71f75-3fe9-49c9-80d5-a5f4bc173b9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:44:35.193087 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 780/1543] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:44:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 15:44:35.203171 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165d364c-02eb-4c6c-b239-72f2e8c33774 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:35.203832 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165d364c-02eb-4c6c-b239-72f2e8c33774 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:35.204336 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165d364c-02eb-4c6c-b239-72f2e8c33774 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:35.234672 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-165d364c-02eb-4c6c-b239-72f2e8c33774 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:44:35.236512 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-165d364c-02eb-4c6c-b239-72f2e8c33774 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:44:35.248029 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 781/1544] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:44:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 15:44:35.256022 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165d364c-02eb-4c6c-b239-72f2e8c33774 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:44:35.259427 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 764/1545] 10.222.0.102 () {60 vars in 1158 bytes} [Mon Aug 1 15:44:35 2022] POST /identity/v3/projects => generated 366 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:44:35.263822 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393f783c-3d50-4947-bf5f-24ed5d345f21 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:44:35.269685 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165d364c-02eb-4c6c-b239-72f2e8c33774 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:44:35.377644 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393f783c-3d50-4947-bf5f-24ed5d345f21 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:44:35.391175 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b17d0b6-59f1-4c3b-923f-9fb69310dd74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:44:35.392701 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b17d0b6-59f1-4c3b-923f-9fb69310dd74 admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:35.393018 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b17d0b6-59f1-4c3b-923f-9fb69310dd74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:35.393300 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b17d0b6-59f1-4c3b-923f-9fb69310dd74 admin admin] PATH_INFO: `/v3/users` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:35.394292 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b17d0b6-59f1-4c3b-923f-9fb69310dd74 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:44:35.395509 dv-cinder-843277-7-smb devstack@keystone.service[80353]: WARNING py.warnings [None req-5b17d0b6-59f1-4c3b-923f-9fb69310dd74 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 01 15:44:35.395509 dv-cinder-843277-7-smb devstack@keystone.service[80353]: warnings.warn(msg) Aug 01 15:44:35.395509 dv-cinder-843277-7-smb devstack@keystone.service[80353]: Aug 01 15:44:35.397307 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b17d0b6-59f1-4c3b-923f-9fb69310dd74 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:44:35.445680 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fad0e3-d48a-4226-b77a-b4867cd63261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:44:35.446408 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fad0e3-d48a-4226-b77a-b4867cd63261 admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:35.446809 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fad0e3-d48a-4226-b77a-b4867cd63261 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:35.447192 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fad0e3-d48a-4226-b77a-b4867cd63261 admin admin] PATH_INFO: `/v3/domains` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:35.448114 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fad0e3-d48a-4226-b77a-b4867cd63261 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:44:35.448544 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fad0e3-d48a-4226-b77a-b4867cd63261 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:44:35.450337 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fad0e3-d48a-4226-b77a-b4867cd63261 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:44:35.471633 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 782/1546] 10.222.0.102 () {58 vars in 1158 bytes} [Mon Aug 1 15:44:35 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:44:35.473218 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684264aa-df4c-4563-8443-bc50580d0c1c None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:35.473511 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684264aa-df4c-4563-8443-bc50580d0c1c None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:35.473787 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684264aa-df4c-4563-8443-bc50580d0c1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:35.502758 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-684264aa-df4c-4563-8443-bc50580d0c1c None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:44:35.505018 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-684264aa-df4c-4563-8443-bc50580d0c1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:44:35.518964 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 783/1547] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:44:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:44:35.520238 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c525379c-c687-4414-b32c-ab6a4033f3f0 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:35.520526 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c525379c-c687-4414-b32c-ab6a4033f3f0 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:35.520810 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c525379c-c687-4414-b32c-ab6a4033f3f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:35.542592 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 765/1548] 10.222.0.102 () {60 vars in 1149 bytes} [Mon Aug 1 15:44:35 2022] POST /identity/v3/users => generated 284 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 15:44:35.544136 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b17d0b6-59f1-4c3b-923f-9fb69310dd74 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:44:35.547746 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-c525379c-c687-4414-b32c-ab6a4033f3f0 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:44:35.549047 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-c525379c-c687-4414-b32c-ab6a4033f3f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:44:35.562268 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b17d0b6-59f1-4c3b-923f-9fb69310dd74 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:44:35.567055 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 784/1549] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:44:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:44:35.569854 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc5af41-6d86-4655-a886-f1b0e7e7b2e8 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:35.571292 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc5af41-6d86-4655-a886-f1b0e7e7b2e8 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:35.572110 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc5af41-6d86-4655-a886-f1b0e7e7b2e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:35.576283 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219210e0-8696-45c1-afb1-c763f42e8ee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:44:35.577516 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219210e0-8696-45c1-afb1-c763f42e8ee4 admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:35.578036 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219210e0-8696-45c1-afb1-c763f42e8ee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:35.578650 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219210e0-8696-45c1-afb1-c763f42e8ee4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:35.580284 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219210e0-8696-45c1-afb1-c763f42e8ee4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:44:35.584431 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219210e0-8696-45c1-afb1-c763f42e8ee4 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:44:35.600623 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-1dc5af41-6d86-4655-a886-f1b0e7e7b2e8 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:44:35.601862 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-1dc5af41-6d86-4655-a886-f1b0e7e7b2e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:44:35.610803 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 785/1550] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:44:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:44:35.611780 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64ec8c7-9a88-46c6-896d-91006a6c2549 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:35.612059 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64ec8c7-9a88-46c6-896d-91006a6c2549 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:35.612324 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64ec8c7-9a88-46c6-896d-91006a6c2549 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:35.634630 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-f64ec8c7-9a88-46c6-896d-91006a6c2549 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:44:35.634972 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-f64ec8c7-9a88-46c6-896d-91006a6c2549 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:44:35.643902 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 786/1551] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:44:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:44:35.644827 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64ec8c7-9a88-46c6-896d-91006a6c2549 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:44:35.654712 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64ec8c7-9a88-46c6-896d-91006a6c2549 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:44:35.659393 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85da6ea-c138-4c1f-b669-61faed62e54a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:44:35.660023 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85da6ea-c138-4c1f-b669-61faed62e54a admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:35.660303 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85da6ea-c138-4c1f-b669-61faed62e54a admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:35.660577 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85da6ea-c138-4c1f-b669-61faed62e54a admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:35.661294 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85da6ea-c138-4c1f-b669-61faed62e54a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:44:35.662894 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85da6ea-c138-4c1f-b669-61faed62e54a admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:44:35.672994 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 787/1552] 10.222.0.102 () {58 vars in 1127 bytes} [Mon Aug 1 15:44:35 2022] GET /identity/v3/roles => generated 1427 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:44:35.674194 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58d7737-94f4-414e-90f2-031c38902ea2 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:35.674480 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58d7737-94f4-414e-90f2-031c38902ea2 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:35.674925 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58d7737-94f4-414e-90f2-031c38902ea2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:35.694225 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-d58d7737-94f4-414e-90f2-031c38902ea2 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:44:35.695440 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-d58d7737-94f4-414e-90f2-031c38902ea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:44:35.707060 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 788/1553] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:44:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:44:35.707060 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d600f3-8f4e-4c3c-8a36-bf660babaa01 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:35.707060 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d600f3-8f4e-4c3c-8a36-bf660babaa01 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:35.707060 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d600f3-8f4e-4c3c-8a36-bf660babaa01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:35.718241 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 766/1554] 10.222.0.102 () {60 vars in 1158 bytes} [Mon Aug 1 15:44:35 2022] POST /identity/v3/projects => generated 394 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:44:35.718241 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219210e0-8696-45c1-afb1-c763f42e8ee4 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:44:35.733311 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-69d600f3-8f4e-4c3c-8a36-bf660babaa01 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:44:35.734526 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-69d600f3-8f4e-4c3c-8a36-bf660babaa01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:44:35.781322 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219210e0-8696-45c1-afb1-c763f42e8ee4 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:44:35.786686 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece15c21-cce3-4533-b146-9285e4a24c7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:44:35.787364 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece15c21-cce3-4533-b146-9285e4a24c7e admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:35.787650 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece15c21-cce3-4533-b146-9285e4a24c7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:35.787924 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece15c21-cce3-4533-b146-9285e4a24c7e admin admin] PATH_INFO: `/v3/domains` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:35.788649 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece15c21-cce3-4533-b146-9285e4a24c7e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:44:35.788995 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece15c21-cce3-4533-b146-9285e4a24c7e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:44:35.790065 dv-cinder-843277-7-smb devstack@keystone.service[80353]: WARNING py.warnings [None req-ece15c21-cce3-4533-b146-9285e4a24c7e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 01 15:44:35.790065 dv-cinder-843277-7-smb devstack@keystone.service[80353]: warnings.warn(msg) Aug 01 15:44:35.790065 dv-cinder-843277-7-smb devstack@keystone.service[80353]: Aug 01 15:44:35.791084 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece15c21-cce3-4533-b146-9285e4a24c7e admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:44:35.794086 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 789/1555] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:44:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:44:35.795348 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1ef0fe-1504-46e2-84c1-b71212e0d2ba None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:35.795618 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1ef0fe-1504-46e2-84c1-b71212e0d2ba None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:35.795894 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1ef0fe-1504-46e2-84c1-b71212e0d2ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:35.804016 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 767/1556] 10.222.0.102 () {58 vars in 1158 bytes} [Mon Aug 1 15:44:35 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:44:35.805313 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c7c6b6-a8a7-4415-a848-bca37cd9a7e3 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:35.805601 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c7c6b6-a8a7-4415-a848-bca37cd9a7e3 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:35.805873 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c7c6b6-a8a7-4415-a848-bca37cd9a7e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:35.821595 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-7c1ef0fe-1504-46e2-84c1-b71212e0d2ba None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:44:35.822807 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-7c1ef0fe-1504-46e2-84c1-b71212e0d2ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:44:35.825291 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-b5c7c6b6-a8a7-4415-a848-bca37cd9a7e3 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:44:35.826724 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-b5c7c6b6-a8a7-4415-a848-bca37cd9a7e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:44:35.830923 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 790/1557] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:44:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:44:35.831695 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1ef0fe-1504-46e2-84c1-b71212e0d2ba None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:44:35.835183 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 768/1558] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:44:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:44:35.835955 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c7c6b6-a8a7-4415-a848-bca37cd9a7e3 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:44:35.845722 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c7c6b6-a8a7-4415-a848-bca37cd9a7e3 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:44:35.845894 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1ef0fe-1504-46e2-84c1-b71212e0d2ba None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:44:35.850365 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e492cd9e-1838-4ae7-9a1d-7c4c1a1c4ee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:44:35.850542 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be4014f-99de-4436-abbd-88f62b0feda2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:44:35.850970 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be4014f-99de-4436-abbd-88f62b0feda2 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:35.851098 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e492cd9e-1838-4ae7-9a1d-7c4c1a1c4ee3 admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:35.851249 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be4014f-99de-4436-abbd-88f62b0feda2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:35.851364 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e492cd9e-1838-4ae7-9a1d-7c4c1a1c4ee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:35.851527 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be4014f-99de-4436-abbd-88f62b0feda2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:35.851663 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e492cd9e-1838-4ae7-9a1d-7c4c1a1c4ee3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:35.852217 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be4014f-99de-4436-abbd-88f62b0feda2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:44:35.852326 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e492cd9e-1838-4ae7-9a1d-7c4c1a1c4ee3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:44:35.852634 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be4014f-99de-4436-abbd-88f62b0feda2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:44:35.853927 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e492cd9e-1838-4ae7-9a1d-7c4c1a1c4ee3 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:44:35.855246 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be4014f-99de-4436-abbd-88f62b0feda2 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:44:35.859238 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:44:35.865086 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 791/1559] 10.222.0.102 () {58 vars in 1127 bytes} [Mon Aug 1 15:44:35 2022] GET /identity/v3/roles => generated 1427 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:44:35.869205 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ea72ec-7077-4bf4-9a61-234dce930158 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:35.869205 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ea72ec-7077-4bf4-9a61-234dce930158 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:35.869205 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ea72ec-7077-4bf4-9a61-234dce930158 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:35.869511 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 769/1560] 10.222.0.102 () {58 vars in 1158 bytes} [Mon Aug 1 15:44:35 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:44:35.869511 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be4014f-99de-4436-abbd-88f62b0feda2 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:44:35.878499 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be4014f-99de-4436-abbd-88f62b0feda2 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:44:35.879388 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:44:35.883790 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ee3050-142d-4008-a2d5-98c609bbf51c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:44:35.884410 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ee3050-142d-4008-a2d5-98c609bbf51c admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:35.884694 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ee3050-142d-4008-a2d5-98c609bbf51c admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:35.885002 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ee3050-142d-4008-a2d5-98c609bbf51c admin admin] PATH_INFO: `/v3/users` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:35.885688 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ee3050-142d-4008-a2d5-98c609bbf51c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:44:35.887669 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ee3050-142d-4008-a2d5-98c609bbf51c admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:44:35.896502 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-85ea72ec-7077-4bf4-9a61-234dce930158 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:44:35.897940 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-85ea72ec-7077-4bf4-9a61-234dce930158 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:44:35.906165 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 792/1561] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:44:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:44:35.907420 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16af8423-a888-4f8a-b8d0-61f23d4bfda3 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:35.908551 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16af8423-a888-4f8a-b8d0-61f23d4bfda3 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:35.908551 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16af8423-a888-4f8a-b8d0-61f23d4bfda3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:35.930811 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-16af8423-a888-4f8a-b8d0-61f23d4bfda3 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:44:35.932208 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-16af8423-a888-4f8a-b8d0-61f23d4bfda3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:44:35.940301 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 793/1562] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:44:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:44:35.941185 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16af8423-a888-4f8a-b8d0-61f23d4bfda3 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:44:35.950564 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16af8423-a888-4f8a-b8d0-61f23d4bfda3 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:44:35.955936 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a012df7-1b70-4602-8d96-7bda2efd90c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:44:35.956511 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a012df7-1b70-4602-8d96-7bda2efd90c8 admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:35.956803 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a012df7-1b70-4602-8d96-7bda2efd90c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:35.957152 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a012df7-1b70-4602-8d96-7bda2efd90c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:35.957796 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a012df7-1b70-4602-8d96-7bda2efd90c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:44:35.958792 dv-cinder-843277-7-smb devstack@keystone.service[80352]: WARNING py.warnings [None req-7a012df7-1b70-4602-8d96-7bda2efd90c8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 01 15:44:35.958792 dv-cinder-843277-7-smb devstack@keystone.service[80352]: warnings.warn(msg) Aug 01 15:44:35.958792 dv-cinder-843277-7-smb devstack@keystone.service[80352]: Aug 01 15:44:35.960106 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a012df7-1b70-4602-8d96-7bda2efd90c8 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:44:36.010606 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 770/1563] 10.222.0.102 () {60 vars in 1149 bytes} [Mon Aug 1 15:44:35 2022] POST /identity/v3/users => generated 298 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:44:36.011450 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ee3050-142d-4008-a2d5-98c609bbf51c admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:44:36.021676 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ee3050-142d-4008-a2d5-98c609bbf51c admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:44:36.026549 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38451a0-4afc-4b77-8f17-086530456805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:44:36.027143 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38451a0-4afc-4b77-8f17-086530456805 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:36.027425 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38451a0-4afc-4b77-8f17-086530456805 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:36.027701 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38451a0-4afc-4b77-8f17-086530456805 admin admin] PATH_INFO: `/v3/domains` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:36.028383 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38451a0-4afc-4b77-8f17-086530456805 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:44:36.028689 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38451a0-4afc-4b77-8f17-086530456805 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:44:36.030323 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38451a0-4afc-4b77-8f17-086530456805 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:44:36.042566 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 771/1564] 10.222.0.102 () {58 vars in 1158 bytes} [Mon Aug 1 15:44:36 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:44:36.043691 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae93c83-4928-4ab1-8f1b-cd4d0d4f50df None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:36.044002 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae93c83-4928-4ab1-8f1b-cd4d0d4f50df None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:36.044285 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae93c83-4928-4ab1-8f1b-cd4d0d4f50df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:36.062857 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-5ae93c83-4928-4ab1-8f1b-cd4d0d4f50df None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:44:36.064096 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-5ae93c83-4928-4ab1-8f1b-cd4d0d4f50df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:44:36.072506 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 772/1565] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:44:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:44:36.073476 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae93c83-4928-4ab1-8f1b-cd4d0d4f50df None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:44:36.083616 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae93c83-4928-4ab1-8f1b-cd4d0d4f50df None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:44:36.088078 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2691a21-cc03-419f-99a3-8165597e45e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:44:36.088704 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2691a21-cc03-419f-99a3-8165597e45e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:36.089014 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2691a21-cc03-419f-99a3-8165597e45e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:36.089285 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2691a21-cc03-419f-99a3-8165597e45e5 admin admin] PATH_INFO: `/v3/projects/a2e80e0285d24fd2adb0371b8b777de0/users/8f070357a5b94f10bcf1b30b8174f71a/roles/27f5093ac0674d799cdbd17c68482e32` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:36.103682 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2691a21-cc03-419f-99a3-8165597e45e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2e80e0285d24fd2adb0371b8b777de0, user_id=8f070357a5b94f10bcf1b30b8174f71a, role_id=27f5093ac0674d799cdbd17c68482e32)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:44:36.106458 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2691a21-cc03-419f-99a3-8165597e45e5 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:44:36.153699 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 794/1566] 10.222.0.102 () {60 vars in 1158 bytes} [Mon Aug 1 15:44:35 2022] POST /identity/v3/projects => generated 378 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:44:36.154634 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a012df7-1b70-4602-8d96-7bda2efd90c8 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:44:36.215172 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a012df7-1b70-4602-8d96-7bda2efd90c8 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:44:36.219624 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32338eb-a8b2-48f8-a41a-ad1e70d52d31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:44:36.220237 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32338eb-a8b2-48f8-a41a-ad1e70d52d31 admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:36.220516 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32338eb-a8b2-48f8-a41a-ad1e70d52d31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:36.220784 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32338eb-a8b2-48f8-a41a-ad1e70d52d31 admin admin] PATH_INFO: `/v3/projects` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:36.221449 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32338eb-a8b2-48f8-a41a-ad1e70d52d31 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:44:36.223445 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32338eb-a8b2-48f8-a41a-ad1e70d52d31 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:44:36.267519 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 773/1567] 10.222.0.102 () {60 vars in 1488 bytes} [Mon Aug 1 15:44:36 2022] PUT /identity/v3/projects/a2e80e0285d24fd2adb0371b8b777de0/users/8f070357a5b94f10bcf1b30b8174f71a/roles/27f5093ac0674d799cdbd17c68482e32 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:44:36.269587 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e45cb1-8af3-4acf-99b9-95679f7f1abf None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:36.269873 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e45cb1-8af3-4acf-99b9-95679f7f1abf None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:36.270145 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e45cb1-8af3-4acf-99b9-95679f7f1abf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:36.289123 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-e7e45cb1-8af3-4acf-99b9-95679f7f1abf None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:44:36.290333 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-e7e45cb1-8af3-4acf-99b9-95679f7f1abf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:44:36.320614 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 795/1568] 10.222.0.102 () {60 vars in 1158 bytes} [Mon Aug 1 15:44:36 2022] POST /identity/v3/projects => generated 374 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:44:36.321846 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32338eb-a8b2-48f8-a41a-ad1e70d52d31 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:44:36.349760 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 774/1569] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:44:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:44:36.350748 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e45cb1-8af3-4acf-99b9-95679f7f1abf None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:44:36.360015 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e45cb1-8af3-4acf-99b9-95679f7f1abf None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:44:36.389680 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32338eb-a8b2-48f8-a41a-ad1e70d52d31 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:44:36.395440 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef92b2ea-54f2-485c-920a-9548c66ae2b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:44:36.395588 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef92b2ea-54f2-485c-920a-9548c66ae2b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:36.395752 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef92b2ea-54f2-485c-920a-9548c66ae2b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:36.396020 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef92b2ea-54f2-485c-920a-9548c66ae2b4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:36.396704 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef92b2ea-54f2-485c-920a-9548c66ae2b4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:44:36.397030 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef92b2ea-54f2-485c-920a-9548c66ae2b4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:44:36.398657 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef92b2ea-54f2-485c-920a-9548c66ae2b4 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:44:36.410284 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 796/1570] 10.222.0.102 () {58 vars in 1158 bytes} [Mon Aug 1 15:44:36 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:44:36.411062 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef92b2ea-54f2-485c-920a-9548c66ae2b4 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:44:36.420711 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef92b2ea-54f2-485c-920a-9548c66ae2b4 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:44:36.425376 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a646ee3-2b94-46b0-b995-412a2418f8c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:44:36.425971 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a646ee3-2b94-46b0-b995-412a2418f8c0 admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:36.426243 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a646ee3-2b94-46b0-b995-412a2418f8c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:36.426508 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a646ee3-2b94-46b0-b995-412a2418f8c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:36.427209 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a646ee3-2b94-46b0-b995-412a2418f8c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:44:36.427473 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa940f0e-75b1-4d51-9624-aba90a424408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:44:36.428205 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa940f0e-75b1-4d51-9624-aba90a424408 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:36.428488 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa940f0e-75b1-4d51-9624-aba90a424408 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:36.428760 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa940f0e-75b1-4d51-9624-aba90a424408 admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:36.429126 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a646ee3-2b94-46b0-b995-412a2418f8c0 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:44:36.429485 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa940f0e-75b1-4d51-9624-aba90a424408 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:44:36.431081 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa940f0e-75b1-4d51-9624-aba90a424408 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:44:36.441392 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 775/1571] 10.222.0.102 () {58 vars in 1127 bytes} [Mon Aug 1 15:44:36 2022] GET /identity/v3/roles => generated 1427 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:44:36.442199 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa940f0e-75b1-4d51-9624-aba90a424408 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:44:36.453259 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa940f0e-75b1-4d51-9624-aba90a424408 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:44:36.458422 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeac6f22-e242-44c1-9e3b-72f7c2f599c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:44:36.464095 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeac6f22-e242-44c1-9e3b-72f7c2f599c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:36.464095 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeac6f22-e242-44c1-9e3b-72f7c2f599c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:36.464095 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeac6f22-e242-44c1-9e3b-72f7c2f599c2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:36.464095 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeac6f22-e242-44c1-9e3b-72f7c2f599c2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:44:36.464095 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeac6f22-e242-44c1-9e3b-72f7c2f599c2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:44:36.464095 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeac6f22-e242-44c1-9e3b-72f7c2f599c2 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:44:36.474713 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 776/1572] 10.222.0.102 () {58 vars in 1158 bytes} [Mon Aug 1 15:44:36 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:44:36.475422 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeac6f22-e242-44c1-9e3b-72f7c2f599c2 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:44:36.485332 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeac6f22-e242-44c1-9e3b-72f7c2f599c2 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:44:36.490508 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabf078a-efe4-4685-9d8e-f886720d4047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:44:36.491091 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabf078a-efe4-4685-9d8e-f886720d4047 admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:36.491371 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabf078a-efe4-4685-9d8e-f886720d4047 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:36.491643 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabf078a-efe4-4685-9d8e-f886720d4047 admin admin] PATH_INFO: `/v3/users` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:36.492285 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabf078a-efe4-4685-9d8e-f886720d4047 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:44:36.494298 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabf078a-efe4-4685-9d8e-f886720d4047 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:44:36.538890 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 797/1573] 10.222.0.102 () {60 vars in 1158 bytes} [Mon Aug 1 15:44:36 2022] POST /identity/v3/projects => generated 378 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:44:36.539888 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827b816f-c622-4069-a5bb-1def895ef9dd None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:36.540176 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827b816f-c622-4069-a5bb-1def895ef9dd None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:36.540451 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827b816f-c622-4069-a5bb-1def895ef9dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:36.568800 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-827b816f-c622-4069-a5bb-1def895ef9dd None None] MFA Rules not processed for user `8f070357a5b94f10bcf1b30b8174f71a`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:44:36.570053 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-827b816f-c622-4069-a5bb-1def895ef9dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:44:36.579398 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:44:36.598975 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 777/1574] 10.222.0.102 () {60 vars in 1149 bytes} [Mon Aug 1 15:44:36 2022] POST /identity/v3/users => generated 290 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:44:36.600121 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabf078a-efe4-4685-9d8e-f886720d4047 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:44:36.611790 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabf078a-efe4-4685-9d8e-f886720d4047 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:44:36.616400 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:44:36.634085 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 798/1575] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:44:36 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:44:36.638952 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827b816f-c622-4069-a5bb-1def895ef9dd None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:44:36.670030 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a9d864-fc43-4116-8f7e-a17e64b458d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:44:36.670631 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a9d864-fc43-4116-8f7e-a17e64b458d1 admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:36.670914 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a9d864-fc43-4116-8f7e-a17e64b458d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:36.671186 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a9d864-fc43-4116-8f7e-a17e64b458d1 admin admin] PATH_INFO: `/v3/users` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:36.672220 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a9d864-fc43-4116-8f7e-a17e64b458d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:44:36.674691 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a9d864-fc43-4116-8f7e-a17e64b458d1 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:44:36.703546 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827b816f-c622-4069-a5bb-1def895ef9dd None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:44:36.708068 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47221361-ca6a-4eed-bba3-2e14b4d56815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:44:36.709327 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47221361-ca6a-4eed-bba3-2e14b4d56815 admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:36.709609 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47221361-ca6a-4eed-bba3-2e14b4d56815 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:36.709882 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47221361-ca6a-4eed-bba3-2e14b4d56815 admin admin] PATH_INFO: `/v3/domains` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:36.710692 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47221361-ca6a-4eed-bba3-2e14b4d56815 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:44:36.711089 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47221361-ca6a-4eed-bba3-2e14b4d56815 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:44:36.712703 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47221361-ca6a-4eed-bba3-2e14b4d56815 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:44:36.724280 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 799/1576] 10.222.0.102 () {58 vars in 1158 bytes} [Mon Aug 1 15:44:36 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:44:36.725103 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47221361-ca6a-4eed-bba3-2e14b4d56815 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:44:36.734310 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47221361-ca6a-4eed-bba3-2e14b4d56815 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:44:36.739570 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a3280a-74e8-4453-9765-9cbe0759a1fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:44:36.740143 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a3280a-74e8-4453-9765-9cbe0759a1fb admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:36.740415 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a3280a-74e8-4453-9765-9cbe0759a1fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:36.740682 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a3280a-74e8-4453-9765-9cbe0759a1fb admin admin] PATH_INFO: `/v3/projects` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:36.741346 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a3280a-74e8-4453-9765-9cbe0759a1fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:44:36.743193 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a3280a-74e8-4453-9765-9cbe0759a1fb admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:44:36.764938 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 778/1577] 10.222.0.102 () {60 vars in 1149 bytes} [Mon Aug 1 15:44:36 2022] POST /identity/v3/users => generated 288 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:44:36.768064 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a9d864-fc43-4116-8f7e-a17e64b458d1 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:44:36.775637 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a9d864-fc43-4116-8f7e-a17e64b458d1 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:44:36.780186 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cfc36a-5061-420e-ac30-920cadfe6ba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:44:36.780780 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cfc36a-5061-420e-ac30-920cadfe6ba9 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:36.781094 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cfc36a-5061-420e-ac30-920cadfe6ba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:36.781366 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cfc36a-5061-420e-ac30-920cadfe6ba9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:36.782044 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cfc36a-5061-420e-ac30-920cadfe6ba9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:44:36.783715 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cfc36a-5061-420e-ac30-920cadfe6ba9 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:44:36.794104 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 779/1578] 10.222.0.102 () {58 vars in 1127 bytes} [Mon Aug 1 15:44:36 2022] GET /identity/v3/roles => generated 1427 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:44:36.799457 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cfc36a-5061-420e-ac30-920cadfe6ba9 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:44:36.805028 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cfc36a-5061-420e-ac30-920cadfe6ba9 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:44:36.809647 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3124afb-13b9-43c1-9cb7-4ea3b6e261fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:44:36.810251 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3124afb-13b9-43c1-9cb7-4ea3b6e261fd admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:36.810535 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3124afb-13b9-43c1-9cb7-4ea3b6e261fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:36.810811 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3124afb-13b9-43c1-9cb7-4ea3b6e261fd admin admin] PATH_INFO: `/v3/projects` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:36.811447 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3124afb-13b9-43c1-9cb7-4ea3b6e261fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:44:36.813385 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3124afb-13b9-43c1-9cb7-4ea3b6e261fd admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:44:36.851786 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 800/1579] 10.222.0.102 () {60 vars in 1158 bytes} [Mon Aug 1 15:44:36 2022] POST /identity/v3/projects => generated 372 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:44:36.852926 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a3280a-74e8-4453-9765-9cbe0759a1fb admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:44:36.920275 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a3280a-74e8-4453-9765-9cbe0759a1fb admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:44:36.925550 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafa3b98-84f4-4558-b29b-7d68d23b23ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:44:36.926172 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafa3b98-84f4-4558-b29b-7d68d23b23ed admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:36.926448 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafa3b98-84f4-4558-b29b-7d68d23b23ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:36.926718 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafa3b98-84f4-4558-b29b-7d68d23b23ed admin admin] PATH_INFO: `/v3/users` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:36.927370 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafa3b98-84f4-4558-b29b-7d68d23b23ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:44:36.929338 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafa3b98-84f4-4558-b29b-7d68d23b23ed admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:44:36.940350 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 780/1580] 10.222.0.102 () {60 vars in 1158 bytes} [Mon Aug 1 15:44:36 2022] POST /identity/v3/projects => generated 386 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:44:36.940350 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3124afb-13b9-43c1-9cb7-4ea3b6e261fd admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:44:37.001663 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3124afb-13b9-43c1-9cb7-4ea3b6e261fd admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:44:37.006336 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e10224-cd03-41a5-9202-60e11d7fa8dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:44:37.006960 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e10224-cd03-41a5-9202-60e11d7fa8dd admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:37.007245 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e10224-cd03-41a5-9202-60e11d7fa8dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:37.007520 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e10224-cd03-41a5-9202-60e11d7fa8dd admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:37.008215 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e10224-cd03-41a5-9202-60e11d7fa8dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:44:37.009844 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e10224-cd03-41a5-9202-60e11d7fa8dd admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:44:37.019873 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 781/1581] 10.222.0.102 () {58 vars in 1127 bytes} [Mon Aug 1 15:44:36 2022] GET /identity/v3/roles => generated 1427 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:44:37.020658 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e10224-cd03-41a5-9202-60e11d7fa8dd admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:44:37.034207 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 801/1582] 10.222.0.102 () {60 vars in 1149 bytes} [Mon Aug 1 15:44:36 2022] POST /identity/v3/users => generated 290 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:44:37.034207 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafa3b98-84f4-4558-b29b-7d68d23b23ed admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:44:37.041612 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafa3b98-84f4-4558-b29b-7d68d23b23ed admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:44:37.046347 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae68a57-8ef2-4db4-befc-f9291566dcfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:44:37.046851 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae68a57-8ef2-4db4-befc-f9291566dcfe admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:37.047128 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae68a57-8ef2-4db4-befc-f9291566dcfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:37.047401 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae68a57-8ef2-4db4-befc-f9291566dcfe admin admin] PATH_INFO: `/v3/projects` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:37.048116 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae68a57-8ef2-4db4-befc-f9291566dcfe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:44:37.050101 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae68a57-8ef2-4db4-befc-f9291566dcfe admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:44:37.062185 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:44:37.078330 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e10224-cd03-41a5-9202-60e11d7fa8dd admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:44:37.083027 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d3a6a9-e8bc-4a1a-9aa6-553049af8ba6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff810b37183c4729859c1b05edff1703', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:44:37.083415 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d3a6a9-e8bc-4a1a-9aa6-553049af8ba6 service cinder] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:37.083699 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d3a6a9-e8bc-4a1a-9aa6-553049af8ba6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:37.083977 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d3a6a9-e8bc-4a1a-9aa6-553049af8ba6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:37.096690 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:44:37.139126 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d3a6a9-e8bc-4a1a-9aa6-553049af8ba6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:44:37.140550 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d3a6a9-e8bc-4a1a-9aa6-553049af8ba6 service cinder] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:44:37.150116 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 782/1583] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:44:37 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:44:37.150911 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d3a6a9-e8bc-4a1a-9aa6-553049af8ba6 service cinder] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:44:37.161001 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d3a6a9-e8bc-4a1a-9aa6-553049af8ba6 service cinder] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:44:37.169681 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e53e7d4-d84d-4eec-849a-5545a6bc6220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:44:37.173050 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 802/1584] 10.222.0.102 () {60 vars in 1158 bytes} [Mon Aug 1 15:44:37 2022] POST /identity/v3/projects => generated 368 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:44:37.173050 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae68a57-8ef2-4db4-befc-f9291566dcfe admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:44:37.173322 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e53e7d4-d84d-4eec-849a-5545a6bc6220 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:37.173451 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e53e7d4-d84d-4eec-849a-5545a6bc6220 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:37.173735 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e53e7d4-d84d-4eec-849a-5545a6bc6220 admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:37.174453 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e53e7d4-d84d-4eec-849a-5545a6bc6220 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:44:37.176115 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e53e7d4-d84d-4eec-849a-5545a6bc6220 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:44:37.195241 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 783/1585] 10.222.0.102 () {58 vars in 1127 bytes} [Mon Aug 1 15:44:37 2022] GET /identity/v3/roles => generated 1427 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:44:37.195241 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e53e7d4-d84d-4eec-849a-5545a6bc6220 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:44:37.202991 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e53e7d4-d84d-4eec-849a-5545a6bc6220 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:44:37.247121 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae68a57-8ef2-4db4-befc-f9291566dcfe admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:44:37.257544 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07445078-1e34-462d-a5b9-a196789ad9a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:44:37.259103 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07445078-1e34-462d-a5b9-a196789ad9a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:37.260004 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07445078-1e34-462d-a5b9-a196789ad9a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:37.260588 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07445078-1e34-462d-a5b9-a196789ad9a6 admin admin] PATH_INFO: `/v3/projects/119e3d5823e94fa38f30e8be15f4f98e/users/82ab36c0e0804e4d8aaff377095aade7/roles/27f5093ac0674d799cdbd17c68482e32` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:37.276052 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb49b593-cd1a-4c11-9157-a315e78b5d23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:44:37.276677 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb49b593-cd1a-4c11-9157-a315e78b5d23 admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:37.276989 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb49b593-cd1a-4c11-9157-a315e78b5d23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:37.282303 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb49b593-cd1a-4c11-9157-a315e78b5d23 admin admin] PATH_INFO: `/v3/users` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:37.282303 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb49b593-cd1a-4c11-9157-a315e78b5d23 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:44:37.282303 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb49b593-cd1a-4c11-9157-a315e78b5d23 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:44:37.283270 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07445078-1e34-462d-a5b9-a196789ad9a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=119e3d5823e94fa38f30e8be15f4f98e, user_id=82ab36c0e0804e4d8aaff377095aade7, role_id=27f5093ac0674d799cdbd17c68482e32)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:44:37.284319 dv-cinder-843277-7-smb devstack@keystone.service[80352]: WARNING py.warnings [None req-07445078-1e34-462d-a5b9-a196789ad9a6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 01 15:44:37.284319 dv-cinder-843277-7-smb devstack@keystone.service[80352]: warnings.warn(msg) Aug 01 15:44:37.284319 dv-cinder-843277-7-smb devstack@keystone.service[80352]: Aug 01 15:44:37.286577 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07445078-1e34-462d-a5b9-a196789ad9a6 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:44:37.374209 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 803/1586] 10.222.0.102 () {60 vars in 1488 bytes} [Mon Aug 1 15:44:37 2022] PUT /identity/v3/projects/119e3d5823e94fa38f30e8be15f4f98e/users/82ab36c0e0804e4d8aaff377095aade7/roles/27f5093ac0674d799cdbd17c68482e32 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:44:37.374209 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07445078-1e34-462d-a5b9-a196789ad9a6 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:44:37.402405 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 784/1587] 10.222.0.102 () {60 vars in 1149 bytes} [Mon Aug 1 15:44:37 2022] POST /identity/v3/users => generated 287 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:44:37.403713 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb49b593-cd1a-4c11-9157-a315e78b5d23 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:44:37.417711 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb49b593-cd1a-4c11-9157-a315e78b5d23 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:44:37.438297 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07445078-1e34-462d-a5b9-a196789ad9a6 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:44:37.443957 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a79d85-3865-4aba-bd5a-4ffe3e12b61e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:44:37.444578 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a79d85-3865-4aba-bd5a-4ffe3e12b61e admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:37.444878 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a79d85-3865-4aba-bd5a-4ffe3e12b61e admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:37.445155 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a79d85-3865-4aba-bd5a-4ffe3e12b61e admin admin] PATH_INFO: `/v3/users` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:37.445813 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a79d85-3865-4aba-bd5a-4ffe3e12b61e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:44:37.447751 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a79d85-3865-4aba-bd5a-4ffe3e12b61e admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:44:37.477440 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35688c39-79a3-42a3-8293-de2da9dec78f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:44:37.478485 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35688c39-79a3-42a3-8293-de2da9dec78f admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:37.478759 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35688c39-79a3-42a3-8293-de2da9dec78f admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:37.479039 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35688c39-79a3-42a3-8293-de2da9dec78f admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:37.479733 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35688c39-79a3-42a3-8293-de2da9dec78f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:44:37.481425 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35688c39-79a3-42a3-8293-de2da9dec78f admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:44:37.491106 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 785/1588] 10.222.0.102 () {58 vars in 1127 bytes} [Mon Aug 1 15:44:37 2022] GET /identity/v3/roles => generated 1427 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:44:37.492042 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35688c39-79a3-42a3-8293-de2da9dec78f admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:44:37.501578 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35688c39-79a3-42a3-8293-de2da9dec78f admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:44:37.506327 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f9421f-b091-40d5-a321-77377cceae28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:44:37.506919 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f9421f-b091-40d5-a321-77377cceae28 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:37.509610 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f9421f-b091-40d5-a321-77377cceae28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:37.509610 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f9421f-b091-40d5-a321-77377cceae28 admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:37.509610 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f9421f-b091-40d5-a321-77377cceae28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:44:37.509908 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f9421f-b091-40d5-a321-77377cceae28 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:44:37.521462 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 786/1589] 10.222.0.102 () {58 vars in 1127 bytes} [Mon Aug 1 15:44:37 2022] GET /identity/v3/roles => generated 1427 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:44:37.522364 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f9421f-b091-40d5-a321-77377cceae28 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:44:37.531863 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f9421f-b091-40d5-a321-77377cceae28 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:44:37.534820 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 804/1590] 10.222.0.102 () {60 vars in 1149 bytes} [Mon Aug 1 15:44:37 2022] POST /identity/v3/users => generated 294 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:44:37.537235 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7c2ee1-3f54-433d-814e-8eb5a438fe16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:44:37.537926 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7c2ee1-3f54-433d-814e-8eb5a438fe16 admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:37.538212 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7c2ee1-3f54-433d-814e-8eb5a438fe16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:37.538481 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a79d85-3865-4aba-bd5a-4ffe3e12b61e admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:44:37.538581 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7c2ee1-3f54-433d-814e-8eb5a438fe16 admin admin] PATH_INFO: `/v3/users` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:37.539141 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7c2ee1-3f54-433d-814e-8eb5a438fe16 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:44:37.541069 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7c2ee1-3f54-433d-814e-8eb5a438fe16 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:44:37.548270 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a79d85-3865-4aba-bd5a-4ffe3e12b61e admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:44:37.553196 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85cb16c-7645-4cd9-b89a-751ce62f0735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:44:37.553823 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85cb16c-7645-4cd9-b89a-751ce62f0735 admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:37.554100 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85cb16c-7645-4cd9-b89a-751ce62f0735 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:37.554372 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85cb16c-7645-4cd9-b89a-751ce62f0735 admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:37.555078 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85cb16c-7645-4cd9-b89a-751ce62f0735 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:44:37.556709 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85cb16c-7645-4cd9-b89a-751ce62f0735 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:44:37.566916 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 805/1591] 10.222.0.102 () {58 vars in 1127 bytes} [Mon Aug 1 15:44:37 2022] GET /identity/v3/roles => generated 1427 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:44:37.568134 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4299c6-b2dc-4ba3-a390-06cd13086487 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:37.568418 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4299c6-b2dc-4ba3-a390-06cd13086487 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:37.568690 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4299c6-b2dc-4ba3-a390-06cd13086487 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:37.587817 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-3c4299c6-b2dc-4ba3-a390-06cd13086487 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:44:37.590013 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-3c4299c6-b2dc-4ba3-a390-06cd13086487 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:44:37.597495 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 806/1592] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:44:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:44:37.598098 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4299c6-b2dc-4ba3-a390-06cd13086487 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:44:37.607673 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4299c6-b2dc-4ba3-a390-06cd13086487 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:44:37.612877 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3bc9a8-fdcf-43f3-bf52-04855c4faabc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:44:37.613503 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3bc9a8-fdcf-43f3-bf52-04855c4faabc admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:37.613781 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3bc9a8-fdcf-43f3-bf52-04855c4faabc admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:37.614170 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3bc9a8-fdcf-43f3-bf52-04855c4faabc admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:37.614851 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3bc9a8-fdcf-43f3-bf52-04855c4faabc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:44:37.616450 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3bc9a8-fdcf-43f3-bf52-04855c4faabc admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:44:37.618194 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 787/1593] 10.222.0.102 () {60 vars in 1149 bytes} [Mon Aug 1 15:44:37 2022] POST /identity/v3/users => generated 285 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:44:37.624087 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7c2ee1-3f54-433d-814e-8eb5a438fe16 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:44:37.625685 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:44:37.627866 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 807/1594] 10.222.0.102 () {58 vars in 1127 bytes} [Mon Aug 1 15:44:37 2022] GET /identity/v3/roles => generated 1427 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:44:37.628652 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3bc9a8-fdcf-43f3-bf52-04855c4faabc admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:44:37.635194 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7c2ee1-3f54-433d-814e-8eb5a438fe16 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:44:37.638542 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3bc9a8-fdcf-43f3-bf52-04855c4faabc admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:44:37.640529 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6613e9b3-24e5-4f58-a8fb-95a7e8d83d3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:44:37.641396 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6613e9b3-24e5-4f58-a8fb-95a7e8d83d3a admin admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:37.642041 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6613e9b3-24e5-4f58-a8fb-95a7e8d83d3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:37.642827 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6613e9b3-24e5-4f58-a8fb-95a7e8d83d3a admin admin] PATH_INFO: `/v3/projects/17a0bbb820b649e7a226f90e64c9133a/users/cffa7f8cddca4a359a3174f800fb1039/roles/27f5093ac0674d799cdbd17c68482e32` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:37.643875 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae39afa-4c5b-4068-83c4-a7680b2a3373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:44:37.644545 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae39afa-4c5b-4068-83c4-a7680b2a3373 admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:37.644827 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae39afa-4c5b-4068-83c4-a7680b2a3373 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:37.645125 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae39afa-4c5b-4068-83c4-a7680b2a3373 admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:37.645803 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae39afa-4c5b-4068-83c4-a7680b2a3373 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:44:37.647403 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae39afa-4c5b-4068-83c4-a7680b2a3373 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:44:37.661214 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 808/1595] 10.222.0.102 () {58 vars in 1127 bytes} [Mon Aug 1 15:44:37 2022] GET /identity/v3/roles => generated 1427 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:44:37.661392 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6613e9b3-24e5-4f58-a8fb-95a7e8d83d3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=17a0bbb820b649e7a226f90e64c9133a, user_id=cffa7f8cddca4a359a3174f800fb1039, role_id=27f5093ac0674d799cdbd17c68482e32)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:44:37.661513 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae39afa-4c5b-4068-83c4-a7680b2a3373 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:44:37.661993 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6613e9b3-24e5-4f58-a8fb-95a7e8d83d3a admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:44:37.670855 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae39afa-4c5b-4068-83c4-a7680b2a3373 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:44:37.675509 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80842472-7291-4ab8-8335-0a5e4fddbd9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:44:37.676104 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80842472-7291-4ab8-8335-0a5e4fddbd9d admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:37.676382 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80842472-7291-4ab8-8335-0a5e4fddbd9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:37.676655 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80842472-7291-4ab8-8335-0a5e4fddbd9d admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:37.677372 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80842472-7291-4ab8-8335-0a5e4fddbd9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:44:37.679086 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80842472-7291-4ab8-8335-0a5e4fddbd9d admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:44:37.691568 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 809/1596] 10.222.0.102 () {58 vars in 1127 bytes} [Mon Aug 1 15:44:37 2022] GET /identity/v3/roles => generated 1427 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:44:37.692433 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80842472-7291-4ab8-8335-0a5e4fddbd9d admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:44:37.702021 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80842472-7291-4ab8-8335-0a5e4fddbd9d admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:44:37.707415 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87d978e-c739-450b-8604-e8b79186ee78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:44:37.708050 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87d978e-c739-450b-8604-e8b79186ee78 admin admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:37.708333 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87d978e-c739-450b-8604-e8b79186ee78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:37.708608 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87d978e-c739-450b-8604-e8b79186ee78 admin admin] PATH_INFO: `/v3/projects/7671fb6628ea4fcd80fc7bd86ff3ba19/users/b2a8f4bf81a24d4e8b4cfb7ff1188772/roles/27f5093ac0674d799cdbd17c68482e32` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:37.719495 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:44:37.723401 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87d978e-c739-450b-8604-e8b79186ee78 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7671fb6628ea4fcd80fc7bd86ff3ba19, user_id=b2a8f4bf81a24d4e8b4cfb7ff1188772, role_id=27f5093ac0674d799cdbd17c68482e32)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:44:37.726113 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87d978e-c739-450b-8604-e8b79186ee78 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:44:37.781277 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 788/1597] 10.222.0.102 () {60 vars in 1488 bytes} [Mon Aug 1 15:44:37 2022] PUT /identity/v3/projects/17a0bbb820b649e7a226f90e64c9133a/users/cffa7f8cddca4a359a3174f800fb1039/roles/27f5093ac0674d799cdbd17c68482e32 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:44:37.782325 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6613e9b3-24e5-4f58-a8fb-95a7e8d83d3a admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:44:37.836807 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6613e9b3-24e5-4f58-a8fb-95a7e8d83d3a admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:44:37.840479 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b337627-ee81-47a3-a968-b77ab204d15f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a856a413100443939fe9b10daa868518', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:44:37.841134 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b337627-ee81-47a3-a968-b77ab204d15f service neutron] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:37.841420 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b337627-ee81-47a3-a968-b77ab204d15f service neutron] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:37.841795 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b337627-ee81-47a3-a968-b77ab204d15f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:37.855372 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 810/1598] 10.222.0.102 () {60 vars in 1488 bytes} [Mon Aug 1 15:44:37 2022] PUT /identity/v3/projects/7671fb6628ea4fcd80fc7bd86ff3ba19/users/b2a8f4bf81a24d4e8b4cfb7ff1188772/roles/27f5093ac0674d799cdbd17c68482e32 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:44:37.866146 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87d978e-c739-450b-8604-e8b79186ee78 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:44:37.908920 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b337627-ee81-47a3-a968-b77ab204d15f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:44:37.910439 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b337627-ee81-47a3-a968-b77ab204d15f service neutron] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:44:37.920544 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 789/1599] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:44:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:44:37.921052 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87d978e-c739-450b-8604-e8b79186ee78 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:44:37.921823 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b337627-ee81-47a3-a968-b77ab204d15f service neutron] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:44:37.926175 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c164103-e2b5-4317-b515-0edfab33d6a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:44:37.926788 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c164103-e2b5-4317-b515-0edfab33d6a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:37.927064 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c164103-e2b5-4317-b515-0edfab33d6a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:37.927331 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c164103-e2b5-4317-b515-0edfab33d6a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:37.928016 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c164103-e2b5-4317-b515-0edfab33d6a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:44:37.929968 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c164103-e2b5-4317-b515-0edfab33d6a2 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:44:37.934139 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b337627-ee81-47a3-a968-b77ab204d15f service neutron] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:44:37.940026 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73ca0cb-cdf6-4e71-9a2d-d34934e136bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:44:37.940451 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73ca0cb-cdf6-4e71-9a2d-d34934e136bb admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:37.940802 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73ca0cb-cdf6-4e71-9a2d-d34934e136bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:37.941285 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73ca0cb-cdf6-4e71-9a2d-d34934e136bb admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:37.942219 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73ca0cb-cdf6-4e71-9a2d-d34934e136bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:44:37.945527 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 811/1600] 10.222.0.102 () {58 vars in 1127 bytes} [Mon Aug 1 15:44:37 2022] GET /identity/v3/roles => generated 1427 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:44:37.945527 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c164103-e2b5-4317-b515-0edfab33d6a2 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:44:37.945775 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73ca0cb-cdf6-4e71-9a2d-d34934e136bb admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:44:37.955749 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 790/1601] 10.222.0.102 () {58 vars in 1127 bytes} [Mon Aug 1 15:44:37 2022] GET /identity/v3/roles => generated 1427 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:44:37.956525 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73ca0cb-cdf6-4e71-9a2d-d34934e136bb admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:44:37.957266 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c164103-e2b5-4317-b515-0edfab33d6a2 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:44:37.962240 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c111903-aba7-4097-9e4f-256af3a82941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:44:37.962851 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c111903-aba7-4097-9e4f-256af3a82941 admin admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:37.963136 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c111903-aba7-4097-9e4f-256af3a82941 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:37.963411 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c111903-aba7-4097-9e4f-256af3a82941 admin admin] PATH_INFO: `/v3/projects/8bee9977e6834ec18339617ed81abfdd/users/d33afc6f3cc746f6a28e60b0c65f6b89/roles/27f5093ac0674d799cdbd17c68482e32` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:37.967785 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73ca0cb-cdf6-4e71-9a2d-d34934e136bb admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:44:37.972570 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b2016e-b1f9-4a26-a481-4543ddafdaec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:44:37.973227 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b2016e-b1f9-4a26-a481-4543ddafdaec admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:37.973509 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b2016e-b1f9-4a26-a481-4543ddafdaec admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:37.973780 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b2016e-b1f9-4a26-a481-4543ddafdaec admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:37.974465 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b2016e-b1f9-4a26-a481-4543ddafdaec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:44:37.976061 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b2016e-b1f9-4a26-a481-4543ddafdaec admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:44:37.980955 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c111903-aba7-4097-9e4f-256af3a82941 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8bee9977e6834ec18339617ed81abfdd, user_id=d33afc6f3cc746f6a28e60b0c65f6b89, role_id=27f5093ac0674d799cdbd17c68482e32)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:44:37.981834 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c111903-aba7-4097-9e4f-256af3a82941 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:44:37.986963 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 791/1602] 10.222.0.102 () {58 vars in 1127 bytes} [Mon Aug 1 15:44:37 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:44:37.988549 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8199d3f-aff1-44b0-9f12-696f25b501b5 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:37.989103 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8199d3f-aff1-44b0-9f12-696f25b501b5 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:37.989467 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8199d3f-aff1-44b0-9f12-696f25b501b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:38.010110 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-e8199d3f-aff1-44b0-9f12-696f25b501b5 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:44:38.011346 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-e8199d3f-aff1-44b0-9f12-696f25b501b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:44:38.019105 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 792/1603] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:44:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:44:38.020305 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987cfe92-78fe-4b7e-8ad5-8e090ef9e480 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:38.027561 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987cfe92-78fe-4b7e-8ad5-8e090ef9e480 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:38.027561 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987cfe92-78fe-4b7e-8ad5-8e090ef9e480 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:38.048946 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-987cfe92-78fe-4b7e-8ad5-8e090ef9e480 None None] MFA Rules not processed for user `b2a8f4bf81a24d4e8b4cfb7ff1188772`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:44:38.050135 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-987cfe92-78fe-4b7e-8ad5-8e090ef9e480 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:44:38.098040 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:44:38.118290 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 793/1604] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:44:38 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:44:38.119451 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987cfe92-78fe-4b7e-8ad5-8e090ef9e480 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:44:38.128070 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 812/1605] 10.222.0.102 () {60 vars in 1488 bytes} [Mon Aug 1 15:44:37 2022] PUT /identity/v3/projects/8bee9977e6834ec18339617ed81abfdd/users/d33afc6f3cc746f6a28e60b0c65f6b89/roles/27f5093ac0674d799cdbd17c68482e32 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:44:38.129114 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c111903-aba7-4097-9e4f-256af3a82941 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:44:38.133704 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987cfe92-78fe-4b7e-8ad5-8e090ef9e480 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:44:38.214665 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c111903-aba7-4097-9e4f-256af3a82941 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:44:38.219994 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d19de2-53b1-450c-a199-6e8202d7ae2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:44:38.220909 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d19de2-53b1-450c-a199-6e8202d7ae2d admin admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:38.221259 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d19de2-53b1-450c-a199-6e8202d7ae2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:38.221602 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d19de2-53b1-450c-a199-6e8202d7ae2d admin admin] PATH_INFO: `/v3/projects/d6f3a83cd4ac40edb9de91f6806c1e2b/users/34d6ef62383a4dceb1c2900262d8bd5b/roles/27f5093ac0674d799cdbd17c68482e32` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:38.226149 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9304a9b0-043c-4a25-90c7-4d766fbe6d90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:44:38.227243 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9304a9b0-043c-4a25-90c7-4d766fbe6d90 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:38.227677 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9304a9b0-043c-4a25-90c7-4d766fbe6d90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:38.228039 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9304a9b0-043c-4a25-90c7-4d766fbe6d90 admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:38.229426 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9304a9b0-043c-4a25-90c7-4d766fbe6d90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:44:38.231201 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9304a9b0-043c-4a25-90c7-4d766fbe6d90 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:44:38.240772 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d19de2-53b1-450c-a199-6e8202d7ae2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6f3a83cd4ac40edb9de91f6806c1e2b, user_id=34d6ef62383a4dceb1c2900262d8bd5b, role_id=27f5093ac0674d799cdbd17c68482e32)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:44:38.245782 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 794/1606] 10.222.0.102 () {58 vars in 1127 bytes} [Mon Aug 1 15:44:38 2022] GET /identity/v3/roles => generated 1427 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:44:38.245782 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9304a9b0-043c-4a25-90c7-4d766fbe6d90 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:44:38.246166 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d19de2-53b1-450c-a199-6e8202d7ae2d admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:44:38.255499 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9304a9b0-043c-4a25-90c7-4d766fbe6d90 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:44:38.261081 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e060092-49fb-4e90-86bc-7df7917b261b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:44:38.261866 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e060092-49fb-4e90-86bc-7df7917b261b admin admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:38.262171 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e060092-49fb-4e90-86bc-7df7917b261b admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:38.263848 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e060092-49fb-4e90-86bc-7df7917b261b admin admin] PATH_INFO: `/v3/projects/4f475e8ed6ec4e5e89e3db406d1790a9/users/d60a67da3f284a469d374b8f1d93ea45/roles/27f5093ac0674d799cdbd17c68482e32` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:38.287709 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e060092-49fb-4e90-86bc-7df7917b261b admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f475e8ed6ec4e5e89e3db406d1790a9, user_id=d60a67da3f284a469d374b8f1d93ea45, role_id=27f5093ac0674d799cdbd17c68482e32)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:44:38.287709 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e060092-49fb-4e90-86bc-7df7917b261b admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:44:38.339634 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 813/1607] 10.222.0.102 () {60 vars in 1488 bytes} [Mon Aug 1 15:44:38 2022] PUT /identity/v3/projects/d6f3a83cd4ac40edb9de91f6806c1e2b/users/34d6ef62383a4dceb1c2900262d8bd5b/roles/27f5093ac0674d799cdbd17c68482e32 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:44:38.339634 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d19de2-53b1-450c-a199-6e8202d7ae2d admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:44:38.339634 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-66d19de2-53b1-450c-a199-6e8202d7ae2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:44:38.377628 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 795/1608] 10.222.0.102 () {60 vars in 1488 bytes} [Mon Aug 1 15:44:38 2022] PUT /identity/v3/projects/4f475e8ed6ec4e5e89e3db406d1790a9/users/d60a67da3f284a469d374b8f1d93ea45/roles/27f5093ac0674d799cdbd17c68482e32 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:44:38.382539 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e060092-49fb-4e90-86bc-7df7917b261b admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:44:38.405865 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:44:38.420060 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d19de2-53b1-450c-a199-6e8202d7ae2d admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:44:38.465351 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e060092-49fb-4e90-86bc-7df7917b261b admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:44:38.470185 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88e19d7-dc32-4d12-a0f3-71839b9630dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:44:38.470832 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88e19d7-dc32-4d12-a0f3-71839b9630dc admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:38.471117 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88e19d7-dc32-4d12-a0f3-71839b9630dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:38.471406 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88e19d7-dc32-4d12-a0f3-71839b9630dc admin admin] PATH_INFO: `/v3/projects` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:38.472223 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88e19d7-dc32-4d12-a0f3-71839b9630dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:44:38.474161 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88e19d7-dc32-4d12-a0f3-71839b9630dc admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:44:38.478163 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d297f9b6-99ee-4a81-844d-f0bb6db80a1b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a856a413100443939fe9b10daa868518', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:44:38.482967 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d297f9b6-99ee-4a81-844d-f0bb6db80a1b service neutron] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:38.482967 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d297f9b6-99ee-4a81-844d-f0bb6db80a1b service neutron] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:38.482967 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d297f9b6-99ee-4a81-844d-f0bb6db80a1b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:38.489198 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d297f9b6-99ee-4a81-844d-f0bb6db80a1b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:44:38.490690 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d297f9b6-99ee-4a81-844d-f0bb6db80a1b service neutron] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:44:38.500179 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 814/1609] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:44:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:44:38.501956 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a96b49a-dde3-427c-884d-a3fd89d6064a None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:38.502363 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a96b49a-dde3-427c-884d-a3fd89d6064a None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:38.502640 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a96b49a-dde3-427c-884d-a3fd89d6064a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:38.523098 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-1a96b49a-dde3-427c-884d-a3fd89d6064a None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:44:38.524315 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-1a96b49a-dde3-427c-884d-a3fd89d6064a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:44:38.535613 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 815/1610] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:44:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:44:38.535613 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a96b49a-dde3-427c-884d-a3fd89d6064a None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:44:38.549289 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a96b49a-dde3-427c-884d-a3fd89d6064a None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:44:38.555647 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67908e0e-88f7-4c58-8e27-dcb058209d05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:44:38.556323 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67908e0e-88f7-4c58-8e27-dcb058209d05 admin admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:38.556594 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67908e0e-88f7-4c58-8e27-dcb058209d05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:38.556895 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67908e0e-88f7-4c58-8e27-dcb058209d05 admin admin] PATH_INFO: `/v3/projects/35fe5621e96944d19dfa398045e075db/users/d2c43971fe254382a86af1fc76a58a96/roles/27f5093ac0674d799cdbd17c68482e32` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:38.573005 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67908e0e-88f7-4c58-8e27-dcb058209d05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=35fe5621e96944d19dfa398045e075db, user_id=d2c43971fe254382a86af1fc76a58a96, role_id=27f5093ac0674d799cdbd17c68482e32)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:44:38.575745 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67908e0e-88f7-4c58-8e27-dcb058209d05 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:44:38.603986 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 796/1611] 10.222.0.102 () {60 vars in 1158 bytes} [Mon Aug 1 15:44:38 2022] POST /identity/v3/projects => generated 372 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:44:38.603986 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9754aef4-275e-48c6-9ab1-707a82c604f4 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:38.603986 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9754aef4-275e-48c6-9ab1-707a82c604f4 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:38.603986 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9754aef4-275e-48c6-9ab1-707a82c604f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:38.631879 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-9754aef4-275e-48c6-9ab1-707a82c604f4 None None] MFA Rules not processed for user `34d6ef62383a4dceb1c2900262d8bd5b`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:44:38.636871 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-9754aef4-275e-48c6-9ab1-707a82c604f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:44:38.671083 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:44:38.708205 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 816/1612] 10.222.0.102 () {60 vars in 1488 bytes} [Mon Aug 1 15:44:38 2022] PUT /identity/v3/projects/35fe5621e96944d19dfa398045e075db/users/d2c43971fe254382a86af1fc76a58a96/roles/27f5093ac0674d799cdbd17c68482e32 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:44:38.708205 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87ddd44-8049-411e-91b5-b8aeb13eaa56 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:38.708205 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87ddd44-8049-411e-91b5-b8aeb13eaa56 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:38.708205 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87ddd44-8049-411e-91b5-b8aeb13eaa56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:38.708801 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 797/1613] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:44:38 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:44:38.710014 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9754aef4-275e-48c6-9ab1-707a82c604f4 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:44:38.737192 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-b87ddd44-8049-411e-91b5-b8aeb13eaa56 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:44:38.738682 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-b87ddd44-8049-411e-91b5-b8aeb13eaa56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:44:38.796102 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9754aef4-275e-48c6-9ab1-707a82c604f4 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:44:38.807118 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 817/1614] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:44:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:44:38.807874 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87ddd44-8049-411e-91b5-b8aeb13eaa56 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:44:38.818698 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87ddd44-8049-411e-91b5-b8aeb13eaa56 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:44:38.823395 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f49aeb-9a57-44f9-81dc-e6a8aa71e7f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:44:38.824004 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f49aeb-9a57-44f9-81dc-e6a8aa71e7f9 admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:38.824285 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f49aeb-9a57-44f9-81dc-e6a8aa71e7f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:38.824573 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f49aeb-9a57-44f9-81dc-e6a8aa71e7f9 admin admin] PATH_INFO: `/v3/users` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:38.825260 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f49aeb-9a57-44f9-81dc-e6a8aa71e7f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:44:38.827535 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f49aeb-9a57-44f9-81dc-e6a8aa71e7f9 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:44:38.848353 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a985eac7-384d-4258-aed6-8a7d5f019448 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a856a413100443939fe9b10daa868518', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:44:38.860423 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a985eac7-384d-4258-aed6-8a7d5f019448 service neutron] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:38.860423 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a985eac7-384d-4258-aed6-8a7d5f019448 service neutron] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:38.860423 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a985eac7-384d-4258-aed6-8a7d5f019448 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:38.860423 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a985eac7-384d-4258-aed6-8a7d5f019448 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:44:38.860423 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a985eac7-384d-4258-aed6-8a7d5f019448 service neutron] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:44:38.870412 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 798/1615] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:44:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:44:38.871777 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ff026f-01db-42e1-9ad5-524d123d43a2 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:38.872052 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ff026f-01db-42e1-9ad5-524d123d43a2 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:38.872321 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ff026f-01db-42e1-9ad5-524d123d43a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:38.903100 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-94ff026f-01db-42e1-9ad5-524d123d43a2 None None] MFA Rules not processed for user `d2c43971fe254382a86af1fc76a58a96`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:44:38.904324 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-94ff026f-01db-42e1-9ad5-524d123d43a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:44:38.964257 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 818/1616] 10.222.0.102 () {60 vars in 1149 bytes} [Mon Aug 1 15:44:38 2022] POST /identity/v3/users => generated 293 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:44:38.967337 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8e5ebf-ca32-4f1b-a6f8-1ad8318c3e82 None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:38.967958 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8e5ebf-ca32-4f1b-a6f8-1ad8318c3e82 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:38.968392 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8e5ebf-ca32-4f1b-a6f8-1ad8318c3e82 None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:38.975691 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 819/1617] 10.222.0.102 () {54 vars in 967 bytes} [Mon Aug 1 15:44:38 2022] GET /identity => generated 271 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 15:44:38.977614 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8e5ebf-ca32-4f1b-a6f8-1ad8318c3e82 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:44:38.989125 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 799/1618] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:44:38 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:44:38.992105 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ff026f-01db-42e1-9ad5-524d123d43a2 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:44:38.996710 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8e5ebf-ca32-4f1b-a6f8-1ad8318c3e82 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:44:39.005208 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bdde4a-4e53-4759-8bdf-b0ce5be85a9f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a856a413100443939fe9b10daa868518', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:44:39.006486 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bdde4a-4e53-4759-8bdf-b0ce5be85a9f service neutron] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:39.007129 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ff026f-01db-42e1-9ad5-524d123d43a2 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:44:39.007507 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bdde4a-4e53-4759-8bdf-b0ce5be85a9f service neutron] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:39.007797 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bdde4a-4e53-4759-8bdf-b0ce5be85a9f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:39.017051 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f03b5d-fff9-4b43-a354-3eac5497c5fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:44:39.017790 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f03b5d-fff9-4b43-a354-3eac5497c5fb admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:39.018177 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f03b5d-fff9-4b43-a354-3eac5497c5fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:39.018619 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f03b5d-fff9-4b43-a354-3eac5497c5fb admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:39.019364 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f03b5d-fff9-4b43-a354-3eac5497c5fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:44:39.021778 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f03b5d-fff9-4b43-a354-3eac5497c5fb admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:44:39.023891 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bdde4a-4e53-4759-8bdf-b0ce5be85a9f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:44:39.026101 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bdde4a-4e53-4759-8bdf-b0ce5be85a9f service neutron] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:44:39.035473 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 800/1619] 10.222.0.102 () {58 vars in 1127 bytes} [Mon Aug 1 15:44:38 2022] GET /identity/v3/roles => generated 1427 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:44:39.037343 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e18d7d1-65b0-4359-9e43-8e923aa89228 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:39.037679 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e18d7d1-65b0-4359-9e43-8e923aa89228 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:39.037998 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e18d7d1-65b0-4359-9e43-8e923aa89228 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:39.039054 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 820/1620] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:44:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:44:39.039933 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bdde4a-4e53-4759-8bdf-b0ce5be85a9f service neutron] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:44:39.051200 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bdde4a-4e53-4759-8bdf-b0ce5be85a9f service neutron] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:44:39.057096 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1204b9af-acc3-4a1f-9319-a34d2db75c34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:44:39.057938 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1204b9af-acc3-4a1f-9319-a34d2db75c34 admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:39.058155 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1204b9af-acc3-4a1f-9319-a34d2db75c34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:39.058414 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1204b9af-acc3-4a1f-9319-a34d2db75c34 admin admin] PATH_INFO: `/v3/projects` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:39.059375 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1204b9af-acc3-4a1f-9319-a34d2db75c34 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:44:39.061471 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1204b9af-acc3-4a1f-9319-a34d2db75c34 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:44:39.088464 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-0e18d7d1-65b0-4359-9e43-8e923aa89228 None None] MFA Rules not processed for user `77b43f1ee8cc4be3907a494abe90c1cc`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:44:39.089996 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-0e18d7d1-65b0-4359-9e43-8e923aa89228 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:44:39.166199 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 821/1621] 10.222.0.102 () {60 vars in 1158 bytes} [Mon Aug 1 15:44:39 2022] POST /identity/v3/projects => generated 368 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:44:39.169841 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1204b9af-acc3-4a1f-9319-a34d2db75c34 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:44:39.170352 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 801/1622] 10.222.0.102 () {58 vars in 1064 bytes} [Mon Aug 1 15:44:39 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:44:39.171843 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e18d7d1-65b0-4359-9e43-8e923aa89228 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:44:39.183704 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e18d7d1-65b0-4359-9e43-8e923aa89228 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:44:39.198631 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:44:39.248732 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1204b9af-acc3-4a1f-9319-a34d2db75c34 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:44:39.254702 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d234268-efaa-4fc8-9c87-c34dc6f8142b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:44:39.255399 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d234268-efaa-4fc8-9c87-c34dc6f8142b admin admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:39.255683 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d234268-efaa-4fc8-9c87-c34dc6f8142b admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:39.255955 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d234268-efaa-4fc8-9c87-c34dc6f8142b admin admin] PATH_INFO: `/v3/projects/bbfd29e93df34d4a9fda1e7b53965bd3/users/bf9d982904704c0c804007dfdb0db9b2/roles/de1374f966c04c27b579515b54334fd2` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:39.258398 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:44:39.274829 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d234268-efaa-4fc8-9c87-c34dc6f8142b admin admin] RBAC: Authorizing `identity:create_grant(project_id=bbfd29e93df34d4a9fda1e7b53965bd3, user_id=bf9d982904704c0c804007dfdb0db9b2, role_id=de1374f966c04c27b579515b54334fd2)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:44:39.280297 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d234268-efaa-4fc8-9c87-c34dc6f8142b admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:44:39.286477 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1777d68c-3dea-4b01-aeef-ee23ac48870f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:44:39.287465 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1777d68c-3dea-4b01-aeef-ee23ac48870f admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:39.287465 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1777d68c-3dea-4b01-aeef-ee23ac48870f admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:39.287681 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1777d68c-3dea-4b01-aeef-ee23ac48870f admin admin] PATH_INFO: `/v3/users` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:39.288399 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1777d68c-3dea-4b01-aeef-ee23ac48870f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:44:39.290646 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1777d68c-3dea-4b01-aeef-ee23ac48870f admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:44:39.407416 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 822/1623] 10.222.0.102 () {60 vars in 1488 bytes} [Mon Aug 1 15:44:39 2022] PUT /identity/v3/projects/bbfd29e93df34d4a9fda1e7b53965bd3/users/bf9d982904704c0c804007dfdb0db9b2/roles/de1374f966c04c27b579515b54334fd2 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:44:39.409063 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d234268-efaa-4fc8-9c87-c34dc6f8142b admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:44:39.433779 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 802/1624] 10.222.0.102 () {60 vars in 1149 bytes} [Mon Aug 1 15:44:39 2022] POST /identity/v3/users => generated 291 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:44:39.435469 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1777d68c-3dea-4b01-aeef-ee23ac48870f admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:44:39.452041 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1777d68c-3dea-4b01-aeef-ee23ac48870f admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:44:39.505982 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d234268-efaa-4fc8-9c87-c34dc6f8142b admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:44:39.511687 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6ea8ad-c801-498c-abc7-96584196211a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77b43f1ee8cc4be3907a494abe90c1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:44:39.512312 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6ea8ad-c801-498c-abc7-96584196211a service nova] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:39.512595 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6ea8ad-c801-498c-abc7-96584196211a service nova] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:39.512952 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6ea8ad-c801-498c-abc7-96584196211a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:39.518341 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f558429a-ac7f-4869-ad15-1eff712a9ce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:44:39.519537 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f558429a-ac7f-4869-ad15-1eff712a9ce1 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:39.519537 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f558429a-ac7f-4869-ad15-1eff712a9ce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:39.519537 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f558429a-ac7f-4869-ad15-1eff712a9ce1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:39.522808 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f558429a-ac7f-4869-ad15-1eff712a9ce1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:44:39.522808 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f558429a-ac7f-4869-ad15-1eff712a9ce1 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:44:39.535268 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 803/1625] 10.222.0.102 () {58 vars in 1127 bytes} [Mon Aug 1 15:44:39 2022] GET /identity/v3/roles => generated 1427 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:44:39.536197 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f558429a-ac7f-4869-ad15-1eff712a9ce1 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:44:39.551596 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f558429a-ac7f-4869-ad15-1eff712a9ce1 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:44:39.559260 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66601c75-18ce-4300-8879-8a8b31a825f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:44:39.559916 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66601c75-18ce-4300-8879-8a8b31a825f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:39.560195 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66601c75-18ce-4300-8879-8a8b31a825f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:39.560464 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66601c75-18ce-4300-8879-8a8b31a825f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:39.561283 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66601c75-18ce-4300-8879-8a8b31a825f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:44:39.563150 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66601c75-18ce-4300-8879-8a8b31a825f8 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:44:39.583770 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 804/1626] 10.222.0.102 () {58 vars in 1127 bytes} [Mon Aug 1 15:44:39 2022] GET /identity/v3/roles => generated 1427 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:44:39.583770 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66601c75-18ce-4300-8879-8a8b31a825f8 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:44:39.595098 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6ea8ad-c801-498c-abc7-96584196211a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:44:39.597374 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6ea8ad-c801-498c-abc7-96584196211a service nova] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:44:39.599307 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66601c75-18ce-4300-8879-8a8b31a825f8 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:44:39.609444 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 823/1627] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:44:39 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:44:39.610299 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6ea8ad-c801-498c-abc7-96584196211a service nova] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:44:39.615030 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab19e100-4c52-4652-94af-7b781eb673ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:44:39.616514 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab19e100-4c52-4652-94af-7b781eb673ce admin admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:39.617210 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab19e100-4c52-4652-94af-7b781eb673ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:39.617619 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab19e100-4c52-4652-94af-7b781eb673ce admin admin] PATH_INFO: `/v3/projects/bbfd29e93df34d4a9fda1e7b53965bd3/users/bf9d982904704c0c804007dfdb0db9b2/roles/de1374f966c04c27b579515b54334fd2` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:39.621765 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab19e100-4c52-4652-94af-7b781eb673ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=bbfd29e93df34d4a9fda1e7b53965bd3, user_id=bf9d982904704c0c804007dfdb0db9b2, role_id=de1374f966c04c27b579515b54334fd2)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:44:39.624171 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6ea8ad-c801-498c-abc7-96584196211a service nova] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:44:39.624882 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab19e100-4c52-4652-94af-7b781eb673ce admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:44:39.629514 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:44:39.632650 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040514a2-18bf-4a58-ac22-f5082d00b222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:44:39.633437 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040514a2-18bf-4a58-ac22-f5082d00b222 admin admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:39.633877 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040514a2-18bf-4a58-ac22-f5082d00b222 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:39.634231 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040514a2-18bf-4a58-ac22-f5082d00b222 admin admin] PATH_INFO: `/v3/projects/bf707ecc0e924bba95f0df83ef0dcca4/users/a36226f3c4044620b87d941104309fa7/roles/de1374f966c04c27b579515b54334fd2` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:39.648810 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 805/1628] 10.222.0.102 () {60 vars in 1488 bytes} [Mon Aug 1 15:44:39 2022] PUT /identity/v3/projects/bbfd29e93df34d4a9fda1e7b53965bd3/users/bf9d982904704c0c804007dfdb0db9b2/roles/de1374f966c04c27b579515b54334fd2 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:44:39.654161 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bf1c04-4361-42f1-b6de-5651665f4e45 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:39.654443 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bf1c04-4361-42f1-b6de-5651665f4e45 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:39.654724 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bf1c04-4361-42f1-b6de-5651665f4e45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:39.658030 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040514a2-18bf-4a58-ac22-f5082d00b222 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf707ecc0e924bba95f0df83ef0dcca4, user_id=a36226f3c4044620b87d941104309fa7, role_id=de1374f966c04c27b579515b54334fd2)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:44:39.661217 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040514a2-18bf-4a58-ac22-f5082d00b222 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:44:39.685852 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-83bf1c04-4361-42f1-b6de-5651665f4e45 None None] MFA Rules not processed for user `bf9d982904704c0c804007dfdb0db9b2`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:44:39.687225 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-83bf1c04-4361-42f1-b6de-5651665f4e45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:44:39.746929 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 824/1629] 10.222.0.102 () {60 vars in 1488 bytes} [Mon Aug 1 15:44:39 2022] PUT /identity/v3/projects/bf707ecc0e924bba95f0df83ef0dcca4/users/a36226f3c4044620b87d941104309fa7/roles/de1374f966c04c27b579515b54334fd2 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:44:39.749600 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040514a2-18bf-4a58-ac22-f5082d00b222 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:44:39.797004 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 806/1630] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:44:39 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:44:39.809951 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bf1c04-4361-42f1-b6de-5651665f4e45 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:44:39.849559 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040514a2-18bf-4a58-ac22-f5082d00b222 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:44:39.857857 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959a080e-7e59-40b4-b740-6748acb068a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:44:39.859010 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959a080e-7e59-40b4-b740-6748acb068a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:39.859298 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959a080e-7e59-40b4-b740-6748acb068a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:39.859571 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959a080e-7e59-40b4-b740-6748acb068a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:39.860269 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959a080e-7e59-40b4-b740-6748acb068a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:44:39.869741 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959a080e-7e59-40b4-b740-6748acb068a3 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:44:39.895470 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 825/1631] 10.222.0.102 () {58 vars in 1127 bytes} [Mon Aug 1 15:44:39 2022] GET /identity/v3/roles => generated 1427 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:44:39.899353 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959a080e-7e59-40b4-b740-6748acb068a3 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:44:39.914046 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959a080e-7e59-40b4-b740-6748acb068a3 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:44:39.920866 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a11019-a64a-4020-b2db-447fe8a86069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:44:39.921896 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a11019-a64a-4020-b2db-447fe8a86069 admin admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:39.922648 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a11019-a64a-4020-b2db-447fe8a86069 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:39.923899 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a11019-a64a-4020-b2db-447fe8a86069 admin admin] PATH_INFO: `/v3/projects/bf707ecc0e924bba95f0df83ef0dcca4/users/a36226f3c4044620b87d941104309fa7/roles/de1374f966c04c27b579515b54334fd2` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:39.924017 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bf1c04-4361-42f1-b6de-5651665f4e45 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:44:39.927267 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a11019-a64a-4020-b2db-447fe8a86069 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf707ecc0e924bba95f0df83ef0dcca4, user_id=a36226f3c4044620b87d941104309fa7, role_id=de1374f966c04c27b579515b54334fd2)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:44:39.931592 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a11019-a64a-4020-b2db-447fe8a86069 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:44:39.947552 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 826/1632] 10.222.0.102 () {60 vars in 1488 bytes} [Mon Aug 1 15:44:39 2022] PUT /identity/v3/projects/bf707ecc0e924bba95f0df83ef0dcca4/users/a36226f3c4044620b87d941104309fa7/roles/de1374f966c04c27b579515b54334fd2 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 15:44:39.957843 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641c029d-67ba-4182-a9e0-0e2a07b1b0da None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:39.958132 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641c029d-67ba-4182-a9e0-0e2a07b1b0da None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:39.958409 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641c029d-67ba-4182-a9e0-0e2a07b1b0da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:40.003587 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-641c029d-67ba-4182-a9e0-0e2a07b1b0da None None] MFA Rules not processed for user `a36226f3c4044620b87d941104309fa7`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:44:40.005226 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-641c029d-67ba-4182-a9e0-0e2a07b1b0da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:44:40.041496 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a1510c-d611-49c3-825a-e099df3e0a44 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff810b37183c4729859c1b05edff1703', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:44:40.042208 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a1510c-d611-49c3-825a-e099df3e0a44 service cinder] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:40.042416 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a1510c-d611-49c3-825a-e099df3e0a44 service cinder] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:40.042691 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a1510c-d611-49c3-825a-e099df3e0a44 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:40.069207 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:44:40.098623 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 827/1633] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:44:39 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 15:44:40.112581 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641c029d-67ba-4182-a9e0-0e2a07b1b0da None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:44:40.142246 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a1510c-d611-49c3-825a-e099df3e0a44 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:44:40.144141 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a1510c-d611-49c3-825a-e099df3e0a44 service cinder] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:44:40.157013 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 807/1634] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:44:39 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 15:44:40.159565 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69abdea-6794-4e4c-b978-088fd9af9149 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:40.160064 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69abdea-6794-4e4c-b978-088fd9af9149 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:40.160547 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69abdea-6794-4e4c-b978-088fd9af9149 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:40.163137 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 808/1635] 10.222.0.102 () {54 vars in 917 bytes} [Mon Aug 1 15:44:40 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 15:44:40.168743 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7a1e30-a5bf-4fc5-accb-c7b1188ca508 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:40.169493 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7a1e30-a5bf-4fc5-accb-c7b1188ca508 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:40.170834 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7a1e30-a5bf-4fc5-accb-c7b1188ca508 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:40.198219 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641c029d-67ba-4182-a9e0-0e2a07b1b0da None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:44:40.202560 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-3c7a1e30-a5bf-4fc5-accb-c7b1188ca508 None None] MFA Rules not processed for user `77b43f1ee8cc4be3907a494abe90c1cc`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:44:40.204959 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-3c7a1e30-a5bf-4fc5-accb-c7b1188ca508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:44:40.211021 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c9fd8b-42c1-4d59-bbf5-0308c1019de9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff810b37183c4729859c1b05edff1703', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:44:40.211716 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c9fd8b-42c1-4d59-bbf5-0308c1019de9 service cinder] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:40.211988 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c9fd8b-42c1-4d59-bbf5-0308c1019de9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:40.212254 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c9fd8b-42c1-4d59-bbf5-0308c1019de9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:40.229988 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c9fd8b-42c1-4d59-bbf5-0308c1019de9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:44:40.231557 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c9fd8b-42c1-4d59-bbf5-0308c1019de9 service cinder] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:44:40.243185 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 828/1636] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:44:40 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:44:40.354573 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 809/1637] 10.222.0.102 () {58 vars in 1014 bytes} [Mon Aug 1 15:44:40 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 15:44:40.445247 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c9fd8b-42c1-4d59-bbf5-0308c1019de9 service cinder] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:44:40.453875 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c9fd8b-42c1-4d59-bbf5-0308c1019de9 service cinder] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:44:40.458020 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288dfcce-4433-47ea-b6b3-3b9b11a5cfd1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff810b37183c4729859c1b05edff1703', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:44:40.458640 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288dfcce-4433-47ea-b6b3-3b9b11a5cfd1 service cinder] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:40.458905 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288dfcce-4433-47ea-b6b3-3b9b11a5cfd1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:40.459181 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288dfcce-4433-47ea-b6b3-3b9b11a5cfd1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:40.469381 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288dfcce-4433-47ea-b6b3-3b9b11a5cfd1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:44:40.471515 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288dfcce-4433-47ea-b6b3-3b9b11a5cfd1 service cinder] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:44:40.482935 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 829/1638] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:44:40 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:44:40.816692 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183e8cf2-0f97-47d9-9f75-08904db10522 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:40.817019 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183e8cf2-0f97-47d9-9f75-08904db10522 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:40.817375 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183e8cf2-0f97-47d9-9f75-08904db10522 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:40.820798 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 810/1639] 10.222.0.102 () {54 vars in 967 bytes} [Mon Aug 1 15:44:40 2022] GET /identity => generated 271 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 15:44:40.829103 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b23919-aaf8-4c21-b5cc-e659a7ae1e05 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:40.830094 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b23919-aaf8-4c21-b5cc-e659a7ae1e05 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:40.830471 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b23919-aaf8-4c21-b5cc-e659a7ae1e05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:40.852781 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-b0b23919-aaf8-4c21-b5cc-e659a7ae1e05 None None] MFA Rules not processed for user `77b43f1ee8cc4be3907a494abe90c1cc`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:44:40.855347 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-b0b23919-aaf8-4c21-b5cc-e659a7ae1e05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:44:40.869233 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 830/1640] 10.222.0.102 () {58 vars in 1064 bytes} [Mon Aug 1 15:44:40 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:44:40.874830 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0873c699-48e8-4b78-9aa6-4c4524e48431 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:40.875214 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0873c699-48e8-4b78-9aa6-4c4524e48431 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:40.875646 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0873c699-48e8-4b78-9aa6-4c4524e48431 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:40.881039 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 811/1641] 10.222.0.102 () {54 vars in 917 bytes} [Mon Aug 1 15:44:40 2022] GET /identity => generated 271 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 15:44:40.887226 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:44:41.231421 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599ad007-7042-4e38-9faf-8f116742c989 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:41.231421 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599ad007-7042-4e38-9faf-8f116742c989 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:41.231421 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599ad007-7042-4e38-9faf-8f116742c989 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:41.231421 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-599ad007-7042-4e38-9faf-8f116742c989 None None] MFA Rules not processed for user `77b43f1ee8cc4be3907a494abe90c1cc`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:44:41.231421 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-599ad007-7042-4e38-9faf-8f116742c989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:44:41.231421 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 831/1642] 10.222.0.102 () {58 vars in 1014 bytes} [Mon Aug 1 15:44:40 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:44:41.240376 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0873c699-48e8-4b78-9aa6-4c4524e48431 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:44:41.240376 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0873c699-48e8-4b78-9aa6-4c4524e48431 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:44:41.240376 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37e9725-7292-4c3c-9ef9-540aad183328 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff810b37183c4729859c1b05edff1703', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:44:41.240376 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37e9725-7292-4c3c-9ef9-540aad183328 service cinder] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:41.245266 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37e9725-7292-4c3c-9ef9-540aad183328 service cinder] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:41.245266 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37e9725-7292-4c3c-9ef9-540aad183328 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:41.245266 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37e9725-7292-4c3c-9ef9-540aad183328 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:44:41.245266 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37e9725-7292-4c3c-9ef9-540aad183328 service cinder] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:44:41.245266 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 812/1643] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:44:41 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:44:41.570726 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:44:43.250585 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599ad007-7042-4e38-9faf-8f116742c989 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:44:43.439564 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599ad007-7042-4e38-9faf-8f116742c989 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:44:43.459518 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb377d06-9ce9-4c4e-a704-9df7b92321fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:44:43.461914 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb377d06-9ce9-4c4e-a704-9df7b92321fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:43.461914 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb377d06-9ce9-4c4e-a704-9df7b92321fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:43.461914 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb377d06-9ce9-4c4e-a704-9df7b92321fe admin admin] PATH_INFO: `/v3/users/b2a8f4bf81a24d4e8b4cfb7ff1188772` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:43.465456 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb377d06-9ce9-4c4e-a704-9df7b92321fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2a8f4bf81a24d4e8b4cfb7ff1188772)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:44:43.482942 dv-cinder-843277-7-smb devstack@keystone.service[80352]: WARNING py.warnings [None req-eb377d06-9ce9-4c4e-a704-9df7b92321fe admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 01 15:44:43.482942 dv-cinder-843277-7-smb devstack@keystone.service[80352]: warnings.warn(msg) Aug 01 15:44:43.482942 dv-cinder-843277-7-smb devstack@keystone.service[80352]: Aug 01 15:44:43.486575 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb377d06-9ce9-4c4e-a704-9df7b92321fe admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:44:44.597700 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-eb377d06-9ce9-4c4e-a704-9df7b92321fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2a8f4bf81a24d4e8b4cfb7ff1188772'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:44:44.632349 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-eb377d06-9ce9-4c4e-a704-9df7b92321fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2a8f4bf81a24d4e8b4cfb7ff1188772'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:44:44.644910 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-eb377d06-9ce9-4c4e-a704-9df7b92321fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2a8f4bf81a24d4e8b4cfb7ff1188772'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:44:44.646766 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-eb377d06-9ce9-4c4e-a704-9df7b92321fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2a8f4bf81a24d4e8b4cfb7ff1188772'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:44:44.646766 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-eb377d06-9ce9-4c4e-a704-9df7b92321fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2a8f4bf81a24d4e8b4cfb7ff1188772'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:44:44.734358 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 832/1644] 10.222.0.102 () {58 vars in 1229 bytes} [Mon Aug 1 15:44:43 2022] DELETE /identity/v3/users/b2a8f4bf81a24d4e8b4cfb7ff1188772 => generated 0 bytes in 1482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:44:44.737286 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f1bdf0-dc39-48d6-9dd5-5d214e20d6a1 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:44.737842 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f1bdf0-dc39-48d6-9dd5-5d214e20d6a1 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:44.738072 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f1bdf0-dc39-48d6-9dd5-5d214e20d6a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:44.790751 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-09f1bdf0-dc39-48d6-9dd5-5d214e20d6a1 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:44:44.792188 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-09f1bdf0-dc39-48d6-9dd5-5d214e20d6a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:44:44.912168 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 813/1645] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:44:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:44:44.926021 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb377d06-9ce9-4c4e-a704-9df7b92321fe admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:44:44.932638 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-eb377d06-9ce9-4c4e-a704-9df7b92321fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:44:45.081851 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb377d06-9ce9-4c4e-a704-9df7b92321fe admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:44:45.091751 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f8df24-a442-4a9d-920c-02694db35b07 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a856a413100443939fe9b10daa868518', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:44:45.092568 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f8df24-a442-4a9d-920c-02694db35b07 service neutron] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:45.092873 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f8df24-a442-4a9d-920c-02694db35b07 service neutron] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:45.095850 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f8df24-a442-4a9d-920c-02694db35b07 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:45.118647 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f8df24-a442-4a9d-920c-02694db35b07 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:44:45.120134 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f8df24-a442-4a9d-920c-02694db35b07 service neutron] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:44:45.149798 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 833/1646] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:44:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:44:45.858088 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f1bdf0-dc39-48d6-9dd5-5d214e20d6a1 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:44:45.860922 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-09f1bdf0-dc39-48d6-9dd5-5d214e20d6a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:44:45.884986 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f1bdf0-dc39-48d6-9dd5-5d214e20d6a1 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:44:45.897575 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbe9ddb-7182-4bc2-83bd-8c0992c9db6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:44:45.898971 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbe9ddb-7182-4bc2-83bd-8c0992c9db6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:45.899375 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbe9ddb-7182-4bc2-83bd-8c0992c9db6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:45.899613 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbe9ddb-7182-4bc2-83bd-8c0992c9db6d admin admin] PATH_INFO: `/v3/users/34d6ef62383a4dceb1c2900262d8bd5b` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:45.910599 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbe9ddb-7182-4bc2-83bd-8c0992c9db6d admin admin] RBAC: Authorizing `identity:delete_user(user_id=34d6ef62383a4dceb1c2900262d8bd5b)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:44:45.910599 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbe9ddb-7182-4bc2-83bd-8c0992c9db6d admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:44:46.240658 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-9cbe9ddb-7182-4bc2-83bd-8c0992c9db6d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '34d6ef62383a4dceb1c2900262d8bd5b'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:44:46.370559 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-9cbe9ddb-7182-4bc2-83bd-8c0992c9db6d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '34d6ef62383a4dceb1c2900262d8bd5b'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:44:46.378974 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:44:46.392215 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-9cbe9ddb-7182-4bc2-83bd-8c0992c9db6d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '34d6ef62383a4dceb1c2900262d8bd5b'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:44:46.401288 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-9cbe9ddb-7182-4bc2-83bd-8c0992c9db6d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '34d6ef62383a4dceb1c2900262d8bd5b'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:44:46.401288 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-9cbe9ddb-7182-4bc2-83bd-8c0992c9db6d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '34d6ef62383a4dceb1c2900262d8bd5b'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:44:46.432239 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 814/1647] 10.222.0.102 () {58 vars in 1229 bytes} [Mon Aug 1 15:44:45 2022] DELETE /identity/v3/users/34d6ef62383a4dceb1c2900262d8bd5b => generated 0 bytes in 575 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:44:46.436827 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9679e4b2-5f2d-410a-8a74-63c69748da5e None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:46.438231 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9679e4b2-5f2d-410a-8a74-63c69748da5e None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:46.438742 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9679e4b2-5f2d-410a-8a74-63c69748da5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:46.475756 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-9679e4b2-5f2d-410a-8a74-63c69748da5e None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:44:46.477168 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-9679e4b2-5f2d-410a-8a74-63c69748da5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:44:46.532178 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:44:46.580286 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbe9ddb-7182-4bc2-83bd-8c0992c9db6d admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:44:46.582152 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-9cbe9ddb-7182-4bc2-83bd-8c0992c9db6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:44:46.611657 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 834/1648] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:44:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:44:46.734352 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbe9ddb-7182-4bc2-83bd-8c0992c9db6d admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:44:46.744508 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9157f8-b639-4c5f-95cc-b924ba6cece8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:44:46.747332 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9157f8-b639-4c5f-95cc-b924ba6cece8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:46.748030 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9157f8-b639-4c5f-95cc-b924ba6cece8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:46.748608 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9157f8-b639-4c5f-95cc-b924ba6cece8 admin admin] PATH_INFO: `/v3/projects/7671fb6628ea4fcd80fc7bd86ff3ba19` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:46.752087 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9157f8-b639-4c5f-95cc-b924ba6cece8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7671fb6628ea4fcd80fc7bd86ff3ba19)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:44:46.753335 dv-cinder-843277-7-smb devstack@keystone.service[80353]: WARNING py.warnings [None req-ea9157f8-b639-4c5f-95cc-b924ba6cece8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 01 15:44:46.753335 dv-cinder-843277-7-smb devstack@keystone.service[80353]: warnings.warn(msg) Aug 01 15:44:46.753335 dv-cinder-843277-7-smb devstack@keystone.service[80353]: Aug 01 15:44:46.757278 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9157f8-b639-4c5f-95cc-b924ba6cece8 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:44:46.785707 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9679e4b2-5f2d-410a-8a74-63c69748da5e None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:44:46.787683 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-9679e4b2-5f2d-410a-8a74-63c69748da5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:44:46.895683 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9679e4b2-5f2d-410a-8a74-63c69748da5e None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:44:46.898061 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c940f081-98b5-489b-89bc-47bfb14f48ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a856a413100443939fe9b10daa868518', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:44:46.898703 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c940f081-98b5-489b-89bc-47bfb14f48ae service neutron] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:46.898979 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c940f081-98b5-489b-89bc-47bfb14f48ae service neutron] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:46.899249 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c940f081-98b5-489b-89bc-47bfb14f48ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:46.919407 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c940f081-98b5-489b-89bc-47bfb14f48ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:44:46.921135 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c940f081-98b5-489b-89bc-47bfb14f48ae service neutron] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:44:46.947382 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 835/1649] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:44:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 15:44:47.007619 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-ea9157f8-b639-4c5f-95cc-b924ba6cece8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7671fb6628ea4fcd80fc7bd86ff3ba19', 'request_id': 'req-ea9157f8-b639-4c5f-95cc-b924ba6cece8'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:44:47.089737 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-ea9157f8-b639-4c5f-95cc-b924ba6cece8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7671fb6628ea4fcd80fc7bd86ff3ba19', 'request_id': 'req-ea9157f8-b639-4c5f-95cc-b924ba6cece8'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:44:47.115413 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-ea9157f8-b639-4c5f-95cc-b924ba6cece8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7671fb6628ea4fcd80fc7bd86ff3ba19', 'request_id': 'req-ea9157f8-b639-4c5f-95cc-b924ba6cece8'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:44:47.173710 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-ea9157f8-b639-4c5f-95cc-b924ba6cece8 admin admin] The token cache is being invalidate because project 7671fb6628ea4fcd80fc7bd86ff3ba19 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80353) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 15:44:47.173710 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-ea9157f8-b639-4c5f-95cc-b924ba6cece8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:44:47.173710 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-ea9157f8-b639-4c5f-95cc-b924ba6cece8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:44:47.176428 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 815/1650] 10.222.0.102 () {58 vars in 1238 bytes} [Mon Aug 1 15:44:46 2022] DELETE /identity/v3/projects/7671fb6628ea4fcd80fc7bd86ff3ba19 => generated 0 bytes in 597 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:44:47.180141 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c940f081-98b5-489b-89bc-47bfb14f48ae service neutron] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:44:47.198303 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c940f081-98b5-489b-89bc-47bfb14f48ae service neutron] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:44:47.217202 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9157f8-b639-4c5f-95cc-b924ba6cece8 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:44:47.218632 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-ea9157f8-b639-4c5f-95cc-b924ba6cece8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:44:47.381983 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760bfc18-2996-4893-8ebf-702a8dc4564e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:44:47.382648 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760bfc18-2996-4893-8ebf-702a8dc4564e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:47.382925 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760bfc18-2996-4893-8ebf-702a8dc4564e admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:47.383193 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760bfc18-2996-4893-8ebf-702a8dc4564e admin admin] PATH_INFO: `/v3/users/bf9d982904704c0c804007dfdb0db9b2` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:47.385777 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760bfc18-2996-4893-8ebf-702a8dc4564e admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf9d982904704c0c804007dfdb0db9b2)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:44:47.388711 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760bfc18-2996-4893-8ebf-702a8dc4564e admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:44:47.409125 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9157f8-b639-4c5f-95cc-b924ba6cece8 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:44:47.434200 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbc928a-ec6e-4192-8c49-5fb53500baa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:44:47.435203 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbc928a-ec6e-4192-8c49-5fb53500baa9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:47.435836 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbc928a-ec6e-4192-8c49-5fb53500baa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:47.436289 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbc928a-ec6e-4192-8c49-5fb53500baa9 admin admin] PATH_INFO: `/v3/users/d2c43971fe254382a86af1fc76a58a96` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:47.444010 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbc928a-ec6e-4192-8c49-5fb53500baa9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d2c43971fe254382a86af1fc76a58a96)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:44:47.447218 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbc928a-ec6e-4192-8c49-5fb53500baa9 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:44:47.672108 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-760bfc18-2996-4893-8ebf-702a8dc4564e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf9d982904704c0c804007dfdb0db9b2'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:44:47.735089 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-760bfc18-2996-4893-8ebf-702a8dc4564e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf9d982904704c0c804007dfdb0db9b2'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:44:47.743761 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-6dbc928a-ec6e-4192-8c49-5fb53500baa9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd2c43971fe254382a86af1fc76a58a96'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:44:47.749815 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-760bfc18-2996-4893-8ebf-702a8dc4564e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf9d982904704c0c804007dfdb0db9b2'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:44:47.750580 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-760bfc18-2996-4893-8ebf-702a8dc4564e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf9d982904704c0c804007dfdb0db9b2'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:44:47.752193 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-760bfc18-2996-4893-8ebf-702a8dc4564e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf9d982904704c0c804007dfdb0db9b2'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:44:47.851242 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-6dbc928a-ec6e-4192-8c49-5fb53500baa9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd2c43971fe254382a86af1fc76a58a96'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:44:47.882556 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-6dbc928a-ec6e-4192-8c49-5fb53500baa9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd2c43971fe254382a86af1fc76a58a96'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:44:47.883856 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-6dbc928a-ec6e-4192-8c49-5fb53500baa9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd2c43971fe254382a86af1fc76a58a96'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:44:47.884767 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-6dbc928a-ec6e-4192-8c49-5fb53500baa9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd2c43971fe254382a86af1fc76a58a96'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:44:47.904517 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 816/1651] 10.222.0.102 () {58 vars in 1229 bytes} [Mon Aug 1 15:44:47 2022] DELETE /identity/v3/users/d2c43971fe254382a86af1fc76a58a96 => generated 0 bytes in 688 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:44:47.910107 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde45def-0884-4691-a8a6-03260da3392b None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:47.911093 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde45def-0884-4691-a8a6-03260da3392b None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:47.911643 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde45def-0884-4691-a8a6-03260da3392b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:47.919506 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 836/1652] 10.222.0.102 () {58 vars in 1229 bytes} [Mon Aug 1 15:44:47 2022] DELETE /identity/v3/users/bf9d982904704c0c804007dfdb0db9b2 => generated 0 bytes in 740 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:44:48.006590 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-fde45def-0884-4691-a8a6-03260da3392b None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:44:48.008018 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-fde45def-0884-4691-a8a6-03260da3392b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:44:48.184303 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 817/1653] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:44:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 15:44:48.202788 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760bfc18-2996-4893-8ebf-702a8dc4564e admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:44:48.204943 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-760bfc18-2996-4893-8ebf-702a8dc4564e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:44:48.388062 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760bfc18-2996-4893-8ebf-702a8dc4564e admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:44:48.402739 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d7fd5d-a614-4ea0-86eb-8a93965c5aa0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a856a413100443939fe9b10daa868518', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:44:48.403384 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d7fd5d-a614-4ea0-86eb-8a93965c5aa0 service neutron] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:48.403819 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d7fd5d-a614-4ea0-86eb-8a93965c5aa0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:48.404220 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d7fd5d-a614-4ea0-86eb-8a93965c5aa0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:48.425889 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d7fd5d-a614-4ea0-86eb-8a93965c5aa0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:44:48.427687 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d7fd5d-a614-4ea0-86eb-8a93965c5aa0 service neutron] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:44:48.448158 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 837/1654] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:44:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:44:48.982874 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde45def-0884-4691-a8a6-03260da3392b None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:44:48.984352 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-fde45def-0884-4691-a8a6-03260da3392b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:44:49.012655 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde45def-0884-4691-a8a6-03260da3392b None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:44:49.019140 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6176a32-caca-4ea1-b2e7-57d176f0e2d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:44:49.020508 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6176a32-caca-4ea1-b2e7-57d176f0e2d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:49.020976 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6176a32-caca-4ea1-b2e7-57d176f0e2d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:49.021407 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6176a32-caca-4ea1-b2e7-57d176f0e2d1 admin admin] PATH_INFO: `/v3/projects/d6f3a83cd4ac40edb9de91f6806c1e2b` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:49.022835 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6176a32-caca-4ea1-b2e7-57d176f0e2d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6f3a83cd4ac40edb9de91f6806c1e2b)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:44:49.024937 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6176a32-caca-4ea1-b2e7-57d176f0e2d1 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:44:49.039764 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:44:49.192627 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:44:49.207397 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-d6176a32-caca-4ea1-b2e7-57d176f0e2d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6f3a83cd4ac40edb9de91f6806c1e2b', 'request_id': 'req-d6176a32-caca-4ea1-b2e7-57d176f0e2d1'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:44:49.276372 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-d6176a32-caca-4ea1-b2e7-57d176f0e2d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6f3a83cd4ac40edb9de91f6806c1e2b', 'request_id': 'req-d6176a32-caca-4ea1-b2e7-57d176f0e2d1'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:44:49.293686 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-d6176a32-caca-4ea1-b2e7-57d176f0e2d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6f3a83cd4ac40edb9de91f6806c1e2b', 'request_id': 'req-d6176a32-caca-4ea1-b2e7-57d176f0e2d1'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:44:49.306396 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-d6176a32-caca-4ea1-b2e7-57d176f0e2d1 admin admin] The token cache is being invalidate because project d6f3a83cd4ac40edb9de91f6806c1e2b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80353) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 15:44:49.306640 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-d6176a32-caca-4ea1-b2e7-57d176f0e2d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:44:49.307534 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-d6176a32-caca-4ea1-b2e7-57d176f0e2d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:44:49.319002 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 818/1655] 10.222.0.102 () {58 vars in 1238 bytes} [Mon Aug 1 15:44:48 2022] DELETE /identity/v3/projects/d6f3a83cd4ac40edb9de91f6806c1e2b => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:44:49.323779 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a799e570-faee-47d8-9755-a5de039f8aba None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:49.324364 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a799e570-faee-47d8-9755-a5de039f8aba None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:49.324829 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a799e570-faee-47d8-9755-a5de039f8aba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:49.364734 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-a799e570-faee-47d8-9755-a5de039f8aba None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:44:49.373682 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-a799e570-faee-47d8-9755-a5de039f8aba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:44:49.469599 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6176a32-caca-4ea1-b2e7-57d176f0e2d1 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:44:49.471222 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-d6176a32-caca-4ea1-b2e7-57d176f0e2d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:44:49.525627 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 838/1656] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:44:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:44:49.546294 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df207be-89a0-4ccb-b1b1-73faa3c66142 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:49.548544 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df207be-89a0-4ccb-b1b1-73faa3c66142 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:49.548951 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df207be-89a0-4ccb-b1b1-73faa3c66142 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:49.609733 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-7df207be-89a0-4ccb-b1b1-73faa3c66142 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:44:49.611524 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-7df207be-89a0-4ccb-b1b1-73faa3c66142 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:44:49.642158 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 839/1657] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:44:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:44:49.648055 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df207be-89a0-4ccb-b1b1-73faa3c66142 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:44:49.655161 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6176a32-caca-4ea1-b2e7-57d176f0e2d1 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:44:49.670664 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df207be-89a0-4ccb-b1b1-73faa3c66142 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:44:49.673670 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fb35db-d795-48b2-bf5f-ab2376e8252e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:44:49.676378 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fb35db-d795-48b2-bf5f-ab2376e8252e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:49.679434 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fb35db-d795-48b2-bf5f-ab2376e8252e admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:49.681194 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fb35db-d795-48b2-bf5f-ab2376e8252e admin admin] PATH_INFO: `/v3/projects/bbfd29e93df34d4a9fda1e7b53965bd3` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:49.690045 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fb35db-d795-48b2-bf5f-ab2376e8252e admin admin] RBAC: Authorizing `identity:delete_project(project_id=bbfd29e93df34d4a9fda1e7b53965bd3)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:44:49.694278 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fb35db-d795-48b2-bf5f-ab2376e8252e admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:44:49.696215 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb129a36-4060-4d00-b1b5-c8754f8c822f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:44:49.697072 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb129a36-4060-4d00-b1b5-c8754f8c822f admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:49.697443 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb129a36-4060-4d00-b1b5-c8754f8c822f admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:49.697812 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb129a36-4060-4d00-b1b5-c8754f8c822f admin admin] PATH_INFO: `/v3/domains` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:49.698615 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb129a36-4060-4d00-b1b5-c8754f8c822f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:44:49.699906 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb129a36-4060-4d00-b1b5-c8754f8c822f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:44:49.701833 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb129a36-4060-4d00-b1b5-c8754f8c822f admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:44:49.761268 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 840/1658] 10.222.0.102 () {58 vars in 1158 bytes} [Mon Aug 1 15:44:49 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:44:49.766036 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb129a36-4060-4d00-b1b5-c8754f8c822f admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:44:49.794782 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb129a36-4060-4d00-b1b5-c8754f8c822f admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:44:49.807514 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863065ab-9918-448a-9e58-9e5a034f9371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:44:49.808149 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863065ab-9918-448a-9e58-9e5a034f9371 admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:49.808929 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863065ab-9918-448a-9e58-9e5a034f9371 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:49.809414 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863065ab-9918-448a-9e58-9e5a034f9371 admin admin] PATH_INFO: `/v3/projects` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:49.810299 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863065ab-9918-448a-9e58-9e5a034f9371 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:44:49.812456 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863065ab-9918-448a-9e58-9e5a034f9371 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:44:49.884988 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-71fb35db-d795-48b2-bf5f-ab2376e8252e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bbfd29e93df34d4a9fda1e7b53965bd3', 'request_id': 'req-71fb35db-d795-48b2-bf5f-ab2376e8252e'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:44:49.970829 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-71fb35db-d795-48b2-bf5f-ab2376e8252e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bbfd29e93df34d4a9fda1e7b53965bd3', 'request_id': 'req-71fb35db-d795-48b2-bf5f-ab2376e8252e'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:44:49.982615 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-71fb35db-d795-48b2-bf5f-ab2376e8252e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bbfd29e93df34d4a9fda1e7b53965bd3', 'request_id': 'req-71fb35db-d795-48b2-bf5f-ab2376e8252e'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:44:49.989681 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 841/1659] 10.222.0.102 () {60 vars in 1158 bytes} [Mon Aug 1 15:44:49 2022] POST /identity/v3/projects => generated 372 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:44:49.992892 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863065ab-9918-448a-9e58-9e5a034f9371 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:44:50.030400 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-71fb35db-d795-48b2-bf5f-ab2376e8252e admin admin] The token cache is being invalidate because project bbfd29e93df34d4a9fda1e7b53965bd3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80353) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 15:44:50.030883 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-71fb35db-d795-48b2-bf5f-ab2376e8252e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:44:50.036978 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-71fb35db-d795-48b2-bf5f-ab2376e8252e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:44:50.046985 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 819/1660] 10.222.0.102 () {58 vars in 1238 bytes} [Mon Aug 1 15:44:49 2022] DELETE /identity/v3/projects/bbfd29e93df34d4a9fda1e7b53965bd3 => generated 0 bytes in 575 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 15:44:50.053067 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65024f7b-91a0-4b8c-ac06-20db9c5bc8b0 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:50.055069 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65024f7b-91a0-4b8c-ac06-20db9c5bc8b0 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:50.055367 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65024f7b-91a0-4b8c-ac06-20db9c5bc8b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:50.138362 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-65024f7b-91a0-4b8c-ac06-20db9c5bc8b0 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:44:50.140278 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-65024f7b-91a0-4b8c-ac06-20db9c5bc8b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:44:50.219177 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863065ab-9918-448a-9e58-9e5a034f9371 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:44:50.232209 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc11f3c4-91aa-4677-9340-9d72d7bdd5fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:44:50.234103 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc11f3c4-91aa-4677-9340-9d72d7bdd5fb admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:50.234567 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc11f3c4-91aa-4677-9340-9d72d7bdd5fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:50.236193 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc11f3c4-91aa-4677-9340-9d72d7bdd5fb admin admin] PATH_INFO: `/v3/users` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:50.237943 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc11f3c4-91aa-4677-9340-9d72d7bdd5fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:44:50.242695 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc11f3c4-91aa-4677-9340-9d72d7bdd5fb admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:44:50.293317 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 820/1661] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:44:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:44:50.302106 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3721de-b8d9-4ab9-860a-b35d3514a03a None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:50.302383 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3721de-b8d9-4ab9-860a-b35d3514a03a None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:50.302814 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3721de-b8d9-4ab9-860a-b35d3514a03a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:50.346391 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-bd3721de-b8d9-4ab9-860a-b35d3514a03a None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:44:50.347725 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-bd3721de-b8d9-4ab9-860a-b35d3514a03a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:44:50.369487 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 821/1662] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:44:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 15:44:50.373441 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3721de-b8d9-4ab9-860a-b35d3514a03a None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:44:50.394806 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3721de-b8d9-4ab9-860a-b35d3514a03a None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:44:50.415330 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 842/1663] 10.222.0.102 () {60 vars in 1149 bytes} [Mon Aug 1 15:44:49 2022] POST /identity/v3/users => generated 287 bytes in 425 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:44:50.418556 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38092663-fba0-4f11-a126-a0eab2bdcf47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:44:50.418556 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38092663-fba0-4f11-a126-a0eab2bdcf47 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:50.418556 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38092663-fba0-4f11-a126-a0eab2bdcf47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:50.418556 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38092663-fba0-4f11-a126-a0eab2bdcf47 admin admin] PATH_INFO: `/v3/domains` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:50.418837 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38092663-fba0-4f11-a126-a0eab2bdcf47 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:44:50.418837 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38092663-fba0-4f11-a126-a0eab2bdcf47 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:44:50.420577 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc11f3c4-91aa-4677-9340-9d72d7bdd5fb admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:44:50.421036 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38092663-fba0-4f11-a126-a0eab2bdcf47 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:44:50.424996 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-dc11f3c4-91aa-4677-9340-9d72d7bdd5fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:44:50.427424 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:44:50.445095 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 822/1664] 10.222.0.102 () {58 vars in 1158 bytes} [Mon Aug 1 15:44:50 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:44:50.449298 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38092663-fba0-4f11-a126-a0eab2bdcf47 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:44:50.451668 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc11f3c4-91aa-4677-9340-9d72d7bdd5fb admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:44:50.457903 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424b3017-7bf2-4787-a527-e5ec393ec4f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:44:50.459026 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424b3017-7bf2-4787-a527-e5ec393ec4f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:50.459914 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424b3017-7bf2-4787-a527-e5ec393ec4f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:50.460700 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424b3017-7bf2-4787-a527-e5ec393ec4f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:50.461726 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424b3017-7bf2-4787-a527-e5ec393ec4f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:44:50.464591 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424b3017-7bf2-4787-a527-e5ec393ec4f5 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:44:50.470343 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38092663-fba0-4f11-a126-a0eab2bdcf47 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:44:50.484067 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9050b6f7-2883-47bc-83cb-25bf8ed9ac49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:44:50.484381 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 843/1665] 10.222.0.102 () {58 vars in 1127 bytes} [Mon Aug 1 15:44:50 2022] GET /identity/v3/roles => generated 1427 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:44:50.484685 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9050b6f7-2883-47bc-83cb-25bf8ed9ac49 admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:50.485284 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9050b6f7-2883-47bc-83cb-25bf8ed9ac49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:50.485733 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9050b6f7-2883-47bc-83cb-25bf8ed9ac49 admin admin] PATH_INFO: `/v3/projects` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:50.486535 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9050b6f7-2883-47bc-83cb-25bf8ed9ac49 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:44:50.488766 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424b3017-7bf2-4787-a527-e5ec393ec4f5 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:44:50.488916 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9050b6f7-2883-47bc-83cb-25bf8ed9ac49 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:44:50.500321 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424b3017-7bf2-4787-a527-e5ec393ec4f5 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:44:50.506649 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd82d080-c4b1-4cfe-9733-b3d1f5da2c3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:44:50.507510 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd82d080-c4b1-4cfe-9733-b3d1f5da2c3d admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:50.508222 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd82d080-c4b1-4cfe-9733-b3d1f5da2c3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:50.508673 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd82d080-c4b1-4cfe-9733-b3d1f5da2c3d admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:50.509647 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd82d080-c4b1-4cfe-9733-b3d1f5da2c3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:44:50.511564 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd82d080-c4b1-4cfe-9733-b3d1f5da2c3d admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:44:50.539109 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 844/1666] 10.222.0.102 () {58 vars in 1127 bytes} [Mon Aug 1 15:44:50 2022] GET /identity/v3/roles => generated 1427 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:44:50.544153 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5ab07f-0ed4-4766-b469-b2d43159e844 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:50.544662 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5ab07f-0ed4-4766-b469-b2d43159e844 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:50.545144 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5ab07f-0ed4-4766-b469-b2d43159e844 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:50.588574 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-fc5ab07f-0ed4-4766-b469-b2d43159e844 None None] MFA Rules not processed for user `d33afc6f3cc746f6a28e60b0c65f6b89`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:44:50.590397 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-fc5ab07f-0ed4-4766-b469-b2d43159e844 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:44:50.643243 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 823/1667] 10.222.0.102 () {60 vars in 1158 bytes} [Mon Aug 1 15:44:50 2022] POST /identity/v3/projects => generated 380 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 15:44:50.643243 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9050b6f7-2883-47bc-83cb-25bf8ed9ac49 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:44:50.702014 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:44:50.733555 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 845/1668] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:44:50 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 15:44:50.736029 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5ab07f-0ed4-4766-b469-b2d43159e844 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:44:50.767946 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5ab07f-0ed4-4766-b469-b2d43159e844 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:44:50.805049 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9050b6f7-2883-47bc-83cb-25bf8ed9ac49 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:44:50.818213 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542d4a35-2904-466e-90a4-802bd90ddd2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:44:50.819122 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542d4a35-2904-466e-90a4-802bd90ddd2b admin admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:50.819563 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542d4a35-2904-466e-90a4-802bd90ddd2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:50.819990 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542d4a35-2904-466e-90a4-802bd90ddd2b admin admin] PATH_INFO: `/v3/projects/0ca6e268674545739cd212a6cb871d17/users/c8e525fa6fc04be79397f1a85346f340/roles/27f5093ac0674d799cdbd17c68482e32` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:50.866202 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542d4a35-2904-466e-90a4-802bd90ddd2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ca6e268674545739cd212a6cb871d17, user_id=c8e525fa6fc04be79397f1a85346f340, role_id=27f5093ac0674d799cdbd17c68482e32)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:44:50.869489 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542d4a35-2904-466e-90a4-802bd90ddd2b admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:44:50.905230 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938dbe26-ebdf-4f83-aec6-31e69800cfb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:44:50.905835 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938dbe26-ebdf-4f83-aec6-31e69800cfb3 admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:50.906111 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938dbe26-ebdf-4f83-aec6-31e69800cfb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:50.906382 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938dbe26-ebdf-4f83-aec6-31e69800cfb3 admin admin] PATH_INFO: `/v3/users` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:50.907045 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938dbe26-ebdf-4f83-aec6-31e69800cfb3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:44:50.909062 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938dbe26-ebdf-4f83-aec6-31e69800cfb3 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:44:50.970995 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 824/1669] 10.222.0.102 () {60 vars in 1488 bytes} [Mon Aug 1 15:44:50 2022] PUT /identity/v3/projects/0ca6e268674545739cd212a6cb871d17/users/c8e525fa6fc04be79397f1a85346f340/roles/27f5093ac0674d799cdbd17c68482e32 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:44:50.972282 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542d4a35-2904-466e-90a4-802bd90ddd2b admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:44:50.976066 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-542d4a35-2904-466e-90a4-802bd90ddd2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:44:51.109573 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 846/1670] 10.222.0.102 () {60 vars in 1149 bytes} [Mon Aug 1 15:44:50 2022] POST /identity/v3/users => generated 291 bytes in 369 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:44:51.109573 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db50984-47e4-427b-bd84-ce94a7a91271 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:51.109573 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db50984-47e4-427b-bd84-ce94a7a91271 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:51.116762 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db50984-47e4-427b-bd84-ce94a7a91271 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:51.187849 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-6db50984-47e4-427b-bd84-ce94a7a91271 None None] MFA Rules not processed for user `c8e525fa6fc04be79397f1a85346f340`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:44:51.189888 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-6db50984-47e4-427b-bd84-ce94a7a91271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:44:51.204042 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542d4a35-2904-466e-90a4-802bd90ddd2b admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:44:51.223816 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a176aadf-a8d6-4bf2-aeac-a7cda52fbf76 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77b43f1ee8cc4be3907a494abe90c1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:44:51.223816 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a176aadf-a8d6-4bf2-aeac-a7cda52fbf76 service nova] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:51.224561 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a176aadf-a8d6-4bf2-aeac-a7cda52fbf76 service nova] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:51.225137 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a176aadf-a8d6-4bf2-aeac-a7cda52fbf76 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:51.347064 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 847/1671] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:44:51 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:44:51.348504 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db50984-47e4-427b-bd84-ce94a7a91271 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:44:51.386037 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a176aadf-a8d6-4bf2-aeac-a7cda52fbf76 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:44:51.387892 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a176aadf-a8d6-4bf2-aeac-a7cda52fbf76 service nova] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:44:51.426130 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 825/1672] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:44:50 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:44:51.427255 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a176aadf-a8d6-4bf2-aeac-a7cda52fbf76 service nova] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:44:51.555715 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db50984-47e4-427b-bd84-ce94a7a91271 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:44:51.573021 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47880186-d4a3-4289-bb03-ba22c8254d72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:44:51.573906 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47880186-d4a3-4289-bb03-ba22c8254d72 admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:51.577011 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47880186-d4a3-4289-bb03-ba22c8254d72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:51.577297 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47880186-d4a3-4289-bb03-ba22c8254d72 admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:51.578043 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47880186-d4a3-4289-bb03-ba22c8254d72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:44:51.586126 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47880186-d4a3-4289-bb03-ba22c8254d72 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:44:51.620277 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 848/1673] 10.222.0.102 () {58 vars in 1127 bytes} [Mon Aug 1 15:44:51 2022] GET /identity/v3/roles => generated 1427 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:44:51.625947 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47880186-d4a3-4289-bb03-ba22c8254d72 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:44:51.662416 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47880186-d4a3-4289-bb03-ba22c8254d72 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:44:51.664240 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a176aadf-a8d6-4bf2-aeac-a7cda52fbf76 service nova] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:44:51.675752 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240c47cc-df88-4bd7-a703-67867821563b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:44:51.676402 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240c47cc-df88-4bd7-a703-67867821563b admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:51.676682 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240c47cc-df88-4bd7-a703-67867821563b admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:51.676986 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240c47cc-df88-4bd7-a703-67867821563b admin admin] PATH_INFO: `/v3/projects` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:51.677993 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240c47cc-df88-4bd7-a703-67867821563b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:44:51.679810 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3d7ecb-c850-4f35-a8ff-0866cf8ef044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:44:51.680221 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240c47cc-df88-4bd7-a703-67867821563b admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:44:51.680836 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3d7ecb-c850-4f35-a8ff-0866cf8ef044 admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:51.681326 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3d7ecb-c850-4f35-a8ff-0866cf8ef044 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:51.681765 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3d7ecb-c850-4f35-a8ff-0866cf8ef044 admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:51.683347 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3d7ecb-c850-4f35-a8ff-0866cf8ef044 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:44:51.689715 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3d7ecb-c850-4f35-a8ff-0866cf8ef044 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:44:51.719262 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 849/1674] 10.222.0.102 () {58 vars in 1127 bytes} [Mon Aug 1 15:44:51 2022] GET /identity/v3/roles => generated 1427 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:44:51.724212 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3d7ecb-c850-4f35-a8ff-0866cf8ef044 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:44:51.736780 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3d7ecb-c850-4f35-a8ff-0866cf8ef044 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:44:51.744962 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f6de0b-d790-44c7-8edc-611c101843fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:44:51.746008 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f6de0b-d790-44c7-8edc-611c101843fc admin admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:51.746281 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f6de0b-d790-44c7-8edc-611c101843fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:51.746557 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f6de0b-d790-44c7-8edc-611c101843fc admin admin] PATH_INFO: `/v3/projects/20140bb41f5740c48de74329b25d5908/users/94477bca84684c26884e6d3d05658d9a/roles/27f5093ac0674d799cdbd17c68482e32` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:51.771267 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f6de0b-d790-44c7-8edc-611c101843fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=20140bb41f5740c48de74329b25d5908, user_id=94477bca84684c26884e6d3d05658d9a, role_id=27f5093ac0674d799cdbd17c68482e32)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:44:51.774592 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f6de0b-d790-44c7-8edc-611c101843fc admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:44:51.801113 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 826/1675] 10.222.0.102 () {60 vars in 1158 bytes} [Mon Aug 1 15:44:51 2022] POST /identity/v3/projects => generated 374 bytes in 374 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:44:51.805032 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240c47cc-df88-4bd7-a703-67867821563b admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:44:51.875742 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 850/1676] 10.222.0.102 () {60 vars in 1488 bytes} [Mon Aug 1 15:44:51 2022] PUT /identity/v3/projects/20140bb41f5740c48de74329b25d5908/users/94477bca84684c26884e6d3d05658d9a/roles/27f5093ac0674d799cdbd17c68482e32 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 15:44:51.883944 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f6de0b-d790-44c7-8edc-611c101843fc admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:44:51.893145 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-36f6de0b-d790-44c7-8edc-611c101843fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:44:51.944841 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240c47cc-df88-4bd7-a703-67867821563b admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:44:52.048374 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f6de0b-d790-44c7-8edc-611c101843fc admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:44:52.056216 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6d9287-2c02-44d4-91d7-aa22d81b17f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:44:52.056985 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6d9287-2c02-44d4-91d7-aa22d81b17f5 admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:52.057195 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6d9287-2c02-44d4-91d7-aa22d81b17f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:52.057567 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6d9287-2c02-44d4-91d7-aa22d81b17f5 admin admin] PATH_INFO: `/v3/users` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:52.058143 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6d9287-2c02-44d4-91d7-aa22d81b17f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:44:52.064562 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:44:52.065674 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644af3d4-668b-4aba-b12d-dff5df9f075f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:44:52.066393 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644af3d4-668b-4aba-b12d-dff5df9f075f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:52.066758 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644af3d4-668b-4aba-b12d-dff5df9f075f admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:52.067056 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6d9287-2c02-44d4-91d7-aa22d81b17f5 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:44:52.067164 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644af3d4-668b-4aba-b12d-dff5df9f075f admin admin] PATH_INFO: `/v3/projects/35fe5621e96944d19dfa398045e075db` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:52.068466 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644af3d4-668b-4aba-b12d-dff5df9f075f admin admin] RBAC: Authorizing `identity:delete_project(project_id=35fe5621e96944d19dfa398045e075db)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:44:52.070494 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644af3d4-668b-4aba-b12d-dff5df9f075f admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:44:52.167615 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 827/1677] 10.222.0.102 () {60 vars in 1149 bytes} [Mon Aug 1 15:44:51 2022] POST /identity/v3/users => generated 294 bytes in 363 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 15:44:52.170993 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2689a7-6376-4caa-8c4f-0fefc8482317 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:52.172713 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2689a7-6376-4caa-8c4f-0fefc8482317 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:52.173298 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2689a7-6376-4caa-8c4f-0fefc8482317 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:52.271464 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-644af3d4-668b-4aba-b12d-dff5df9f075f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35fe5621e96944d19dfa398045e075db', 'request_id': 'req-644af3d4-668b-4aba-b12d-dff5df9f075f'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:44:52.288143 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-644af3d4-668b-4aba-b12d-dff5df9f075f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35fe5621e96944d19dfa398045e075db', 'request_id': 'req-644af3d4-668b-4aba-b12d-dff5df9f075f'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:44:52.301727 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-5a2689a7-6376-4caa-8c4f-0fefc8482317 None None] MFA Rules not processed for user `94477bca84684c26884e6d3d05658d9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:44:52.306750 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-5a2689a7-6376-4caa-8c4f-0fefc8482317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:44:52.363526 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:44:52.410146 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-644af3d4-668b-4aba-b12d-dff5df9f075f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35fe5621e96944d19dfa398045e075db', 'request_id': 'req-644af3d4-668b-4aba-b12d-dff5df9f075f'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:44:52.433523 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-644af3d4-668b-4aba-b12d-dff5df9f075f admin admin] The token cache is being invalidate because project 35fe5621e96944d19dfa398045e075db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80352) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 15:44:52.433860 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-644af3d4-668b-4aba-b12d-dff5df9f075f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:44:52.434832 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-644af3d4-668b-4aba-b12d-dff5df9f075f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:44:52.440092 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 851/1678] 10.222.0.102 () {58 vars in 1238 bytes} [Mon Aug 1 15:44:51 2022] DELETE /identity/v3/projects/35fe5621e96944d19dfa398045e075db => generated 0 bytes in 553 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 15:44:52.441213 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644af3d4-668b-4aba-b12d-dff5df9f075f admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:44:52.442603 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-644af3d4-668b-4aba-b12d-dff5df9f075f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:44:52.473285 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 828/1679] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:44:52 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:44:52.474431 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2689a7-6376-4caa-8c4f-0fefc8482317 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:44:52.481495 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-5a2689a7-6376-4caa-8c4f-0fefc8482317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:44:52.539861 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644af3d4-668b-4aba-b12d-dff5df9f075f admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:44:52.545526 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d467e6f9-22d9-4035-8373-59865c676f72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:44:52.546295 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d467e6f9-22d9-4035-8373-59865c676f72 admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:52.546667 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d467e6f9-22d9-4035-8373-59865c676f72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:52.547101 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d467e6f9-22d9-4035-8373-59865c676f72 admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:52.548385 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d467e6f9-22d9-4035-8373-59865c676f72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:44:52.550298 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d467e6f9-22d9-4035-8373-59865c676f72 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:44:52.575132 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 852/1680] 10.222.0.102 () {58 vars in 1127 bytes} [Mon Aug 1 15:44:52 2022] GET /identity/v3/roles => generated 1427 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:44:52.577367 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d467e6f9-22d9-4035-8373-59865c676f72 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:44:52.580332 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-d467e6f9-22d9-4035-8373-59865c676f72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:44:52.600065 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d467e6f9-22d9-4035-8373-59865c676f72 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:44:52.605261 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23db0a58-2c0a-42d1-9833-8b81f1f3b4c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:44:52.606327 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23db0a58-2c0a-42d1-9833-8b81f1f3b4c6 admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:52.606327 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23db0a58-2c0a-42d1-9833-8b81f1f3b4c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:52.606772 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23db0a58-2c0a-42d1-9833-8b81f1f3b4c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:52.607571 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23db0a58-2c0a-42d1-9833-8b81f1f3b4c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:44:52.610028 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23db0a58-2c0a-42d1-9833-8b81f1f3b4c6 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:44:52.664317 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2689a7-6376-4caa-8c4f-0fefc8482317 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:44:52.672387 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a42ac1-4093-456c-8e3b-ef996f91fc60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:44:52.673283 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a42ac1-4093-456c-8e3b-ef996f91fc60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:52.673633 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a42ac1-4093-456c-8e3b-ef996f91fc60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:52.674005 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a42ac1-4093-456c-8e3b-ef996f91fc60 admin admin] PATH_INFO: `/v3/users/a36226f3c4044620b87d941104309fa7` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:52.675455 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a42ac1-4093-456c-8e3b-ef996f91fc60 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a36226f3c4044620b87d941104309fa7)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:44:52.677700 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a42ac1-4093-456c-8e3b-ef996f91fc60 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:44:52.816144 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 853/1681] 10.222.0.102 () {60 vars in 1158 bytes} [Mon Aug 1 15:44:52 2022] POST /identity/v3/projects => generated 382 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:44:52.819066 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23db0a58-2c0a-42d1-9833-8b81f1f3b4c6 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:44:52.957033 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-61a42ac1-4093-456c-8e3b-ef996f91fc60 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a36226f3c4044620b87d941104309fa7'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:44:53.049497 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23db0a58-2c0a-42d1-9833-8b81f1f3b4c6 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:44:53.063689 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8efe70f-8016-4664-bcb4-cebd8c2c5e90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:44:53.064456 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8efe70f-8016-4664-bcb4-cebd8c2c5e90 admin admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:53.064741 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8efe70f-8016-4664-bcb4-cebd8c2c5e90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:53.067733 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8efe70f-8016-4664-bcb4-cebd8c2c5e90 admin admin] PATH_INFO: `/v3/projects/4e9e88cb8da84eceb0ff5ba693f33809/users/09e61a8af18f4db4907a8023e461c7c9/roles/de1374f966c04c27b579515b54334fd2` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:53.079115 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-61a42ac1-4093-456c-8e3b-ef996f91fc60 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a36226f3c4044620b87d941104309fa7'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:44:53.097199 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8efe70f-8016-4664-bcb4-cebd8c2c5e90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e9e88cb8da84eceb0ff5ba693f33809, user_id=09e61a8af18f4db4907a8023e461c7c9, role_id=de1374f966c04c27b579515b54334fd2)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:44:53.097785 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-61a42ac1-4093-456c-8e3b-ef996f91fc60 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a36226f3c4044620b87d941104309fa7'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:44:53.098715 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-61a42ac1-4093-456c-8e3b-ef996f91fc60 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a36226f3c4044620b87d941104309fa7'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:44:53.099496 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-61a42ac1-4093-456c-8e3b-ef996f91fc60 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a36226f3c4044620b87d941104309fa7'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:44:53.101882 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8efe70f-8016-4664-bcb4-cebd8c2c5e90 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:44:53.136348 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 829/1682] 10.222.0.102 () {58 vars in 1229 bytes} [Mon Aug 1 15:44:52 2022] DELETE /identity/v3/users/a36226f3c4044620b87d941104309fa7 => generated 0 bytes in 662 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:44:53.139944 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a42ac1-4093-456c-8e3b-ef996f91fc60 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:44:53.144919 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-61a42ac1-4093-456c-8e3b-ef996f91fc60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:44:53.226985 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 854/1683] 10.222.0.102 () {60 vars in 1488 bytes} [Mon Aug 1 15:44:52 2022] PUT /identity/v3/projects/4e9e88cb8da84eceb0ff5ba693f33809/users/09e61a8af18f4db4907a8023e461c7c9/roles/de1374f966c04c27b579515b54334fd2 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:44:53.232505 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8efe70f-8016-4664-bcb4-cebd8c2c5e90 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:44:53.235457 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-b8efe70f-8016-4664-bcb4-cebd8c2c5e90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:44:53.344233 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a42ac1-4093-456c-8e3b-ef996f91fc60 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:44:53.488343 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8efe70f-8016-4664-bcb4-cebd8c2c5e90 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:44:53.521742 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2e8c96-319c-46ea-917b-93bf61dd2040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:44:53.523139 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2e8c96-319c-46ea-917b-93bf61dd2040 admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:53.524896 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2e8c96-319c-46ea-917b-93bf61dd2040 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:53.525016 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2e8c96-319c-46ea-917b-93bf61dd2040 admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:53.525789 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2e8c96-319c-46ea-917b-93bf61dd2040 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:44:53.530084 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2e8c96-319c-46ea-917b-93bf61dd2040 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:44:53.557069 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 855/1684] 10.222.0.102 () {58 vars in 1127 bytes} [Mon Aug 1 15:44:53 2022] GET /identity/v3/roles => generated 1427 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:44:53.561308 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2e8c96-319c-46ea-917b-93bf61dd2040 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:44:53.585861 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2e8c96-319c-46ea-917b-93bf61dd2040 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:44:53.591121 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429fa106-af43-47a0-ad7f-60d40d78f825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:44:53.592155 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429fa106-af43-47a0-ad7f-60d40d78f825 admin admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:53.592555 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429fa106-af43-47a0-ad7f-60d40d78f825 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:53.592922 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429fa106-af43-47a0-ad7f-60d40d78f825 admin admin] PATH_INFO: `/v3/projects/4e9e88cb8da84eceb0ff5ba693f33809/users/09e61a8af18f4db4907a8023e461c7c9/roles/de1374f966c04c27b579515b54334fd2` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:53.596494 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429fa106-af43-47a0-ad7f-60d40d78f825 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e9e88cb8da84eceb0ff5ba693f33809, user_id=09e61a8af18f4db4907a8023e461c7c9, role_id=de1374f966c04c27b579515b54334fd2)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:44:53.600121 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429fa106-af43-47a0-ad7f-60d40d78f825 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:44:53.621765 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b72389-d39c-4ae7-96e7-f68c5c6fa0b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:44:53.622502 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b72389-d39c-4ae7-96e7-f68c5c6fa0b8 admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:53.622819 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b72389-d39c-4ae7-96e7-f68c5c6fa0b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:53.623071 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b72389-d39c-4ae7-96e7-f68c5c6fa0b8 admin admin] PATH_INFO: `/v3/users` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:53.623245 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 856/1685] 10.222.0.102 () {60 vars in 1488 bytes} [Mon Aug 1 15:44:53 2022] PUT /identity/v3/projects/4e9e88cb8da84eceb0ff5ba693f33809/users/09e61a8af18f4db4907a8023e461c7c9/roles/de1374f966c04c27b579515b54334fd2 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 15:44:53.632701 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b72389-d39c-4ae7-96e7-f68c5c6fa0b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:44:53.635591 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b45ddd-74d9-40ca-be4c-320ca6129643 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:53.636030 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b45ddd-74d9-40ca-be4c-320ca6129643 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:53.636349 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b45ddd-74d9-40ca-be4c-320ca6129643 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:53.636454 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b72389-d39c-4ae7-96e7-f68c5c6fa0b8 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:44:53.722158 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-86b45ddd-74d9-40ca-be4c-320ca6129643 None None] MFA Rules not processed for user `09e61a8af18f4db4907a8023e461c7c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:44:53.724028 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-86b45ddd-74d9-40ca-be4c-320ca6129643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:44:53.806820 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 830/1686] 10.222.0.102 () {60 vars in 1149 bytes} [Mon Aug 1 15:44:53 2022] POST /identity/v3/users => generated 298 bytes in 670 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:44:53.811671 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b72389-d39c-4ae7-96e7-f68c5c6fa0b8 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:44:53.825294 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b72389-d39c-4ae7-96e7-f68c5c6fa0b8 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:44:53.969669 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9a416f-5baa-4555-aad6-5c837a282464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:44:53.970468 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9a416f-5baa-4555-aad6-5c837a282464 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:53.975164 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9a416f-5baa-4555-aad6-5c837a282464 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:53.975164 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9a416f-5baa-4555-aad6-5c837a282464 admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:53.975164 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9a416f-5baa-4555-aad6-5c837a282464 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:44:53.975164 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9a416f-5baa-4555-aad6-5c837a282464 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:44:53.975472 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 857/1687] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:44:53 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 340 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:44:53.975472 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b45ddd-74d9-40ca-be4c-320ca6129643 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:44:53.987720 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-86b45ddd-74d9-40ca-be4c-320ca6129643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:44:54.009249 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 831/1688] 10.222.0.102 () {58 vars in 1127 bytes} [Mon Aug 1 15:44:53 2022] GET /identity/v3/roles => generated 1427 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:44:54.010760 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37727182-c3bb-402a-85e1-523443376f5f None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:54.011054 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37727182-c3bb-402a-85e1-523443376f5f None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:54.011332 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37727182-c3bb-402a-85e1-523443376f5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:54.064688 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:44:54.100943 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-37727182-c3bb-402a-85e1-523443376f5f None None] MFA Rules not processed for user `82ab36c0e0804e4d8aaff377095aade7`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:44:54.102607 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-37727182-c3bb-402a-85e1-523443376f5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:44:54.223613 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b45ddd-74d9-40ca-be4c-320ca6129643 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:44:54.229805 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e1d029-d58c-4094-ba5a-378be95e7156 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff810b37183c4729859c1b05edff1703', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:44:54.230450 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e1d029-d58c-4094-ba5a-378be95e7156 service cinder] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:54.230841 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e1d029-d58c-4094-ba5a-378be95e7156 service cinder] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:54.231169 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e1d029-d58c-4094-ba5a-378be95e7156 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:54.245808 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e1d029-d58c-4094-ba5a-378be95e7156 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:44:54.248795 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e1d029-d58c-4094-ba5a-378be95e7156 service cinder] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:44:54.297295 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 858/1689] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:44:53 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:44:54.300753 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e1d029-d58c-4094-ba5a-378be95e7156 service cinder] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:44:54.338728 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e1d029-d58c-4094-ba5a-378be95e7156 service cinder] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:44:54.351010 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 832/1690] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:44:54 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 341 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:44:54.351941 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37727182-c3bb-402a-85e1-523443376f5f None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:44:54.353028 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fa9cff-e003-461e-967c-ace70c53b0d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:44:54.353734 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fa9cff-e003-461e-967c-ace70c53b0d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:54.354011 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fa9cff-e003-461e-967c-ace70c53b0d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:54.354286 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fa9cff-e003-461e-967c-ace70c53b0d7 admin admin] PATH_INFO: `/v3/projects/afe50c6c1c7a4c028f9fe53582527b71/users/ff48549512ca48b6aaa9315a54215a76/roles/de1374f966c04c27b579515b54334fd2` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:54.357726 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-37727182-c3bb-402a-85e1-523443376f5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:44:54.413110 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fa9cff-e003-461e-967c-ace70c53b0d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=afe50c6c1c7a4c028f9fe53582527b71, user_id=ff48549512ca48b6aaa9315a54215a76, role_id=de1374f966c04c27b579515b54334fd2)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:44:54.416646 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fa9cff-e003-461e-967c-ace70c53b0d7 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:44:54.427839 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37727182-c3bb-402a-85e1-523443376f5f None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:44:54.441163 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350cc960-a6ec-4e97-b3c3-9aae88e11902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:44:54.441845 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350cc960-a6ec-4e97-b3c3-9aae88e11902 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:54.442129 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350cc960-a6ec-4e97-b3c3-9aae88e11902 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:54.442414 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350cc960-a6ec-4e97-b3c3-9aae88e11902 admin admin] PATH_INFO: `/v3/projects/bf707ecc0e924bba95f0df83ef0dcca4` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:54.444461 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350cc960-a6ec-4e97-b3c3-9aae88e11902 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf707ecc0e924bba95f0df83ef0dcca4)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:44:54.455667 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350cc960-a6ec-4e97-b3c3-9aae88e11902 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:44:54.517747 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 859/1691] 10.222.0.102 () {60 vars in 1488 bytes} [Mon Aug 1 15:44:54 2022] PUT /identity/v3/projects/afe50c6c1c7a4c028f9fe53582527b71/users/ff48549512ca48b6aaa9315a54215a76/roles/de1374f966c04c27b579515b54334fd2 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:44:54.521342 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db51843-f807-4b02-99fb-7efd80ae2069 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:54.521342 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db51843-f807-4b02-99fb-7efd80ae2069 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:54.521342 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db51843-f807-4b02-99fb-7efd80ae2069 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:54.584059 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-3db51843-f807-4b02-99fb-7efd80ae2069 None None] MFA Rules not processed for user `82ab36c0e0804e4d8aaff377095aade7`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:44:54.584059 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-3db51843-f807-4b02-99fb-7efd80ae2069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:44:54.692550 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-350cc960-a6ec-4e97-b3c3-9aae88e11902 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf707ecc0e924bba95f0df83ef0dcca4', 'request_id': 'req-350cc960-a6ec-4e97-b3c3-9aae88e11902'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:44:54.733851 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 860/1692] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:44:54 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:44:54.733851 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db51843-f807-4b02-99fb-7efd80ae2069 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:44:54.844603 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db51843-f807-4b02-99fb-7efd80ae2069 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:44:54.870985 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-350cc960-a6ec-4e97-b3c3-9aae88e11902 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf707ecc0e924bba95f0df83ef0dcca4', 'request_id': 'req-350cc960-a6ec-4e97-b3c3-9aae88e11902'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:44:54.884326 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-350cc960-a6ec-4e97-b3c3-9aae88e11902 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf707ecc0e924bba95f0df83ef0dcca4', 'request_id': 'req-350cc960-a6ec-4e97-b3c3-9aae88e11902'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:44:54.912785 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-350cc960-a6ec-4e97-b3c3-9aae88e11902 admin admin] The token cache is being invalidate because project bf707ecc0e924bba95f0df83ef0dcca4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80353) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 15:44:54.913335 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-350cc960-a6ec-4e97-b3c3-9aae88e11902 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:44:54.914813 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-350cc960-a6ec-4e97-b3c3-9aae88e11902 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:44:54.917145 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 833/1693] 10.222.0.102 () {58 vars in 1238 bytes} [Mon Aug 1 15:44:54 2022] DELETE /identity/v3/projects/bf707ecc0e924bba95f0df83ef0dcca4 => generated 0 bytes in 566 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:44:54.918358 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350cc960-a6ec-4e97-b3c3-9aae88e11902 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:44:54.922837 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-350cc960-a6ec-4e97-b3c3-9aae88e11902 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:44:54.934763 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f515888d-3964-478e-80f9-ab415a0e85db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:44:54.935496 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f515888d-3964-478e-80f9-ab415a0e85db admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:54.935776 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f515888d-3964-478e-80f9-ab415a0e85db admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:54.936205 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f515888d-3964-478e-80f9-ab415a0e85db admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:54.937011 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f515888d-3964-478e-80f9-ab415a0e85db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:44:54.940205 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f515888d-3964-478e-80f9-ab415a0e85db admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:44:54.957935 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 861/1694] 10.222.0.102 () {58 vars in 1127 bytes} [Mon Aug 1 15:44:54 2022] GET /identity/v3/roles => generated 1427 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:44:54.958963 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f515888d-3964-478e-80f9-ab415a0e85db admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:44:54.970543 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-f515888d-3964-478e-80f9-ab415a0e85db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:44:55.150085 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350cc960-a6ec-4e97-b3c3-9aae88e11902 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:44:55.175056 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649e726e-4c91-40f1-b4f3-51fd20dffe26 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff810b37183c4729859c1b05edff1703', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:44:55.176981 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649e726e-4c91-40f1-b4f3-51fd20dffe26 service cinder] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:55.176981 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649e726e-4c91-40f1-b4f3-51fd20dffe26 service cinder] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:55.176981 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649e726e-4c91-40f1-b4f3-51fd20dffe26 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:55.182983 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-649e726e-4c91-40f1-b4f3-51fd20dffe26 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:44:55.257539 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f515888d-3964-478e-80f9-ab415a0e85db admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:44:55.264740 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c496b3c4-ca39-47bc-807d-45127fd37c71 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77b43f1ee8cc4be3907a494abe90c1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:44:55.269433 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c496b3c4-ca39-47bc-807d-45127fd37c71 service nova] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:55.269433 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c496b3c4-ca39-47bc-807d-45127fd37c71 service nova] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:55.269433 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c496b3c4-ca39-47bc-807d-45127fd37c71 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:55.269433 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-c496b3c4-ca39-47bc-807d-45127fd37c71 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:44:55.294728 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:44:55.339919 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649e726e-4c91-40f1-b4f3-51fd20dffe26 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:44:55.343334 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649e726e-4c91-40f1-b4f3-51fd20dffe26 service cinder] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:44:55.372103 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 834/1695] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:44:54 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:44:55.378267 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dccfa22-0f18-475e-b31b-5c40eff79098 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:55.383515 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dccfa22-0f18-475e-b31b-5c40eff79098 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:55.383515 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dccfa22-0f18-475e-b31b-5c40eff79098 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:55.423873 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-2dccfa22-0f18-475e-b31b-5c40eff79098 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:44:55.427052 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-2dccfa22-0f18-475e-b31b-5c40eff79098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:44:55.447562 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 835/1696] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:44:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:44:55.453050 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dccfa22-0f18-475e-b31b-5c40eff79098 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:44:55.453050 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-2dccfa22-0f18-475e-b31b-5c40eff79098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:44:55.455680 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c496b3c4-ca39-47bc-807d-45127fd37c71 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:44:55.463889 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c496b3c4-ca39-47bc-807d-45127fd37c71 service nova] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:44:55.480315 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 862/1697] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:44:54 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 522 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:44:55.482612 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dccfa22-0f18-475e-b31b-5c40eff79098 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:44:55.483849 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94c57e9-1104-4565-94c0-c9afa8d74881 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:55.484130 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94c57e9-1104-4565-94c0-c9afa8d74881 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:55.484409 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94c57e9-1104-4565-94c0-c9afa8d74881 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:55.494036 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05996c0-c5b3-460b-9113-bc7aaff9fc31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:44:55.504360 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05996c0-c5b3-460b-9113-bc7aaff9fc31 admin admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:55.504360 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05996c0-c5b3-460b-9113-bc7aaff9fc31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:55.504360 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05996c0-c5b3-460b-9113-bc7aaff9fc31 admin admin] PATH_INFO: `/v3/projects/afe50c6c1c7a4c028f9fe53582527b71/users/ff48549512ca48b6aaa9315a54215a76/roles/de1374f966c04c27b579515b54334fd2` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:55.504360 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05996c0-c5b3-460b-9113-bc7aaff9fc31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=afe50c6c1c7a4c028f9fe53582527b71, user_id=ff48549512ca48b6aaa9315a54215a76, role_id=de1374f966c04c27b579515b54334fd2)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:44:55.506040 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05996c0-c5b3-460b-9113-bc7aaff9fc31 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:44:55.527064 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-e94c57e9-1104-4565-94c0-c9afa8d74881 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:44:55.530930 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-e94c57e9-1104-4565-94c0-c9afa8d74881 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:44:55.532489 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 836/1698] 10.222.0.102 () {60 vars in 1488 bytes} [Mon Aug 1 15:44:55 2022] PUT /identity/v3/projects/afe50c6c1c7a4c028f9fe53582527b71/users/ff48549512ca48b6aaa9315a54215a76/roles/de1374f966c04c27b579515b54334fd2 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:44:55.543213 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4181d7c1-d216-4604-b1fa-fdb5a54b2be1 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:55.549874 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4181d7c1-d216-4604-b1fa-fdb5a54b2be1 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:55.549874 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4181d7c1-d216-4604-b1fa-fdb5a54b2be1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:55.620382 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-4181d7c1-d216-4604-b1fa-fdb5a54b2be1 None None] MFA Rules not processed for user `ff48549512ca48b6aaa9315a54215a76`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:44:55.621651 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-4181d7c1-d216-4604-b1fa-fdb5a54b2be1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:44:55.703644 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 863/1699] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:44:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:44:55.707983 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94c57e9-1104-4565-94c0-c9afa8d74881 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:44:55.723501 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94c57e9-1104-4565-94c0-c9afa8d74881 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:44:55.731419 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829366aa-f904-42bf-9139-c91c589e7022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:44:55.732929 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829366aa-f904-42bf-9139-c91c589e7022 admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:55.733606 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829366aa-f904-42bf-9139-c91c589e7022 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:55.734237 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829366aa-f904-42bf-9139-c91c589e7022 admin admin] PATH_INFO: `/v3/domains` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:55.735334 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829366aa-f904-42bf-9139-c91c589e7022 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:44:55.736410 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829366aa-f904-42bf-9139-c91c589e7022 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:44:55.739745 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829366aa-f904-42bf-9139-c91c589e7022 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:44:55.759590 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 864/1700] 10.222.0.102 () {58 vars in 1158 bytes} [Mon Aug 1 15:44:55 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:44:55.764306 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829366aa-f904-42bf-9139-c91c589e7022 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:44:55.799822 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829366aa-f904-42bf-9139-c91c589e7022 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:44:55.814417 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099bde1c-8436-476c-9dee-b643dcebaedd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:44:55.815703 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099bde1c-8436-476c-9dee-b643dcebaedd admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:55.816162 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099bde1c-8436-476c-9dee-b643dcebaedd admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:55.817931 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099bde1c-8436-476c-9dee-b643dcebaedd admin admin] PATH_INFO: `/v3/projects` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:55.819328 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099bde1c-8436-476c-9dee-b643dcebaedd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:44:55.839888 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099bde1c-8436-476c-9dee-b643dcebaedd admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:44:55.853390 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 837/1701] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:44:55 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:44:55.855240 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4181d7c1-d216-4604-b1fa-fdb5a54b2be1 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:44:55.859021 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-4181d7c1-d216-4604-b1fa-fdb5a54b2be1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:44:55.964198 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4181d7c1-d216-4604-b1fa-fdb5a54b2be1 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:44:55.968632 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c474b1f9-a562-43f6-b588-22e0bdd9a9f7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff810b37183c4729859c1b05edff1703', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:44:55.969348 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c474b1f9-a562-43f6-b588-22e0bdd9a9f7 service cinder] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:55.969693 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c474b1f9-a562-43f6-b588-22e0bdd9a9f7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:55.970002 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c474b1f9-a562-43f6-b588-22e0bdd9a9f7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:55.981274 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c474b1f9-a562-43f6-b588-22e0bdd9a9f7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:44:55.983522 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c474b1f9-a562-43f6-b588-22e0bdd9a9f7 service cinder] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:44:56.015357 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 838/1702] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:44:55 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:44:56.021935 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 865/1703] 10.222.0.102 () {60 vars in 1158 bytes} [Mon Aug 1 15:44:55 2022] POST /identity/v3/projects => generated 388 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:44:56.024340 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c474b1f9-a562-43f6-b588-22e0bdd9a9f7 service cinder] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:44:56.055433 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c474b1f9-a562-43f6-b588-22e0bdd9a9f7 service cinder] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:44:56.170197 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099bde1c-8436-476c-9dee-b643dcebaedd admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:44:56.175767 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-099bde1c-8436-476c-9dee-b643dcebaedd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:44:56.182034 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554b5bfd-3a2d-45c5-8e42-66ccbe824936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:44:56.182034 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554b5bfd-3a2d-45c5-8e42-66ccbe824936 admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:56.182034 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554b5bfd-3a2d-45c5-8e42-66ccbe824936 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:56.182034 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554b5bfd-3a2d-45c5-8e42-66ccbe824936 admin admin] PATH_INFO: `/v3/users` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:56.182436 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554b5bfd-3a2d-45c5-8e42-66ccbe824936 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:44:56.183768 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554b5bfd-3a2d-45c5-8e42-66ccbe824936 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:44:56.220399 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099bde1c-8436-476c-9dee-b643dcebaedd admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:44:56.256483 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4d7a84-308b-4d84-a9ab-3b033b3de218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:44:56.256483 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4d7a84-308b-4d84-a9ab-3b033b3de218 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:56.256483 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4d7a84-308b-4d84-a9ab-3b033b3de218 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:56.256483 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4d7a84-308b-4d84-a9ab-3b033b3de218 admin admin] PATH_INFO: `/v3/users/8f070357a5b94f10bcf1b30b8174f71a` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:56.257289 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4d7a84-308b-4d84-a9ab-3b033b3de218 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f070357a5b94f10bcf1b30b8174f71a)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:44:56.257289 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4d7a84-308b-4d84-a9ab-3b033b3de218 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:44:56.304264 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 839/1704] 10.222.0.102 () {60 vars in 1149 bytes} [Mon Aug 1 15:44:56 2022] POST /identity/v3/users => generated 295 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:44:56.305440 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554b5bfd-3a2d-45c5-8e42-66ccbe824936 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:44:56.340839 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554b5bfd-3a2d-45c5-8e42-66ccbe824936 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:44:56.356947 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ab5002-d06d-4bd5-acf0-f77693a8a1c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:44:56.358180 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ab5002-d06d-4bd5-acf0-f77693a8a1c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:56.358459 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ab5002-d06d-4bd5-acf0-f77693a8a1c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:56.358727 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ab5002-d06d-4bd5-acf0-f77693a8a1c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:56.359729 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ab5002-d06d-4bd5-acf0-f77693a8a1c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:44:56.363618 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ab5002-d06d-4bd5-acf0-f77693a8a1c7 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:44:56.394971 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 840/1705] 10.222.0.102 () {58 vars in 1127 bytes} [Mon Aug 1 15:44:56 2022] GET /identity/v3/roles => generated 1427 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:44:56.400618 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ab5002-d06d-4bd5-acf0-f77693a8a1c7 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:44:56.429490 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ab5002-d06d-4bd5-acf0-f77693a8a1c7 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:44:56.437129 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c559bbec-78a2-4213-ba1e-b7f06f2ab6e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:44:56.437866 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c559bbec-78a2-4213-ba1e-b7f06f2ab6e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:56.438149 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c559bbec-78a2-4213-ba1e-b7f06f2ab6e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:56.438790 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c559bbec-78a2-4213-ba1e-b7f06f2ab6e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:56.439583 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c559bbec-78a2-4213-ba1e-b7f06f2ab6e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:44:56.441352 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c559bbec-78a2-4213-ba1e-b7f06f2ab6e0 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:44:56.467467 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 841/1706] 10.222.0.102 () {58 vars in 1127 bytes} [Mon Aug 1 15:44:56 2022] GET /identity/v3/roles => generated 1427 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:44:56.468440 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c559bbec-78a2-4213-ba1e-b7f06f2ab6e0 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:44:56.481079 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c559bbec-78a2-4213-ba1e-b7f06f2ab6e0 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:44:56.486963 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc38edd8-a945-4e56-ad15-b886cbedad01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:44:56.488017 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc38edd8-a945-4e56-ad15-b886cbedad01 admin admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:56.488343 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc38edd8-a945-4e56-ad15-b886cbedad01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:56.488619 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc38edd8-a945-4e56-ad15-b886cbedad01 admin admin] PATH_INFO: `/v3/projects/6cfcfdebbd1b43fdac2e5e2cf1ed018d/users/2687a4c0f03a4144aef7dc72feffd981/roles/27f5093ac0674d799cdbd17c68482e32` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:56.531350 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc38edd8-a945-4e56-ad15-b886cbedad01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6cfcfdebbd1b43fdac2e5e2cf1ed018d, user_id=2687a4c0f03a4144aef7dc72feffd981, role_id=27f5093ac0674d799cdbd17c68482e32)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:44:56.536457 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc38edd8-a945-4e56-ad15-b886cbedad01 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:44:56.578148 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-bb4d7a84-308b-4d84-a9ab-3b033b3de218 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f070357a5b94f10bcf1b30b8174f71a'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:44:56.609293 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-bb4d7a84-308b-4d84-a9ab-3b033b3de218 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f070357a5b94f10bcf1b30b8174f71a'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:44:56.622489 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-bb4d7a84-308b-4d84-a9ab-3b033b3de218 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f070357a5b94f10bcf1b30b8174f71a'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:44:56.624731 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-bb4d7a84-308b-4d84-a9ab-3b033b3de218 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f070357a5b94f10bcf1b30b8174f71a'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:44:56.625495 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-bb4d7a84-308b-4d84-a9ab-3b033b3de218 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f070357a5b94f10bcf1b30b8174f71a'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:44:56.679813 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 842/1707] 10.222.0.102 () {60 vars in 1488 bytes} [Mon Aug 1 15:44:56 2022] PUT /identity/v3/projects/6cfcfdebbd1b43fdac2e5e2cf1ed018d/users/2687a4c0f03a4144aef7dc72feffd981/roles/27f5093ac0674d799cdbd17c68482e32 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:44:56.681318 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c72152-92ed-4607-839c-6c620f8b22d2 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:56.681708 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c72152-92ed-4607-839c-6c620f8b22d2 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:56.682093 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c72152-92ed-4607-839c-6c620f8b22d2 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:56.688293 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 843/1708] 10.222.0.102 () {54 vars in 917 bytes} [Mon Aug 1 15:44:56 2022] GET /identity => generated 271 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 15:44:56.690010 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc9460b-4824-4b5a-93e1-6adf14960533 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:56.695460 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc9460b-4824-4b5a-93e1-6adf14960533 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:56.695460 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc9460b-4824-4b5a-93e1-6adf14960533 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:56.725566 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 866/1709] 10.222.0.102 () {58 vars in 1229 bytes} [Mon Aug 1 15:44:56 2022] DELETE /identity/v3/users/8f070357a5b94f10bcf1b30b8174f71a => generated 0 bytes in 556 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 15:44:56.729821 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed19e9e-34b6-474a-a215-03730b42e4ed None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:56.730115 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed19e9e-34b6-474a-a215-03730b42e4ed None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:56.736232 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed19e9e-34b6-474a-a215-03730b42e4ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:56.744067 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-adc9460b-4824-4b5a-93e1-6adf14960533 None None] MFA Rules not processed for user `a856a413100443939fe9b10daa868518`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:44:56.746511 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-adc9460b-4824-4b5a-93e1-6adf14960533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:44:56.747275 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:DELETE=6,keystone:SELECT=91,keystone:INSERT=3 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:44:56.785721 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-2ed19e9e-34b6-474a-a215-03730b42e4ed None None] MFA Rules not processed for user `2687a4c0f03a4144aef7dc72feffd981`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:44:56.787088 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-2ed19e9e-34b6-474a-a215-03730b42e4ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:44:56.856196 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 844/1710] 10.222.0.102 () {58 vars in 1014 bytes} [Mon Aug 1 15:44:56 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:44:56.859299 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6187562c-d73d-458e-a819-e9a66454f70a None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:56.859609 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6187562c-d73d-458e-a819-e9a66454f70a None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:56.859886 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6187562c-d73d-458e-a819-e9a66454f70a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:56.881211 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 867/1711] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:44:56 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:44:56.895304 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed19e9e-34b6-474a-a215-03730b42e4ed None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:44:56.897321 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-2ed19e9e-34b6-474a-a215-03730b42e4ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:44:56.912748 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-6187562c-d73d-458e-a819-e9a66454f70a None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:44:56.914044 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-6187562c-d73d-458e-a819-e9a66454f70a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:44:57.000895 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed19e9e-34b6-474a-a215-03730b42e4ed None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:44:57.009685 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfca6dd-d555-4f08-b296-0fe0d3961144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:44:57.010655 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfca6dd-d555-4f08-b296-0fe0d3961144 admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:57.011181 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfca6dd-d555-4f08-b296-0fe0d3961144 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:57.012571 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfca6dd-d555-4f08-b296-0fe0d3961144 admin admin] PATH_INFO: `/v3/projects` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:57.013978 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfca6dd-d555-4f08-b296-0fe0d3961144 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:44:57.016567 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfca6dd-d555-4f08-b296-0fe0d3961144 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:44:57.036207 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 845/1712] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:44:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:44:57.037111 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6187562c-d73d-458e-a819-e9a66454f70a None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:44:57.039950 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-6187562c-d73d-458e-a819-e9a66454f70a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:44:57.069756 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6187562c-d73d-458e-a819-e9a66454f70a None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:44:57.079717 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbb2f3c-0c13-4e4a-af64-8b1c0deba264 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a856a413100443939fe9b10daa868518', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:44:57.080450 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbb2f3c-0c13-4e4a-af64-8b1c0deba264 service neutron] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:57.080739 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbb2f3c-0c13-4e4a-af64-8b1c0deba264 service neutron] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:57.081037 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbb2f3c-0c13-4e4a-af64-8b1c0deba264 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:57.096928 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbb2f3c-0c13-4e4a-af64-8b1c0deba264 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:44:57.098429 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbb2f3c-0c13-4e4a-af64-8b1c0deba264 service neutron] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:44:57.107904 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 846/1713] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:44:57 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:44:57.108770 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbb2f3c-0c13-4e4a-af64-8b1c0deba264 service neutron] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:44:57.124545 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbb2f3c-0c13-4e4a-af64-8b1c0deba264 service neutron] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:44:57.130217 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:44:57.138814 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13445c6f-0304-45ec-8159-c1233061b516 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a856a413100443939fe9b10daa868518', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:44:57.141046 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13445c6f-0304-45ec-8159-c1233061b516 service neutron] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:57.141488 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13445c6f-0304-45ec-8159-c1233061b516 service neutron] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:57.142461 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13445c6f-0304-45ec-8159-c1233061b516 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:57.161864 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13445c6f-0304-45ec-8159-c1233061b516 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:44:57.168173 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13445c6f-0304-45ec-8159-c1233061b516 service neutron] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:44:57.188225 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 868/1714] 10.222.0.102 () {60 vars in 1158 bytes} [Mon Aug 1 15:44:56 2022] POST /identity/v3/projects => generated 386 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:44:57.189859 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 847/1715] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:44:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:44:57.195507 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfca6dd-d555-4f08-b296-0fe0d3961144 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:44:57.324945 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfca6dd-d555-4f08-b296-0fe0d3961144 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:44:57.337634 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c670cdf1-6bef-4562-8752-abe28e698acb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:44:57.338281 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c670cdf1-6bef-4562-8752-abe28e698acb admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:57.338560 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c670cdf1-6bef-4562-8752-abe28e698acb admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:57.338830 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c670cdf1-6bef-4562-8752-abe28e698acb admin admin] PATH_INFO: `/v3/users` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:57.339503 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c670cdf1-6bef-4562-8752-abe28e698acb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:44:57.341741 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c670cdf1-6bef-4562-8752-abe28e698acb admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:44:57.394547 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bb097a-cdfd-4e7d-b509-9a3c1aa38415 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:57.394844 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bb097a-cdfd-4e7d-b509-9a3c1aa38415 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:57.395125 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bb097a-cdfd-4e7d-b509-9a3c1aa38415 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:57.451617 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-81bb097a-cdfd-4e7d-b509-9a3c1aa38415 None None] MFA Rules not processed for user `d33afc6f3cc746f6a28e60b0c65f6b89`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:44:57.458840 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-81bb097a-cdfd-4e7d-b509-9a3c1aa38415 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:44:57.497206 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 869/1716] 10.222.0.102 () {60 vars in 1149 bytes} [Mon Aug 1 15:44:57 2022] POST /identity/v3/users => generated 300 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:44:57.498143 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c670cdf1-6bef-4562-8752-abe28e698acb admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:44:57.519910 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c670cdf1-6bef-4562-8752-abe28e698acb admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:44:57.535517 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4eb0180-d929-4d9e-9c5e-be455ba9c08e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:44:57.536312 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eb0180-d929-4d9e-9c5e-be455ba9c08e admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:57.536424 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eb0180-d929-4d9e-9c5e-be455ba9c08e admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:57.536674 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eb0180-d929-4d9e-9c5e-be455ba9c08e admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:57.537537 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4eb0180-d929-4d9e-9c5e-be455ba9c08e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:44:57.539166 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4eb0180-d929-4d9e-9c5e-be455ba9c08e admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:44:57.567092 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 870/1717] 10.222.0.102 () {58 vars in 1127 bytes} [Mon Aug 1 15:44:57 2022] GET /identity/v3/roles => generated 1427 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:44:57.568036 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4eb0180-d929-4d9e-9c5e-be455ba9c08e admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:44:57.569879 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-f4eb0180-d929-4d9e-9c5e-be455ba9c08e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:44:57.622401 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 848/1718] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:44:57 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:44:57.623152 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bb097a-cdfd-4e7d-b509-9a3c1aa38415 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:44:57.651010 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bb097a-cdfd-4e7d-b509-9a3c1aa38415 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:44:57.670775 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc8eddb-270f-4200-a243-6129e80c67c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:44:57.671797 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc8eddb-270f-4200-a243-6129e80c67c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:57.671908 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc8eddb-270f-4200-a243-6129e80c67c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:57.672182 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc8eddb-270f-4200-a243-6129e80c67c8 admin admin] PATH_INFO: `/v3/projects/acc440bde7984d96b57f2831cafef0b0/users/016b24e1a7774cebbd1b140240ed2f05/roles/de1374f966c04c27b579515b54334fd2` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:57.711235 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc8eddb-270f-4200-a243-6129e80c67c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=acc440bde7984d96b57f2831cafef0b0, user_id=016b24e1a7774cebbd1b140240ed2f05, role_id=de1374f966c04c27b579515b54334fd2)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:44:57.717021 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc8eddb-270f-4200-a243-6129e80c67c8 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:44:57.722717 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4eb0180-d929-4d9e-9c5e-be455ba9c08e admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:44:57.727860 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e185661a-8ae4-4ffb-acdc-68b2c6100791 tempest-VolumeQuotaClassesTest-1872046121 tempest-VolumeQuotaClassesTest-1872046121-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff48549512ca48b6aaa9315a54215a76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe50c6c1c7a4c028f9fe53582527b71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:44:57.729147 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e185661a-8ae4-4ffb-acdc-68b2c6100791 tempest-VolumeQuotaClassesTest-1872046121 tempest-VolumeQuotaClassesTest-1872046121-project-admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:57.729508 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e185661a-8ae4-4ffb-acdc-68b2c6100791 tempest-VolumeQuotaClassesTest-1872046121 tempest-VolumeQuotaClassesTest-1872046121-project-admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:57.729830 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e185661a-8ae4-4ffb-acdc-68b2c6100791 tempest-VolumeQuotaClassesTest-1872046121 tempest-VolumeQuotaClassesTest-1872046121-project-admin] PATH_INFO: `/v3/domains` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:57.730629 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e185661a-8ae4-4ffb-acdc-68b2c6100791 tempest-VolumeQuotaClassesTest-1872046121 tempest-VolumeQuotaClassesTest-1872046121-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:44:57.731006 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e185661a-8ae4-4ffb-acdc-68b2c6100791 tempest-VolumeQuotaClassesTest-1872046121 tempest-VolumeQuotaClassesTest-1872046121-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:44:57.732703 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e185661a-8ae4-4ffb-acdc-68b2c6100791 tempest-VolumeQuotaClassesTest-1872046121 tempest-VolumeQuotaClassesTest-1872046121-project-admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:44:57.749404 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 871/1719] 10.222.0.102 () {58 vars in 1158 bytes} [Mon Aug 1 15:44:57 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:44:57.751103 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbba5941-589d-40a7-b8f2-d4d3898ad203 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:57.752092 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbba5941-589d-40a7-b8f2-d4d3898ad203 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:57.752426 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbba5941-589d-40a7-b8f2-d4d3898ad203 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:57.822613 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 849/1720] 10.222.0.102 () {60 vars in 1488 bytes} [Mon Aug 1 15:44:57 2022] PUT /identity/v3/projects/acc440bde7984d96b57f2831cafef0b0/users/016b24e1a7774cebbd1b140240ed2f05/roles/de1374f966c04c27b579515b54334fd2 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:44:57.823553 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc8eddb-270f-4200-a243-6129e80c67c8 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:44:57.828676 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-cbba5941-589d-40a7-b8f2-d4d3898ad203 None None] MFA Rules not processed for user `d60a67da3f284a469d374b8f1d93ea45`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:44:57.831557 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-cbba5941-589d-40a7-b8f2-d4d3898ad203 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:44:57.965153 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 872/1721] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:44:57 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:44:57.966739 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbba5941-589d-40a7-b8f2-d4d3898ad203 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:44:58.052877 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc8eddb-270f-4200-a243-6129e80c67c8 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:44:58.066468 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370a95b0-156c-413e-81bf-0391901d9f49 tempest-VolumeQuotaClassesTest-1872046121 tempest-VolumeQuotaClassesTest-1872046121-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff48549512ca48b6aaa9315a54215a76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe50c6c1c7a4c028f9fe53582527b71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:44:58.067433 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370a95b0-156c-413e-81bf-0391901d9f49 tempest-VolumeQuotaClassesTest-1872046121 tempest-VolumeQuotaClassesTest-1872046121-project-admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:58.067600 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370a95b0-156c-413e-81bf-0391901d9f49 tempest-VolumeQuotaClassesTest-1872046121 tempest-VolumeQuotaClassesTest-1872046121-project-admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:58.067854 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370a95b0-156c-413e-81bf-0391901d9f49 tempest-VolumeQuotaClassesTest-1872046121 tempest-VolumeQuotaClassesTest-1872046121-project-admin] PATH_INFO: `/v3/projects` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:58.068529 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370a95b0-156c-413e-81bf-0391901d9f49 tempest-VolumeQuotaClassesTest-1872046121 tempest-VolumeQuotaClassesTest-1872046121-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:44:58.074863 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370a95b0-156c-413e-81bf-0391901d9f49 tempest-VolumeQuotaClassesTest-1872046121 tempest-VolumeQuotaClassesTest-1872046121-project-admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:44:58.167822 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbba5941-589d-40a7-b8f2-d4d3898ad203 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:44:58.181591 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9014ab3f-d63e-4142-aebb-7a6f467b2c97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:44:58.182165 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9014ab3f-d63e-4142-aebb-7a6f467b2c97 admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:58.182442 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9014ab3f-d63e-4142-aebb-7a6f467b2c97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:58.183094 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9014ab3f-d63e-4142-aebb-7a6f467b2c97 admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:58.183550 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9014ab3f-d63e-4142-aebb-7a6f467b2c97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:44:58.185205 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9014ab3f-d63e-4142-aebb-7a6f467b2c97 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:44:58.226658 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 873/1722] 10.222.0.102 () {58 vars in 1127 bytes} [Mon Aug 1 15:44:57 2022] GET /identity/v3/roles => generated 1427 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:44:58.228130 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0819ce-57fe-417d-89d3-e2e2c67bd004 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:58.228406 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0819ce-57fe-417d-89d3-e2e2c67bd004 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:58.228683 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0819ce-57fe-417d-89d3-e2e2c67bd004 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:58.264383 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 850/1723] 10.222.0.102 () {60 vars in 1158 bytes} [Mon Aug 1 15:44:57 2022] POST /identity/v3/projects => generated 356 bytes in 441 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:44:58.271452 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370a95b0-156c-413e-81bf-0391901d9f49 tempest-VolumeQuotaClassesTest-1872046121 tempest-VolumeQuotaClassesTest-1872046121-project-admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:44:58.294179 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-4d0819ce-57fe-417d-89d3-e2e2c67bd004 None None] MFA Rules not processed for user `cffa7f8cddca4a359a3174f800fb1039`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:44:58.303430 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-4d0819ce-57fe-417d-89d3-e2e2c67bd004 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:44:58.446613 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 874/1724] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:44:58 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:44:58.447968 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0819ce-57fe-417d-89d3-e2e2c67bd004 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:44:58.476925 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370a95b0-156c-413e-81bf-0391901d9f49 tempest-VolumeQuotaClassesTest-1872046121 tempest-VolumeQuotaClassesTest-1872046121-project-admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:44:58.483607 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c93b98-c604-4aab-a432-8c3834704fea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:44:58.484966 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c93b98-c604-4aab-a432-8c3834704fea admin admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:58.487039 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c93b98-c604-4aab-a432-8c3834704fea admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:58.487579 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c93b98-c604-4aab-a432-8c3834704fea admin admin] PATH_INFO: `/v3/projects/acc440bde7984d96b57f2831cafef0b0/users/016b24e1a7774cebbd1b140240ed2f05/roles/de1374f966c04c27b579515b54334fd2` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:58.490460 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c93b98-c604-4aab-a432-8c3834704fea admin admin] RBAC: Authorizing `identity:create_grant(project_id=acc440bde7984d96b57f2831cafef0b0, user_id=016b24e1a7774cebbd1b140240ed2f05, role_id=de1374f966c04c27b579515b54334fd2)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:44:58.495597 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c93b98-c604-4aab-a432-8c3834704fea admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:44:58.515713 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 851/1725] 10.222.0.102 () {60 vars in 1488 bytes} [Mon Aug 1 15:44:58 2022] PUT /identity/v3/projects/acc440bde7984d96b57f2831cafef0b0/users/016b24e1a7774cebbd1b140240ed2f05/roles/de1374f966c04c27b579515b54334fd2 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:44:58.517613 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c93b98-c604-4aab-a432-8c3834704fea admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:44:58.521658 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-c7c93b98-c604-4aab-a432-8c3834704fea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:44:58.559356 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0819ce-57fe-417d-89d3-e2e2c67bd004 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:44:58.604289 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:44:58.679647 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c93b98-c604-4aab-a432-8c3834704fea admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:44:58.690760 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71b04e5-e1bf-4fa2-bc28-22671dd2fa4f tempest-VolumeQuotaClassesTest-1872046121 tempest-VolumeQuotaClassesTest-1872046121-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff48549512ca48b6aaa9315a54215a76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe50c6c1c7a4c028f9fe53582527b71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:44:58.691338 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71b04e5-e1bf-4fa2-bc28-22671dd2fa4f tempest-VolumeQuotaClassesTest-1872046121 tempest-VolumeQuotaClassesTest-1872046121-project-admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:58.691616 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71b04e5-e1bf-4fa2-bc28-22671dd2fa4f tempest-VolumeQuotaClassesTest-1872046121 tempest-VolumeQuotaClassesTest-1872046121-project-admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:58.691903 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71b04e5-e1bf-4fa2-bc28-22671dd2fa4f tempest-VolumeQuotaClassesTest-1872046121 tempest-VolumeQuotaClassesTest-1872046121-project-admin] PATH_INFO: `/v3/domains` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:58.692602 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71b04e5-e1bf-4fa2-bc28-22671dd2fa4f tempest-VolumeQuotaClassesTest-1872046121 tempest-VolumeQuotaClassesTest-1872046121-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:44:58.693214 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71b04e5-e1bf-4fa2-bc28-22671dd2fa4f tempest-VolumeQuotaClassesTest-1872046121 tempest-VolumeQuotaClassesTest-1872046121-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:44:58.695073 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f898a6-2f7a-4eba-a448-09da3fc96001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:44:58.695974 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f898a6-2f7a-4eba-a448-09da3fc96001 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:58.706241 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f898a6-2f7a-4eba-a448-09da3fc96001 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:58.706241 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f898a6-2f7a-4eba-a448-09da3fc96001 admin admin] PATH_INFO: `/v3/projects/a2e80e0285d24fd2adb0371b8b777de0` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:58.706241 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f898a6-2f7a-4eba-a448-09da3fc96001 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2e80e0285d24fd2adb0371b8b777de0)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:44:58.706241 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f898a6-2f7a-4eba-a448-09da3fc96001 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:44:58.720285 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71b04e5-e1bf-4fa2-bc28-22671dd2fa4f tempest-VolumeQuotaClassesTest-1872046121 tempest-VolumeQuotaClassesTest-1872046121-project-admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:44:58.754582 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 875/1726] 10.222.0.102 () {58 vars in 1158 bytes} [Mon Aug 1 15:44:58 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:44:58.754582 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71b04e5-e1bf-4fa2-bc28-22671dd2fa4f tempest-VolumeQuotaClassesTest-1872046121 tempest-VolumeQuotaClassesTest-1872046121-project-admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:44:58.759007 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-a71b04e5-e1bf-4fa2-bc28-22671dd2fa4f tempest-VolumeQuotaClassesTest-1872046121 tempest-VolumeQuotaClassesTest-1872046121-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:44:58.995710 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71b04e5-e1bf-4fa2-bc28-22671dd2fa4f tempest-VolumeQuotaClassesTest-1872046121 tempest-VolumeQuotaClassesTest-1872046121-project-admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:44:58.996001 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-f1f898a6-2f7a-4eba-a448-09da3fc96001 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2e80e0285d24fd2adb0371b8b777de0', 'request_id': 'req-f1f898a6-2f7a-4eba-a448-09da3fc96001'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:44:59.073174 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:44:59.099444 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73becd01-964a-4097-89c3-d5f4dde26e3c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77b43f1ee8cc4be3907a494abe90c1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:44:59.103758 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73becd01-964a-4097-89c3-d5f4dde26e3c service nova] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:59.104517 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73becd01-964a-4097-89c3-d5f4dde26e3c service nova] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:59.105449 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73becd01-964a-4097-89c3-d5f4dde26e3c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:59.133440 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-f1f898a6-2f7a-4eba-a448-09da3fc96001 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2e80e0285d24fd2adb0371b8b777de0', 'request_id': 'req-f1f898a6-2f7a-4eba-a448-09da3fc96001'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:44:59.143395 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-f1f898a6-2f7a-4eba-a448-09da3fc96001 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2e80e0285d24fd2adb0371b8b777de0', 'request_id': 'req-f1f898a6-2f7a-4eba-a448-09da3fc96001'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:44:59.167154 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-f1f898a6-2f7a-4eba-a448-09da3fc96001 admin admin] The token cache is being invalidate because project a2e80e0285d24fd2adb0371b8b777de0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80353) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 15:44:59.167801 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-f1f898a6-2f7a-4eba-a448-09da3fc96001 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:44:59.169662 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-f1f898a6-2f7a-4eba-a448-09da3fc96001 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:44:59.179704 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 852/1727] 10.222.0.102 () {58 vars in 1238 bytes} [Mon Aug 1 15:44:58 2022] DELETE /identity/v3/projects/a2e80e0285d24fd2adb0371b8b777de0 => generated 0 bytes in 659 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:44:59.181055 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41a7f1e-a29e-4090-b2a0-f4b495fa6438 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:59.181552 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41a7f1e-a29e-4090-b2a0-f4b495fa6438 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:59.182030 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41a7f1e-a29e-4090-b2a0-f4b495fa6438 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:59.194457 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73becd01-964a-4097-89c3-d5f4dde26e3c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:44:59.201121 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73becd01-964a-4097-89c3-d5f4dde26e3c service nova] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:44:59.225140 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-e41a7f1e-a29e-4090-b2a0-f4b495fa6438 None None] MFA Rules not processed for user `cffa7f8cddca4a359a3174f800fb1039`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:44:59.227100 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 876/1728] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:44:58 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 474 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:44:59.228722 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cc5a14-af09-4c87-a8c0-4e1d49a4eef6 None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:59.228973 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cc5a14-af09-4c87-a8c0-4e1d49a4eef6 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:59.229252 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cc5a14-af09-4c87-a8c0-4e1d49a4eef6 None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:59.230942 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 877/1729] 10.222.0.102 () {54 vars in 917 bytes} [Mon Aug 1 15:44:59 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 15:44:59.232020 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8047bb3-ec0d-403d-a64b-30e6599c0079 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:59.232297 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8047bb3-ec0d-403d-a64b-30e6599c0079 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:59.232747 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8047bb3-ec0d-403d-a64b-30e6599c0079 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:59.246374 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-e41a7f1e-a29e-4090-b2a0-f4b495fa6438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:44:59.333328 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-d8047bb3-ec0d-403d-a64b-30e6599c0079 None None] MFA Rules not processed for user `016b24e1a7774cebbd1b140240ed2f05`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:44:59.334586 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-d8047bb3-ec0d-403d-a64b-30e6599c0079 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:44:59.381876 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 853/1730] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:44:59 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:44:59.383700 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c53b97-1f66-49f1-9661-e792c82c56ed None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:59.384140 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c53b97-1f66-49f1-9661-e792c82c56ed None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:59.384556 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c53b97-1f66-49f1-9661-e792c82c56ed None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:59.390229 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 854/1731] 10.222.0.102 () {54 vars in 966 bytes} [Mon Aug 1 15:44:59 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 15:44:59.390229 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c53b97-1f66-49f1-9661-e792c82c56ed None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:44:59.390229 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-d8c53b97-1f66-49f1-9661-e792c82c56ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:44:59.453309 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 878/1732] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:44:59 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:44:59.455573 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c8fe5e-9927-4f15-bc1d-480b35e47401 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:59.456489 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c8fe5e-9927-4f15-bc1d-480b35e47401 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:59.456489 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c8fe5e-9927-4f15-bc1d-480b35e47401 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:59.483022 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-54c8fe5e-9927-4f15-bc1d-480b35e47401 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:44:59.484939 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-54c8fe5e-9927-4f15-bc1d-480b35e47401 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:44:59.513265 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c53b97-1f66-49f1-9661-e792c82c56ed None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:44:59.526021 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad280d91-23c7-4d87-8a4a-62264e3403f4 tempest-VolumeQuotaClassesTest-1872046121 tempest-VolumeQuotaClassesTest-1872046121-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff48549512ca48b6aaa9315a54215a76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe50c6c1c7a4c028f9fe53582527b71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:44:59.527683 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad280d91-23c7-4d87-8a4a-62264e3403f4 tempest-VolumeQuotaClassesTest-1872046121 tempest-VolumeQuotaClassesTest-1872046121-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:59.527683 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad280d91-23c7-4d87-8a4a-62264e3403f4 tempest-VolumeQuotaClassesTest-1872046121 tempest-VolumeQuotaClassesTest-1872046121-project-admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:59.527683 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad280d91-23c7-4d87-8a4a-62264e3403f4 tempest-VolumeQuotaClassesTest-1872046121 tempest-VolumeQuotaClassesTest-1872046121-project-admin] PATH_INFO: `/v3/projects/d2100615ec984b61b33e1668703d4abe` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:59.529080 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad280d91-23c7-4d87-8a4a-62264e3403f4 tempest-VolumeQuotaClassesTest-1872046121 tempest-VolumeQuotaClassesTest-1872046121-project-admin] RBAC: Authorizing `identity:delete_project(project_id=d2100615ec984b61b33e1668703d4abe)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:44:59.531378 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad280d91-23c7-4d87-8a4a-62264e3403f4 tempest-VolumeQuotaClassesTest-1872046121 tempest-VolumeQuotaClassesTest-1872046121-project-admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:44:59.675594 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 879/1733] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:44:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:44:59.675594 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8e473a-8ffa-463f-abeb-9d18ac7bee36 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:59.675594 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8e473a-8ffa-463f-abeb-9d18ac7bee36 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:59.675594 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8e473a-8ffa-463f-abeb-9d18ac7bee36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:59.702798 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-ed8e473a-8ffa-463f-abeb-9d18ac7bee36 None None] MFA Rules not processed for user `a856a413100443939fe9b10daa868518`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:44:59.705172 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-ed8e473a-8ffa-463f-abeb-9d18ac7bee36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:44:59.746245 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-ad280d91-23c7-4d87-8a4a-62264e3403f4 tempest-VolumeQuotaClassesTest-1872046121 tempest-VolumeQuotaClassesTest-1872046121-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2100615ec984b61b33e1668703d4abe', 'request_id': 'req-ad280d91-23c7-4d87-8a4a-62264e3403f4'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:44:59.780937 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 880/1734] 10.222.0.102 () {58 vars in 1014 bytes} [Mon Aug 1 15:44:59 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:44:59.783217 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2235e0-62aa-49d4-a69f-36cbf3f93336 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:59.783503 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2235e0-62aa-49d4-a69f-36cbf3f93336 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:59.783775 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2235e0-62aa-49d4-a69f-36cbf3f93336 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:44:59.832582 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-3c2235e0-62aa-49d4-a69f-36cbf3f93336 None None] MFA Rules not processed for user `b78f5749fe9c46a389c88bb9c222cc73`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:44:59.834388 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-3c2235e0-62aa-49d4-a69f-36cbf3f93336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:44:59.895685 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-ad280d91-23c7-4d87-8a4a-62264e3403f4 tempest-VolumeQuotaClassesTest-1872046121 tempest-VolumeQuotaClassesTest-1872046121-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2100615ec984b61b33e1668703d4abe', 'request_id': 'req-ad280d91-23c7-4d87-8a4a-62264e3403f4'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:44:59.903797 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-ad280d91-23c7-4d87-8a4a-62264e3403f4 tempest-VolumeQuotaClassesTest-1872046121 tempest-VolumeQuotaClassesTest-1872046121-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2100615ec984b61b33e1668703d4abe', 'request_id': 'req-ad280d91-23c7-4d87-8a4a-62264e3403f4'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:44:59.919852 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-ad280d91-23c7-4d87-8a4a-62264e3403f4 tempest-VolumeQuotaClassesTest-1872046121 tempest-VolumeQuotaClassesTest-1872046121-project-admin] The token cache is being invalidate because project d2100615ec984b61b33e1668703d4abe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80353) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 15:44:59.920215 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-ad280d91-23c7-4d87-8a4a-62264e3403f4 tempest-VolumeQuotaClassesTest-1872046121 tempest-VolumeQuotaClassesTest-1872046121-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:44:59.921044 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-ad280d91-23c7-4d87-8a4a-62264e3403f4 tempest-VolumeQuotaClassesTest-1872046121 tempest-VolumeQuotaClassesTest-1872046121-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:44:59.929322 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 855/1735] 10.222.0.102 () {58 vars in 1238 bytes} [Mon Aug 1 15:44:59 2022] DELETE /identity/v3/projects/d2100615ec984b61b33e1668703d4abe => generated 0 bytes in 539 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:44:59.929322 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad280d91-23c7-4d87-8a4a-62264e3403f4 tempest-VolumeQuotaClassesTest-1872046121 tempest-VolumeQuotaClassesTest-1872046121-project-admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:44:59.930826 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-ad280d91-23c7-4d87-8a4a-62264e3403f4 tempest-VolumeQuotaClassesTest-1872046121 tempest-VolumeQuotaClassesTest-1872046121-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:44:59.949960 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 881/1736] 10.222.0.102 () {58 vars in 1063 bytes} [Mon Aug 1 15:44:59 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:44:59.951292 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a14f0b-7f80-425b-9671-ff7e32bdf3f3 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:44:59.951873 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a14f0b-7f80-425b-9671-ff7e32bdf3f3 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:44:59.952171 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a14f0b-7f80-425b-9671-ff7e32bdf3f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:00.001780 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-b1a14f0b-7f80-425b-9671-ff7e32bdf3f3 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:45:00.004900 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-b1a14f0b-7f80-425b-9671-ff7e32bdf3f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:45:00.064423 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad280d91-23c7-4d87-8a4a-62264e3403f4 tempest-VolumeQuotaClassesTest-1872046121 tempest-VolumeQuotaClassesTest-1872046121-project-admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:45:00.068594 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d29a5d-1d26-45b2-b7c0-504fb3156eec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff810b37183c4729859c1b05edff1703', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:45:00.071558 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d29a5d-1d26-45b2-b7c0-504fb3156eec service cinder] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:00.071832 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d29a5d-1d26-45b2-b7c0-504fb3156eec service cinder] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:00.072102 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d29a5d-1d26-45b2-b7c0-504fb3156eec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:00.078690 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-a1d29a5d-1d26-45b2-b7c0-504fb3156eec service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:45:00.121919 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 882/1737] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:44:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:45:00.122818 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a14f0b-7f80-425b-9671-ff7e32bdf3f3 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:45:00.124827 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-b1a14f0b-7f80-425b-9671-ff7e32bdf3f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:45:00.189909 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d29a5d-1d26-45b2-b7c0-504fb3156eec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:45:00.191957 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d29a5d-1d26-45b2-b7c0-504fb3156eec service cinder] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:45:00.203508 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 856/1738] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:44:59 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:45:00.205465 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375a6ab5-8fe8-4667-b3c4-9c4c1bfa679d None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:00.205986 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375a6ab5-8fe8-4667-b3c4-9c4c1bfa679d None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:00.206488 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375a6ab5-8fe8-4667-b3c4-9c4c1bfa679d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:00.228036 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-375a6ab5-8fe8-4667-b3c4-9c4c1bfa679d None None] MFA Rules not processed for user `82ab36c0e0804e4d8aaff377095aade7`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:45:00.229375 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-375a6ab5-8fe8-4667-b3c4-9c4c1bfa679d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:45:00.241688 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a14f0b-7f80-425b-9671-ff7e32bdf3f3 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:45:00.251346 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067797a4-5d47-427d-851a-a76dc7bd4529 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77b43f1ee8cc4be3907a494abe90c1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:45:00.252390 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067797a4-5d47-427d-851a-a76dc7bd4529 service nova] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:00.253592 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067797a4-5d47-427d-851a-a76dc7bd4529 service nova] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:00.255211 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067797a4-5d47-427d-851a-a76dc7bd4529 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:00.257935 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-067797a4-5d47-427d-851a-a76dc7bd4529 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:45:00.302195 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 857/1739] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:45:00 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:45:00.309659 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375a6ab5-8fe8-4667-b3c4-9c4c1bfa679d None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:45:00.309659 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-375a6ab5-8fe8-4667-b3c4-9c4c1bfa679d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:45:00.359803 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067797a4-5d47-427d-851a-a76dc7bd4529 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:45:00.362550 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067797a4-5d47-427d-851a-a76dc7bd4529 service nova] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:45:00.382474 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 883/1740] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:45:00 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:45:00.399222 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067797a4-5d47-427d-851a-a76dc7bd4529 service nova] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:45:00.436095 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067797a4-5d47-427d-851a-a76dc7bd4529 service nova] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:45:00.446292 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375a6ab5-8fe8-4667-b3c4-9c4c1bfa679d None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:45:00.448004 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e37eff-f448-445c-a812-e27b1c91ea10 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a856a413100443939fe9b10daa868518', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:45:00.448816 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e37eff-f448-445c-a812-e27b1c91ea10 service neutron] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:00.449371 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e37eff-f448-445c-a812-e27b1c91ea10 service neutron] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:00.449829 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e37eff-f448-445c-a812-e27b1c91ea10 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:00.450647 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5122d741-c12a-4619-acf0-b67e8b258ee0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b78f5749fe9c46a389c88bb9c222cc73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:45:00.451787 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5122d741-c12a-4619-acf0-b67e8b258ee0 service placement] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:00.452137 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5122d741-c12a-4619-acf0-b67e8b258ee0 service placement] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:00.452433 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-e9e37eff-f448-445c-a812-e27b1c91ea10 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:45:00.452530 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5122d741-c12a-4619-acf0-b67e8b258ee0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:00.459153 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-5122d741-c12a-4619-acf0-b67e8b258ee0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:45:00.466878 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e37eff-f448-445c-a812-e27b1c91ea10 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:45:00.468695 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e37eff-f448-445c-a812-e27b1c91ea10 service neutron] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:45:00.481446 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 858/1741] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:45:00 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:45:00.482307 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e37eff-f448-445c-a812-e27b1c91ea10 service neutron] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:45:00.502109 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5122d741-c12a-4619-acf0-b67e8b258ee0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:45:00.502334 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e37eff-f448-445c-a812-e27b1c91ea10 service neutron] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:45:00.504216 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5122d741-c12a-4619-acf0-b67e8b258ee0 service placement] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:45:00.509640 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed136f10-8698-48ec-ac33-d78f00343d9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:45:00.520145 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed136f10-8698-48ec-ac33-d78f00343d9a admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:00.520145 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed136f10-8698-48ec-ac33-d78f00343d9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:00.520145 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed136f10-8698-48ec-ac33-d78f00343d9a admin admin] PATH_INFO: `/v3/domains` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:00.520145 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed136f10-8698-48ec-ac33-d78f00343d9a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:45:00.520145 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed136f10-8698-48ec-ac33-d78f00343d9a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:45:00.520145 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed136f10-8698-48ec-ac33-d78f00343d9a admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:45:00.524198 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 884/1742] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:45:00 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:45:00.524758 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5122d741-c12a-4619-acf0-b67e8b258ee0 service placement] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:45:00.526191 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-5122d741-c12a-4619-acf0-b67e8b258ee0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:45:00.537332 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 859/1743] 10.222.0.102 () {58 vars in 1158 bytes} [Mon Aug 1 15:45:00 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:45:00.541615 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed136f10-8698-48ec-ac33-d78f00343d9a admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:45:00.556687 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5122d741-c12a-4619-acf0-b67e8b258ee0 service placement] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:45:00.565345 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed136f10-8698-48ec-ac33-d78f00343d9a admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:45:00.567113 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ae1651-5185-40c3-bf14-d18486ebccae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:45:00.567846 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ae1651-5185-40c3-bf14-d18486ebccae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:00.568193 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ae1651-5185-40c3-bf14-d18486ebccae admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:00.568537 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ae1651-5185-40c3-bf14-d18486ebccae admin admin] PATH_INFO: `/v3/users/2687a4c0f03a4144aef7dc72feffd981` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:00.574679 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ae1651-5185-40c3-bf14-d18486ebccae admin admin] RBAC: Authorizing `identity:delete_user(user_id=2687a4c0f03a4144aef7dc72feffd981)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:45:00.577098 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ae1651-5185-40c3-bf14-d18486ebccae admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:45:00.579767 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3c99d2-a116-44a1-97e2-791261186a77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:45:00.589807 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3c99d2-a116-44a1-97e2-791261186a77 admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:00.589807 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3c99d2-a116-44a1-97e2-791261186a77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:00.589807 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3c99d2-a116-44a1-97e2-791261186a77 admin admin] PATH_INFO: `/v3/projects` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:00.589807 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3c99d2-a116-44a1-97e2-791261186a77 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:45:00.594090 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3c99d2-a116-44a1-97e2-791261186a77 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:45:00.791019 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 860/1744] 10.222.0.102 () {60 vars in 1158 bytes} [Mon Aug 1 15:45:00 2022] POST /identity/v3/projects => generated 382 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:45:00.791969 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3c99d2-a116-44a1-97e2-791261186a77 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:45:00.908207 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3c99d2-a116-44a1-97e2-791261186a77 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:45:00.920825 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dc670b-1ada-4dab-accc-fc9124740d14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:45:00.922413 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dc670b-1ada-4dab-accc-fc9124740d14 admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:00.922694 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dc670b-1ada-4dab-accc-fc9124740d14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:00.924608 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dc670b-1ada-4dab-accc-fc9124740d14 admin admin] PATH_INFO: `/v3/users` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:00.926698 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dc670b-1ada-4dab-accc-fc9124740d14 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:45:00.930375 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-e6ae1651-5185-40c3-bf14-d18486ebccae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2687a4c0f03a4144aef7dc72feffd981'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:45:00.935610 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dc670b-1ada-4dab-accc-fc9124740d14 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:45:00.968516 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-e6ae1651-5185-40c3-bf14-d18486ebccae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2687a4c0f03a4144aef7dc72feffd981'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:45:00.991249 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-e6ae1651-5185-40c3-bf14-d18486ebccae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2687a4c0f03a4144aef7dc72feffd981'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:45:00.993316 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-e6ae1651-5185-40c3-bf14-d18486ebccae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2687a4c0f03a4144aef7dc72feffd981'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:45:00.994204 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-e6ae1651-5185-40c3-bf14-d18486ebccae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2687a4c0f03a4144aef7dc72feffd981'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:45:01.072464 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 885/1745] 10.222.0.102 () {58 vars in 1229 bytes} [Mon Aug 1 15:45:00 2022] DELETE /identity/v3/users/2687a4c0f03a4144aef7dc72feffd981 => generated 0 bytes in 548 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:45:01.073920 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ae1651-5185-40c3-bf14-d18486ebccae admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:45:01.077361 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-e6ae1651-5185-40c3-bf14-d18486ebccae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:45:01.086951 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 861/1746] 10.222.0.102 () {60 vars in 1149 bytes} [Mon Aug 1 15:45:00 2022] POST /identity/v3/users => generated 292 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:45:01.088548 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c072148-a62f-4e2d-8a3f-85dd02ab8cd4 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:01.088947 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c072148-a62f-4e2d-8a3f-85dd02ab8cd4 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:01.089456 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c072148-a62f-4e2d-8a3f-85dd02ab8cd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:01.134336 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-1c072148-a62f-4e2d-8a3f-85dd02ab8cd4 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:45:01.136234 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-1c072148-a62f-4e2d-8a3f-85dd02ab8cd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:45:01.141075 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:45:01.227877 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 862/1747] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:45:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:45:01.228546 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c072148-a62f-4e2d-8a3f-85dd02ab8cd4 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:45:01.230581 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-1c072148-a62f-4e2d-8a3f-85dd02ab8cd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:45:01.244624 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ae1651-5185-40c3-bf14-d18486ebccae admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:45:01.250038 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a1d601-74c5-4c36-bf8d-6f63f9f27b11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:45:01.251038 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a1d601-74c5-4c36-bf8d-6f63f9f27b11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:01.252176 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a1d601-74c5-4c36-bf8d-6f63f9f27b11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:01.252679 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a1d601-74c5-4c36-bf8d-6f63f9f27b11 admin admin] PATH_INFO: `/v3/users/94477bca84684c26884e6d3d05658d9a` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:01.254350 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c072148-a62f-4e2d-8a3f-85dd02ab8cd4 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:45:01.254832 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a1d601-74c5-4c36-bf8d-6f63f9f27b11 admin admin] RBAC: Authorizing `identity:delete_user(user_id=94477bca84684c26884e6d3d05658d9a)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:45:01.257358 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a1d601-74c5-4c36-bf8d-6f63f9f27b11 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:45:01.262219 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cb057f-fd6a-4e97-9058-4d3a28090dc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:45:01.262915 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cb057f-fd6a-4e97-9058-4d3a28090dc5 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:01.263197 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cb057f-fd6a-4e97-9058-4d3a28090dc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:01.263517 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cb057f-fd6a-4e97-9058-4d3a28090dc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:01.264431 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cb057f-fd6a-4e97-9058-4d3a28090dc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:45:01.268222 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cb057f-fd6a-4e97-9058-4d3a28090dc5 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:45:01.287385 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 863/1748] 10.222.0.102 () {58 vars in 1127 bytes} [Mon Aug 1 15:45:01 2022] GET /identity/v3/roles => generated 1427 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:45:01.287385 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cb057f-fd6a-4e97-9058-4d3a28090dc5 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:45:01.289739 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-c0cb057f-fd6a-4e97-9058-4d3a28090dc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:45:01.397651 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cb057f-fd6a-4e97-9058-4d3a28090dc5 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:45:01.401357 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8a5387-865c-4623-aee2-5fec596f535c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a856a413100443939fe9b10daa868518', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:45:01.401968 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8a5387-865c-4623-aee2-5fec596f535c service neutron] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:01.402359 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8a5387-865c-4623-aee2-5fec596f535c service neutron] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:01.402632 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8a5387-865c-4623-aee2-5fec596f535c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:01.421239 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8a5387-865c-4623-aee2-5fec596f535c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:45:01.422799 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8a5387-865c-4623-aee2-5fec596f535c service neutron] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:45:01.441741 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 864/1749] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:45:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:45:01.443579 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8a5387-865c-4623-aee2-5fec596f535c service neutron] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:45:01.490307 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-99a1d601-74c5-4c36-bf8d-6f63f9f27b11 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94477bca84684c26884e6d3d05658d9a'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:45:01.508951 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8a5387-865c-4623-aee2-5fec596f535c service neutron] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:45:01.539129 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11030770-62d6-42d1-9493-8d8afe3ab34b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:45:01.540974 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11030770-62d6-42d1-9493-8d8afe3ab34b admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:01.542056 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11030770-62d6-42d1-9493-8d8afe3ab34b admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:01.542230 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11030770-62d6-42d1-9493-8d8afe3ab34b admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:01.545886 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11030770-62d6-42d1-9493-8d8afe3ab34b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:45:01.554720 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11030770-62d6-42d1-9493-8d8afe3ab34b admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:45:01.574621 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-99a1d601-74c5-4c36-bf8d-6f63f9f27b11 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94477bca84684c26884e6d3d05658d9a'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:45:01.575335 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:45:01.633561 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 865/1750] 10.222.0.102 () {58 vars in 1127 bytes} [Mon Aug 1 15:45:01 2022] GET /identity/v3/roles => generated 1427 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:45:01.636344 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11030770-62d6-42d1-9493-8d8afe3ab34b admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:45:01.646016 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-99a1d601-74c5-4c36-bf8d-6f63f9f27b11 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94477bca84684c26884e6d3d05658d9a'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:45:01.650373 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-99a1d601-74c5-4c36-bf8d-6f63f9f27b11 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94477bca84684c26884e6d3d05658d9a'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:45:01.651700 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-99a1d601-74c5-4c36-bf8d-6f63f9f27b11 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94477bca84684c26884e6d3d05658d9a'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:45:01.661685 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11030770-62d6-42d1-9493-8d8afe3ab34b admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:45:01.693371 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7451ccea-341f-465e-8d55-55cefc1d1bce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:45:01.694090 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7451ccea-341f-465e-8d55-55cefc1d1bce admin admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:01.694377 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7451ccea-341f-465e-8d55-55cefc1d1bce admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:01.700354 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7451ccea-341f-465e-8d55-55cefc1d1bce admin admin] PATH_INFO: `/v3/projects/059bac2dc3d541859196e165b3fd36e4/users/ae3dcda8c8cd48029a1a4286aa8ec5cd/roles/27f5093ac0674d799cdbd17c68482e32` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:01.817705 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 886/1751] 10.222.0.102 () {58 vars in 1229 bytes} [Mon Aug 1 15:45:01 2022] DELETE /identity/v3/users/94477bca84684c26884e6d3d05658d9a => generated 0 bytes in 739 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:45:01.823427 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f5a60d-37d8-4552-b22f-5902fc3ec77b None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:01.826835 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f5a60d-37d8-4552-b22f-5902fc3ec77b None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:01.827142 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f5a60d-37d8-4552-b22f-5902fc3ec77b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:01.836074 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7451ccea-341f-465e-8d55-55cefc1d1bce admin admin] RBAC: Authorizing `identity:create_grant(project_id=059bac2dc3d541859196e165b3fd36e4, user_id=ae3dcda8c8cd48029a1a4286aa8ec5cd, role_id=27f5093ac0674d799cdbd17c68482e32)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:45:01.838859 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7451ccea-341f-465e-8d55-55cefc1d1bce admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:45:01.948289 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-40f5a60d-37d8-4552-b22f-5902fc3ec77b None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:45:01.962323 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-40f5a60d-37d8-4552-b22f-5902fc3ec77b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:45:01.993988 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 866/1752] 10.222.0.102 () {60 vars in 1488 bytes} [Mon Aug 1 15:45:01 2022] PUT /identity/v3/projects/059bac2dc3d541859196e165b3fd36e4/users/ae3dcda8c8cd48029a1a4286aa8ec5cd/roles/27f5093ac0674d799cdbd17c68482e32 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 15:45:02.016183 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379b7e3f-b008-499d-884c-46a74efb5730 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:02.016183 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379b7e3f-b008-499d-884c-46a74efb5730 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:02.018904 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379b7e3f-b008-499d-884c-46a74efb5730 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:02.100693 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=93,keystone:INSERT=1,keystone:DELETE=6 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:45:02.148518 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-379b7e3f-b008-499d-884c-46a74efb5730 None None] MFA Rules not processed for user `ae3dcda8c8cd48029a1a4286aa8ec5cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:45:02.150780 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-379b7e3f-b008-499d-884c-46a74efb5730 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:45:02.323732 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 887/1753] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:45:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 507 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:45:02.389421 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 867/1754] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:45:02 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 379 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:45:02.393188 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f5a60d-37d8-4552-b22f-5902fc3ec77b None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:45:02.394663 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-40f5a60d-37d8-4552-b22f-5902fc3ec77b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:45:02.415893 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f5a60d-37d8-4552-b22f-5902fc3ec77b None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:45:02.452082 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379b7e3f-b008-499d-884c-46a74efb5730 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:45:02.459415 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-379b7e3f-b008-499d-884c-46a74efb5730 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:45:02.606350 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c9f866-c8dd-466c-8ec1-3c9037e29224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:45:02.611626 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c9f866-c8dd-466c-8ec1-3c9037e29224 admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:02.613227 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c9f866-c8dd-466c-8ec1-3c9037e29224 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:02.613562 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c9f866-c8dd-466c-8ec1-3c9037e29224 admin admin] PATH_INFO: `/v3/projects` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:02.614553 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c9f866-c8dd-466c-8ec1-3c9037e29224 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:45:02.620927 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c9f866-c8dd-466c-8ec1-3c9037e29224 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:45:02.651477 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379b7e3f-b008-499d-884c-46a74efb5730 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:45:02.662603 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89248cf-3bc6-426b-9e5f-44a848d5f8a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a856a413100443939fe9b10daa868518', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:45:02.663506 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89248cf-3bc6-426b-9e5f-44a848d5f8a6 service neutron] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:02.663847 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89248cf-3bc6-426b-9e5f-44a848d5f8a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:02.664608 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89248cf-3bc6-426b-9e5f-44a848d5f8a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:02.686680 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89248cf-3bc6-426b-9e5f-44a848d5f8a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:45:02.689136 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89248cf-3bc6-426b-9e5f-44a848d5f8a6 service neutron] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:45:02.743141 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 868/1755] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:45:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:45:02.766267 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 888/1756] 10.222.0.102 () {60 vars in 1158 bytes} [Mon Aug 1 15:45:02 2022] POST /identity/v3/projects => generated 380 bytes in 374 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:45:02.771001 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89248cf-3bc6-426b-9e5f-44a848d5f8a6 service neutron] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:45:02.787741 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89248cf-3bc6-426b-9e5f-44a848d5f8a6 service neutron] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:45:02.946091 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778a61c5-5854-43d9-b66f-d6de9d3d50ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:45:02.946884 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778a61c5-5854-43d9-b66f-d6de9d3d50ea admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:02.947246 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778a61c5-5854-43d9-b66f-d6de9d3d50ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:02.947818 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778a61c5-5854-43d9-b66f-d6de9d3d50ea admin admin] PATH_INFO: `/v3/users` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:02.948719 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778a61c5-5854-43d9-b66f-d6de9d3d50ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:45:02.951966 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778a61c5-5854-43d9-b66f-d6de9d3d50ea admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:45:03.156532 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c9f866-c8dd-466c-8ec1-3c9037e29224 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:45:03.159866 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-51c9f866-c8dd-466c-8ec1-3c9037e29224 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:45:03.162927 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 869/1757] 10.222.0.102 () {60 vars in 1149 bytes} [Mon Aug 1 15:45:02 2022] POST /identity/v3/users => generated 297 bytes in 392 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:45:03.167368 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778a61c5-5854-43d9-b66f-d6de9d3d50ea admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:45:03.179601 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c9f866-c8dd-466c-8ec1-3c9037e29224 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:45:03.185769 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2348e1f2-3f95-425f-af71-81dc86ba015f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:45:03.186882 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2348e1f2-3f95-425f-af71-81dc86ba015f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:03.187354 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2348e1f2-3f95-425f-af71-81dc86ba015f admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:03.187817 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2348e1f2-3f95-425f-af71-81dc86ba015f admin admin] PATH_INFO: `/v3/projects/6cfcfdebbd1b43fdac2e5e2cf1ed018d` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:03.190128 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2348e1f2-3f95-425f-af71-81dc86ba015f admin admin] RBAC: Authorizing `identity:delete_project(project_id=6cfcfdebbd1b43fdac2e5e2cf1ed018d)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:45:03.192689 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2348e1f2-3f95-425f-af71-81dc86ba015f admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:45:03.197280 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:45:03.205920 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778a61c5-5854-43d9-b66f-d6de9d3d50ea admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:45:03.215140 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89e2f5e-fa0b-4a19-b41c-af88777e08ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:45:03.215863 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89e2f5e-fa0b-4a19-b41c-af88777e08ce admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:03.216212 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89e2f5e-fa0b-4a19-b41c-af88777e08ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:03.217016 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89e2f5e-fa0b-4a19-b41c-af88777e08ce admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:03.218207 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89e2f5e-fa0b-4a19-b41c-af88777e08ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:45:03.221895 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89e2f5e-fa0b-4a19-b41c-af88777e08ce admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:45:03.258124 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 870/1758] 10.222.0.102 () {58 vars in 1127 bytes} [Mon Aug 1 15:45:03 2022] GET /identity/v3/roles => generated 1427 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:45:03.259844 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89e2f5e-fa0b-4a19-b41c-af88777e08ce admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:45:03.286962 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89e2f5e-fa0b-4a19-b41c-af88777e08ce admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:45:03.304374 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1496e5ea-4d1d-4794-b424-d472e987c82f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:45:03.304712 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1496e5ea-4d1d-4794-b424-d472e987c82f admin admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:03.305492 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1496e5ea-4d1d-4794-b424-d472e987c82f admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:03.306231 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1496e5ea-4d1d-4794-b424-d472e987c82f admin admin] PATH_INFO: `/v3/projects/d50e61c618974f5b84c0d33495f63e05/users/4043273ee0bc429fa61ce10e0d3a579c/roles/de1374f966c04c27b579515b54334fd2` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:03.332934 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-2348e1f2-3f95-425f-af71-81dc86ba015f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6cfcfdebbd1b43fdac2e5e2cf1ed018d', 'request_id': 'req-2348e1f2-3f95-425f-af71-81dc86ba015f'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:45:03.338318 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1496e5ea-4d1d-4794-b424-d472e987c82f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d50e61c618974f5b84c0d33495f63e05, user_id=4043273ee0bc429fa61ce10e0d3a579c, role_id=de1374f966c04c27b579515b54334fd2)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:45:03.343305 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-2348e1f2-3f95-425f-af71-81dc86ba015f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6cfcfdebbd1b43fdac2e5e2cf1ed018d', 'request_id': 'req-2348e1f2-3f95-425f-af71-81dc86ba015f'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:45:03.347603 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1496e5ea-4d1d-4794-b424-d472e987c82f admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:45:03.410341 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-2348e1f2-3f95-425f-af71-81dc86ba015f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6cfcfdebbd1b43fdac2e5e2cf1ed018d', 'request_id': 'req-2348e1f2-3f95-425f-af71-81dc86ba015f'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:45:03.436627 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-2348e1f2-3f95-425f-af71-81dc86ba015f admin admin] The token cache is being invalidate because project 6cfcfdebbd1b43fdac2e5e2cf1ed018d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80352) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 15:45:03.437340 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-2348e1f2-3f95-425f-af71-81dc86ba015f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:45:03.440276 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-2348e1f2-3f95-425f-af71-81dc86ba015f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:45:03.445329 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 889/1759] 10.222.0.102 () {58 vars in 1238 bytes} [Mon Aug 1 15:45:03 2022] DELETE /identity/v3/projects/6cfcfdebbd1b43fdac2e5e2cf1ed018d => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:45:03.450737 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2348e1f2-3f95-425f-af71-81dc86ba015f admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:45:03.453618 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-2348e1f2-3f95-425f-af71-81dc86ba015f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:45:03.479747 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 871/1760] 10.222.0.102 () {60 vars in 1488 bytes} [Mon Aug 1 15:45:03 2022] PUT /identity/v3/projects/d50e61c618974f5b84c0d33495f63e05/users/4043273ee0bc429fa61ce10e0d3a579c/roles/de1374f966c04c27b579515b54334fd2 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:45:03.483954 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1496e5ea-4d1d-4794-b424-d472e987c82f admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:45:03.495614 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-1496e5ea-4d1d-4794-b424-d472e987c82f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:45:03.706526 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2348e1f2-3f95-425f-af71-81dc86ba015f admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:45:03.793817 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1496e5ea-4d1d-4794-b424-d472e987c82f admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:45:03.809187 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761d6a65-e46b-4799-a175-aad062182ac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:45:03.809891 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761d6a65-e46b-4799-a175-aad062182ac5 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:03.810176 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761d6a65-e46b-4799-a175-aad062182ac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:03.810648 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761d6a65-e46b-4799-a175-aad062182ac5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:03.813443 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761d6a65-e46b-4799-a175-aad062182ac5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:45:03.819246 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761d6a65-e46b-4799-a175-aad062182ac5 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:45:03.851565 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 872/1761] 10.222.0.102 () {58 vars in 1127 bytes} [Mon Aug 1 15:45:03 2022] GET /identity/v3/roles => generated 1427 bytes in 363 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 15:45:03.851565 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761d6a65-e46b-4799-a175-aad062182ac5 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:45:03.851565 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-761d6a65-e46b-4799-a175-aad062182ac5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:45:03.914846 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761d6a65-e46b-4799-a175-aad062182ac5 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:45:03.941043 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b0b809-d8a0-45c0-a872-e51d5c45d5c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:45:03.941718 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b0b809-d8a0-45c0-a872-e51d5c45d5c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:03.942002 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b0b809-d8a0-45c0-a872-e51d5c45d5c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:03.942279 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b0b809-d8a0-45c0-a872-e51d5c45d5c3 admin admin] PATH_INFO: `/v3/projects/20140bb41f5740c48de74329b25d5908` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:03.949421 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b0b809-d8a0-45c0-a872-e51d5c45d5c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=20140bb41f5740c48de74329b25d5908)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:45:03.949421 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b0b809-d8a0-45c0-a872-e51d5c45d5c3 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:45:03.959714 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3da222b-f304-48bb-a230-6cc58c0915d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:45:03.960522 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3da222b-f304-48bb-a230-6cc58c0915d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:03.961002 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3da222b-f304-48bb-a230-6cc58c0915d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:03.961273 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3da222b-f304-48bb-a230-6cc58c0915d9 admin admin] PATH_INFO: `/v3/users/016b24e1a7774cebbd1b140240ed2f05` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:03.963320 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3da222b-f304-48bb-a230-6cc58c0915d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=016b24e1a7774cebbd1b140240ed2f05)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:45:03.984568 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3da222b-f304-48bb-a230-6cc58c0915d9 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:45:04.127816 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-61b0b809-d8a0-45c0-a872-e51d5c45d5c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20140bb41f5740c48de74329b25d5908', 'request_id': 'req-61b0b809-d8a0-45c0-a872-e51d5c45d5c3'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:45:04.227007 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-61b0b809-d8a0-45c0-a872-e51d5c45d5c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20140bb41f5740c48de74329b25d5908', 'request_id': 'req-61b0b809-d8a0-45c0-a872-e51d5c45d5c3'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:45:04.235993 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-61b0b809-d8a0-45c0-a872-e51d5c45d5c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20140bb41f5740c48de74329b25d5908', 'request_id': 'req-61b0b809-d8a0-45c0-a872-e51d5c45d5c3'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:45:04.268079 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-61b0b809-d8a0-45c0-a872-e51d5c45d5c3 admin admin] The token cache is being invalidate because project 20140bb41f5740c48de74329b25d5908 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80353) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 15:45:04.268748 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-61b0b809-d8a0-45c0-a872-e51d5c45d5c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:45:04.270498 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-61b0b809-d8a0-45c0-a872-e51d5c45d5c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:45:04.273663 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 873/1762] 10.222.0.102 () {58 vars in 1238 bytes} [Mon Aug 1 15:45:03 2022] DELETE /identity/v3/projects/20140bb41f5740c48de74329b25d5908 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:45:04.277311 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b0b809-d8a0-45c0-a872-e51d5c45d5c3 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:45:04.280717 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-c3da222b-f304-48bb-a230-6cc58c0915d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '016b24e1a7774cebbd1b140240ed2f05'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:45:04.282693 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-61b0b809-d8a0-45c0-a872-e51d5c45d5c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:45:04.345673 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-c3da222b-f304-48bb-a230-6cc58c0915d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '016b24e1a7774cebbd1b140240ed2f05'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:45:04.357343 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-c3da222b-f304-48bb-a230-6cc58c0915d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '016b24e1a7774cebbd1b140240ed2f05'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:45:04.363232 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-c3da222b-f304-48bb-a230-6cc58c0915d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '016b24e1a7774cebbd1b140240ed2f05'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:45:04.363232 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-c3da222b-f304-48bb-a230-6cc58c0915d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '016b24e1a7774cebbd1b140240ed2f05'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:45:04.407823 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b0b809-d8a0-45c0-a872-e51d5c45d5c3 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:45:04.414084 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22db36a9-5714-4cdf-9c41-71c24245b669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:45:04.414999 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22db36a9-5714-4cdf-9c41-71c24245b669 admin admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:04.415430 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22db36a9-5714-4cdf-9c41-71c24245b669 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:04.415769 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22db36a9-5714-4cdf-9c41-71c24245b669 admin admin] PATH_INFO: `/v3/projects/d50e61c618974f5b84c0d33495f63e05/users/4043273ee0bc429fa61ce10e0d3a579c/roles/de1374f966c04c27b579515b54334fd2` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:04.418061 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22db36a9-5714-4cdf-9c41-71c24245b669 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d50e61c618974f5b84c0d33495f63e05, user_id=4043273ee0bc429fa61ce10e0d3a579c, role_id=de1374f966c04c27b579515b54334fd2)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:45:04.420986 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22db36a9-5714-4cdf-9c41-71c24245b669 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:45:04.444941 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 874/1763] 10.222.0.102 () {60 vars in 1488 bytes} [Mon Aug 1 15:45:04 2022] PUT /identity/v3/projects/d50e61c618974f5b84c0d33495f63e05/users/4043273ee0bc429fa61ce10e0d3a579c/roles/de1374f966c04c27b579515b54334fd2 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:45:04.449358 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22db36a9-5714-4cdf-9c41-71c24245b669 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:45:04.452018 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-22db36a9-5714-4cdf-9c41-71c24245b669 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:45:04.492288 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 890/1764] 10.222.0.102 () {58 vars in 1229 bytes} [Mon Aug 1 15:45:03 2022] DELETE /identity/v3/users/016b24e1a7774cebbd1b140240ed2f05 => generated 0 bytes in 1043 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:45:04.494759 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05257680-6a08-4922-a782-2e0d3e1264e7 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:04.495269 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05257680-6a08-4922-a782-2e0d3e1264e7 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:04.495845 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05257680-6a08-4922-a782-2e0d3e1264e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:04.569651 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-05257680-6a08-4922-a782-2e0d3e1264e7 None None] MFA Rules not processed for user `4043273ee0bc429fa61ce10e0d3a579c`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:45:04.572063 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-05257680-6a08-4922-a782-2e0d3e1264e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:45:04.651339 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22db36a9-5714-4cdf-9c41-71c24245b669 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:45:04.691846 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 891/1765] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:45:04 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:45:04.703964 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05257680-6a08-4922-a782-2e0d3e1264e7 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:45:04.705580 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-05257680-6a08-4922-a782-2e0d3e1264e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:45:04.747721 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a185c76-1183-4ddf-a9bc-e134c1f89e88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:45:04.748461 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a185c76-1183-4ddf-a9bc-e134c1f89e88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:04.748741 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a185c76-1183-4ddf-a9bc-e134c1f89e88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:04.749084 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a185c76-1183-4ddf-a9bc-e134c1f89e88 admin admin] PATH_INFO: `/v3/users/ff48549512ca48b6aaa9315a54215a76` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:04.750598 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a185c76-1183-4ddf-a9bc-e134c1f89e88 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff48549512ca48b6aaa9315a54215a76)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:45:04.752365 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a185c76-1183-4ddf-a9bc-e134c1f89e88 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:45:04.790706 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05257680-6a08-4922-a782-2e0d3e1264e7 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:45:04.795010 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12db9280-6aac-4b6c-8a74-d7be4bb47f67 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff810b37183c4729859c1b05edff1703', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:45:04.795173 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12db9280-6aac-4b6c-8a74-d7be4bb47f67 service cinder] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:04.795528 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12db9280-6aac-4b6c-8a74-d7be4bb47f67 service cinder] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:04.795871 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12db9280-6aac-4b6c-8a74-d7be4bb47f67 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:04.807064 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12db9280-6aac-4b6c-8a74-d7be4bb47f67 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:45:04.808670 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12db9280-6aac-4b6c-8a74-d7be4bb47f67 service cinder] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:45:04.818935 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 892/1766] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:45:04 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 15:45:04.822240 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a137fdfb-bd95-469b-8ba8-d1a5ea5bb9ab None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:04.822525 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a137fdfb-bd95-469b-8ba8-d1a5ea5bb9ab None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:04.822794 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a137fdfb-bd95-469b-8ba8-d1a5ea5bb9ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:04.844609 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-a137fdfb-bd95-469b-8ba8-d1a5ea5bb9ab None None] MFA Rules not processed for user `d60a67da3f284a469d374b8f1d93ea45`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:45:04.846473 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-a137fdfb-bd95-469b-8ba8-d1a5ea5bb9ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:45:04.862333 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:DELETE=4,keystone:SELECT=94,keystone:INSERT=2 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:45:04.912042 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 893/1767] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:45:04 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:45:05.098311 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a137fdfb-bd95-469b-8ba8-d1a5ea5bb9ab None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:45:05.099814 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-a137fdfb-bd95-469b-8ba8-d1a5ea5bb9ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:45:05.127518 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a137fdfb-bd95-469b-8ba8-d1a5ea5bb9ab None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:45:05.151442 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77191d7b-e446-4c8c-81ed-6548f52ed0aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:45:05.153177 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77191d7b-e446-4c8c-81ed-6548f52ed0aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:05.153399 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77191d7b-e446-4c8c-81ed-6548f52ed0aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:05.155842 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77191d7b-e446-4c8c-81ed-6548f52ed0aa admin admin] PATH_INFO: `/v3/projects/acc440bde7984d96b57f2831cafef0b0` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:05.161819 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77191d7b-e446-4c8c-81ed-6548f52ed0aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=acc440bde7984d96b57f2831cafef0b0)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:45:05.163116 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-8a185c76-1183-4ddf-a9bc-e134c1f89e88 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff48549512ca48b6aaa9315a54215a76'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:45:05.171856 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77191d7b-e446-4c8c-81ed-6548f52ed0aa admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:45:05.265199 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-8a185c76-1183-4ddf-a9bc-e134c1f89e88 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff48549512ca48b6aaa9315a54215a76'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:45:05.300733 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-8a185c76-1183-4ddf-a9bc-e134c1f89e88 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff48549512ca48b6aaa9315a54215a76'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:45:05.300733 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-8a185c76-1183-4ddf-a9bc-e134c1f89e88 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff48549512ca48b6aaa9315a54215a76'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:45:05.300733 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-8a185c76-1183-4ddf-a9bc-e134c1f89e88 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff48549512ca48b6aaa9315a54215a76'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:45:05.337449 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 875/1768] 10.222.0.102 () {58 vars in 1229 bytes} [Mon Aug 1 15:45:04 2022] DELETE /identity/v3/users/ff48549512ca48b6aaa9315a54215a76 => generated 0 bytes in 888 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:45:05.339104 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a185c76-1183-4ddf-a9bc-e134c1f89e88 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:45:05.343981 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-8a185c76-1183-4ddf-a9bc-e134c1f89e88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:45:05.414722 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-77191d7b-e446-4c8c-81ed-6548f52ed0aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'acc440bde7984d96b57f2831cafef0b0', 'request_id': 'req-77191d7b-e446-4c8c-81ed-6548f52ed0aa'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:45:05.430938 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-77191d7b-e446-4c8c-81ed-6548f52ed0aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'acc440bde7984d96b57f2831cafef0b0', 'request_id': 'req-77191d7b-e446-4c8c-81ed-6548f52ed0aa'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:45:05.506319 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a185c76-1183-4ddf-a9bc-e134c1f89e88 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:45:05.514471 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-77191d7b-e446-4c8c-81ed-6548f52ed0aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'acc440bde7984d96b57f2831cafef0b0', 'request_id': 'req-77191d7b-e446-4c8c-81ed-6548f52ed0aa'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:45:05.537579 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-77191d7b-e446-4c8c-81ed-6548f52ed0aa admin admin] The token cache is being invalidate because project acc440bde7984d96b57f2831cafef0b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80352) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 15:45:05.537901 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-77191d7b-e446-4c8c-81ed-6548f52ed0aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:45:05.540449 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-77191d7b-e446-4c8c-81ed-6548f52ed0aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:45:05.547607 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 894/1769] 10.222.0.102 () {58 vars in 1238 bytes} [Mon Aug 1 15:45:05 2022] DELETE /identity/v3/projects/acc440bde7984d96b57f2831cafef0b0 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 15:45:05.555417 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36f56b5-5ce4-43f5-962c-2a94402b2ba9 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:05.555417 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36f56b5-5ce4-43f5-962c-2a94402b2ba9 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:05.555417 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36f56b5-5ce4-43f5-962c-2a94402b2ba9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:05.611020 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-d36f56b5-5ce4-43f5-962c-2a94402b2ba9 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:45:05.611020 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-d36f56b5-5ce4-43f5-962c-2a94402b2ba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:45:05.694886 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa73799c-e317-4c6d-8a17-0037f029e559 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff810b37183c4729859c1b05edff1703', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:45:05.695541 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa73799c-e317-4c6d-8a17-0037f029e559 service cinder] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:05.695829 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa73799c-e317-4c6d-8a17-0037f029e559 service cinder] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:05.696099 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa73799c-e317-4c6d-8a17-0037f029e559 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:05.701791 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-fa73799c-e317-4c6d-8a17-0037f029e559 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:45:05.809011 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 895/1770] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:45:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:45:05.816878 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ae686e-8276-4823-9bc1-22816e525bfb None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:05.817400 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ae686e-8276-4823-9bc1-22816e525bfb None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:05.818100 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ae686e-8276-4823-9bc1-22816e525bfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:05.856238 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-12ae686e-8276-4823-9bc1-22816e525bfb None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:45:05.857423 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-12ae686e-8276-4823-9bc1-22816e525bfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:45:05.859562 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa73799c-e317-4c6d-8a17-0037f029e559 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:45:05.861070 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa73799c-e317-4c6d-8a17-0037f029e559 service cinder] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:45:05.893594 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 896/1771] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:45:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 15:45:05.900272 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ae686e-8276-4823-9bc1-22816e525bfb None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:45:05.915003 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 876/1772] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:45:05 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 574 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:45:05.916390 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ae686e-8276-4823-9bc1-22816e525bfb None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:45:05.922598 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605c400a-8310-457e-acb2-16497ab97c4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:45:05.923266 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605c400a-8310-457e-acb2-16497ab97c4a admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:05.923547 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605c400a-8310-457e-acb2-16497ab97c4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:05.924282 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605c400a-8310-457e-acb2-16497ab97c4a admin admin] PATH_INFO: `/v3/domains` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:05.925024 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605c400a-8310-457e-acb2-16497ab97c4a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:45:05.925333 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605c400a-8310-457e-acb2-16497ab97c4a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:45:05.927645 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605c400a-8310-457e-acb2-16497ab97c4a admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:45:05.956896 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 897/1773] 10.222.0.102 () {58 vars in 1158 bytes} [Mon Aug 1 15:45:05 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:45:05.960067 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa73799c-e317-4c6d-8a17-0037f029e559 service cinder] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:45:05.973520 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa73799c-e317-4c6d-8a17-0037f029e559 service cinder] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:45:05.978257 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf79a5e-f48d-4704-bb7d-0cbd35324a19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:45:05.978878 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf79a5e-f48d-4704-bb7d-0cbd35324a19 admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:05.979162 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf79a5e-f48d-4704-bb7d-0cbd35324a19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:05.979438 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf79a5e-f48d-4704-bb7d-0cbd35324a19 admin admin] PATH_INFO: `/v3/projects` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:05.980105 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf79a5e-f48d-4704-bb7d-0cbd35324a19 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:45:05.982086 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf79a5e-f48d-4704-bb7d-0cbd35324a19 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:45:06.117016 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 877/1774] 10.222.0.102 () {60 vars in 1158 bytes} [Mon Aug 1 15:45:05 2022] POST /identity/v3/projects => generated 380 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:45:06.119380 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605c400a-8310-457e-acb2-16497ab97c4a admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:45:06.133683 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605c400a-8310-457e-acb2-16497ab97c4a admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:45:06.277574 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee74c22d-edb5-4085-bae6-8d8b8bcf0528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:45:06.279145 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee74c22d-edb5-4085-bae6-8d8b8bcf0528 admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:06.279595 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee74c22d-edb5-4085-bae6-8d8b8bcf0528 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:06.280772 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee74c22d-edb5-4085-bae6-8d8b8bcf0528 admin admin] PATH_INFO: `/v3/users` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:06.281860 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee74c22d-edb5-4085-bae6-8d8b8bcf0528 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:45:06.284357 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee74c22d-edb5-4085-bae6-8d8b8bcf0528 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:45:06.434853 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1f55e8-6056-411f-b689-28a4964f1821 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:06.435366 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1f55e8-6056-411f-b689-28a4964f1821 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:06.435463 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1f55e8-6056-411f-b689-28a4964f1821 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:06.489435 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 898/1775] 10.222.0.102 () {60 vars in 1149 bytes} [Mon Aug 1 15:45:06 2022] POST /identity/v3/users => generated 291 bytes in 371 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:45:06.493842 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee74c22d-edb5-4085-bae6-8d8b8bcf0528 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:45:06.520035 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee74c22d-edb5-4085-bae6-8d8b8bcf0528 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:45:06.540201 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786a1b80-f5b9-4606-af7a-2d0e398fafe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:45:06.540915 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786a1b80-f5b9-4606-af7a-2d0e398fafe0 admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:06.541201 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786a1b80-f5b9-4606-af7a-2d0e398fafe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:06.541477 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786a1b80-f5b9-4606-af7a-2d0e398fafe0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:06.542380 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786a1b80-f5b9-4606-af7a-2d0e398fafe0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:45:06.547809 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786a1b80-f5b9-4606-af7a-2d0e398fafe0 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:45:06.555188 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:45:06.575997 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-9d1f55e8-6056-411f-b689-28a4964f1821 None None] MFA Rules not processed for user `ae8514df55144c9086ed98ba44efbbd4`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:45:06.580985 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-9d1f55e8-6056-411f-b689-28a4964f1821 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:45:06.586244 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 899/1776] 10.222.0.102 () {58 vars in 1127 bytes} [Mon Aug 1 15:45:06 2022] GET /identity/v3/roles => generated 1427 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:45:06.589792 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786a1b80-f5b9-4606-af7a-2d0e398fafe0 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:45:06.608041 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786a1b80-f5b9-4606-af7a-2d0e398fafe0 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:45:06.624761 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa218afb-6375-4c3a-8f42-d1dca0cb2097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:45:06.625603 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa218afb-6375-4c3a-8f42-d1dca0cb2097 admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:06.625724 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa218afb-6375-4c3a-8f42-d1dca0cb2097 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:06.625995 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa218afb-6375-4c3a-8f42-d1dca0cb2097 admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:06.633132 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa218afb-6375-4c3a-8f42-d1dca0cb2097 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:45:06.633702 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa218afb-6375-4c3a-8f42-d1dca0cb2097 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:45:06.663826 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 900/1777] 10.222.0.102 () {58 vars in 1127 bytes} [Mon Aug 1 15:45:06 2022] GET /identity/v3/roles => generated 1427 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 15:45:06.667517 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa218afb-6375-4c3a-8f42-d1dca0cb2097 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:45:06.675761 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa218afb-6375-4c3a-8f42-d1dca0cb2097 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:45:06.689390 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4f20f4-9c3d-4b4f-b73e-55657c718543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:45:06.690419 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4f20f4-9c3d-4b4f-b73e-55657c718543 admin admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:06.692274 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4f20f4-9c3d-4b4f-b73e-55657c718543 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:06.692764 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4f20f4-9c3d-4b4f-b73e-55657c718543 admin admin] PATH_INFO: `/v3/projects/0e773c0bbedb4e55b67308934847e31e/users/fd748920cbc445398cc522eb3b4408f8/roles/27f5093ac0674d799cdbd17c68482e32` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:06.714590 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4f20f4-9c3d-4b4f-b73e-55657c718543 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e773c0bbedb4e55b67308934847e31e, user_id=fd748920cbc445398cc522eb3b4408f8, role_id=27f5093ac0674d799cdbd17c68482e32)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:45:06.719495 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4f20f4-9c3d-4b4f-b73e-55657c718543 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:45:06.746835 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 878/1778] 10.222.0.102 () {58 vars in 1014 bytes} [Mon Aug 1 15:45:06 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 15:45:06.824042 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 901/1779] 10.222.0.102 () {60 vars in 1488 bytes} [Mon Aug 1 15:45:06 2022] PUT /identity/v3/projects/0e773c0bbedb4e55b67308934847e31e/users/fd748920cbc445398cc522eb3b4408f8/roles/27f5093ac0674d799cdbd17c68482e32 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:45:06.835149 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bc9b2c-1e4b-4b0f-8605-aeaf6d68b9ef None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:06.835439 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bc9b2c-1e4b-4b0f-8605-aeaf6d68b9ef None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:06.835717 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bc9b2c-1e4b-4b0f-8605-aeaf6d68b9ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:06.903626 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-02bc9b2c-1e4b-4b0f-8605-aeaf6d68b9ef None None] MFA Rules not processed for user `fd748920cbc445398cc522eb3b4408f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:45:06.904959 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-02bc9b2c-1e4b-4b0f-8605-aeaf6d68b9ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:45:06.928831 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4f20f4-9c3d-4b4f-b73e-55657c718543 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:45:06.931087 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-4a4f20f4-9c3d-4b4f-b73e-55657c718543 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:45:07.076924 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 879/1780] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:45:06 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 15:45:07.087568 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bc9b2c-1e4b-4b0f-8605-aeaf6d68b9ef None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:45:07.198658 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4f20f4-9c3d-4b4f-b73e-55657c718543 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:45:07.249627 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c64e7c4-4d2b-498c-8012-09f4ce016ec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:45:07.250148 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c64e7c4-4d2b-498c-8012-09f4ce016ec0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:07.250434 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c64e7c4-4d2b-498c-8012-09f4ce016ec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:07.255947 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c64e7c4-4d2b-498c-8012-09f4ce016ec0 admin admin] PATH_INFO: `/v3/projects/afe50c6c1c7a4c028f9fe53582527b71` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:07.270398 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c64e7c4-4d2b-498c-8012-09f4ce016ec0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=afe50c6c1c7a4c028f9fe53582527b71)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:45:07.285126 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c64e7c4-4d2b-498c-8012-09f4ce016ec0 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:45:07.422484 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bc9b2c-1e4b-4b0f-8605-aeaf6d68b9ef None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:45:07.442718 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb0f2c6-5305-4b01-a6df-aa9494402a6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:45:07.444119 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb0f2c6-5305-4b01-a6df-aa9494402a6f admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:07.445809 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb0f2c6-5305-4b01-a6df-aa9494402a6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:07.446309 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb0f2c6-5305-4b01-a6df-aa9494402a6f admin admin] PATH_INFO: `/v3/projects` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:07.447286 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb0f2c6-5305-4b01-a6df-aa9494402a6f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:45:07.451901 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb0f2c6-5305-4b01-a6df-aa9494402a6f admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:45:07.505068 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-5c64e7c4-4d2b-498c-8012-09f4ce016ec0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'afe50c6c1c7a4c028f9fe53582527b71', 'request_id': 'req-5c64e7c4-4d2b-498c-8012-09f4ce016ec0'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:45:07.527446 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-5c64e7c4-4d2b-498c-8012-09f4ce016ec0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'afe50c6c1c7a4c028f9fe53582527b71', 'request_id': 'req-5c64e7c4-4d2b-498c-8012-09f4ce016ec0'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:45:07.577980 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 880/1781] 10.222.0.102 () {60 vars in 1158 bytes} [Mon Aug 1 15:45:07 2022] POST /identity/v3/projects => generated 380 bytes in 491 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:45:07.584939 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb0f2c6-5305-4b01-a6df-aa9494402a6f admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:45:07.592295 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-6bb0f2c6-5305-4b01-a6df-aa9494402a6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:45:07.626784 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-5c64e7c4-4d2b-498c-8012-09f4ce016ec0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'afe50c6c1c7a4c028f9fe53582527b71', 'request_id': 'req-5c64e7c4-4d2b-498c-8012-09f4ce016ec0'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:45:07.643240 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-5c64e7c4-4d2b-498c-8012-09f4ce016ec0 admin admin] The token cache is being invalidate because project afe50c6c1c7a4c028f9fe53582527b71 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80352) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 15:45:07.645601 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-5c64e7c4-4d2b-498c-8012-09f4ce016ec0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:45:07.647488 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-5c64e7c4-4d2b-498c-8012-09f4ce016ec0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:45:07.653884 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 902/1782] 10.222.0.102 () {58 vars in 1238 bytes} [Mon Aug 1 15:45:06 2022] DELETE /identity/v3/projects/afe50c6c1c7a4c028f9fe53582527b71 => generated 0 bytes in 725 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:45:07.655006 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c64e7c4-4d2b-498c-8012-09f4ce016ec0 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:45:07.661253 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-5c64e7c4-4d2b-498c-8012-09f4ce016ec0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:45:07.859126 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c64e7c4-4d2b-498c-8012-09f4ce016ec0 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:45:07.866848 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb0f2c6-5305-4b01-a6df-aa9494402a6f admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:45:07.880772 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7419d491-6d3d-4a2e-a5e9-bddb2801b601 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90673f47354f4403aa0e12e3658441c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:45:07.881102 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7419d491-6d3d-4a2e-a5e9-bddb2801b601 service swift] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:07.881345 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7419d491-6d3d-4a2e-a5e9-bddb2801b601 service swift] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:07.881616 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7419d491-6d3d-4a2e-a5e9-bddb2801b601 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:07.889872 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-7419d491-6d3d-4a2e-a5e9-bddb2801b601 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:45:07.977484 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e80e0df-a602-4c12-9733-9d101d62f700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:45:07.978126 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e80e0df-a602-4c12-9733-9d101d62f700 admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:07.978406 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e80e0df-a602-4c12-9733-9d101d62f700 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:07.978677 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e80e0df-a602-4c12-9733-9d101d62f700 admin admin] PATH_INFO: `/v3/users` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:07.979347 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e80e0df-a602-4c12-9733-9d101d62f700 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:45:07.981310 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e80e0df-a602-4c12-9733-9d101d62f700 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:45:08.013264 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7419d491-6d3d-4a2e-a5e9-bddb2801b601 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:45:08.016924 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7419d491-6d3d-4a2e-a5e9-bddb2801b601 service swift] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:45:08.026688 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 881/1783] 10.222.0.102 () {60 vars in 1389 bytes} [Mon Aug 1 15:45:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 01 15:45:08.028007 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef3ae9f-fa89-4b16-825c-894217609227 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:08.028718 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef3ae9f-fa89-4b16-825c-894217609227 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:08.028718 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef3ae9f-fa89-4b16-825c-894217609227 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:08.060202 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-8ef3ae9f-fa89-4b16-825c-894217609227 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:45:08.065591 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-8ef3ae9f-fa89-4b16-825c-894217609227 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:45:08.086139 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 882/1784] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:45:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:45:08.093977 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3f689a-3203-4259-89fa-71ed271ad036 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:08.094257 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3f689a-3203-4259-89fa-71ed271ad036 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:08.094528 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3f689a-3203-4259-89fa-71ed271ad036 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:08.136558 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:45:08.145556 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 903/1785] 10.222.0.102 () {60 vars in 1149 bytes} [Mon Aug 1 15:45:07 2022] POST /identity/v3/users => generated 291 bytes in 488 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:45:08.147147 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e80e0df-a602-4c12-9733-9d101d62f700 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:45:08.172135 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-8a3f689a-3203-4259-89fa-71ed271ad036 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:45:08.172135 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-8a3f689a-3203-4259-89fa-71ed271ad036 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:45:08.189526 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e80e0df-a602-4c12-9733-9d101d62f700 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:45:08.229805 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 883/1786] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:45:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:45:08.231294 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2193511-c4a2-4ce6-94a2-2ea8f1365b77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:45:08.231951 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2193511-c4a2-4ce6-94a2-2ea8f1365b77 admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:08.232230 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2193511-c4a2-4ce6-94a2-2ea8f1365b77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:08.232503 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2193511-c4a2-4ce6-94a2-2ea8f1365b77 admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:08.233238 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2193511-c4a2-4ce6-94a2-2ea8f1365b77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:45:08.235007 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2193511-c4a2-4ce6-94a2-2ea8f1365b77 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:45:08.237276 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3f689a-3203-4259-89fa-71ed271ad036 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:45:08.257659 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3f689a-3203-4259-89fa-71ed271ad036 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:45:08.275857 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 904/1787] 10.222.0.102 () {58 vars in 1127 bytes} [Mon Aug 1 15:45:08 2022] GET /identity/v3/roles => generated 1427 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 15:45:08.286896 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f0928c-bceb-4561-a7d6-1b54a995f343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:45:08.292130 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f0928c-bceb-4561-a7d6-1b54a995f343 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:08.292130 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f0928c-bceb-4561-a7d6-1b54a995f343 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:08.292130 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f0928c-bceb-4561-a7d6-1b54a995f343 admin admin] PATH_INFO: `/v3/domains` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:08.292429 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2193511-c4a2-4ce6-94a2-2ea8f1365b77 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:45:08.292520 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f0928c-bceb-4561-a7d6-1b54a995f343 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:45:08.292520 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f0928c-bceb-4561-a7d6-1b54a995f343 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:45:08.300010 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f0928c-bceb-4561-a7d6-1b54a995f343 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:45:08.323191 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2193511-c4a2-4ce6-94a2-2ea8f1365b77 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:45:08.328635 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 884/1788] 10.222.0.102 () {58 vars in 1158 bytes} [Mon Aug 1 15:45:08 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:45:08.343426 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f0928c-bceb-4561-a7d6-1b54a995f343 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:45:08.344507 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f412fe-f655-430a-af40-136b429828a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:45:08.345690 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f412fe-f655-430a-af40-136b429828a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:08.346117 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f412fe-f655-430a-af40-136b429828a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:08.346228 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f412fe-f655-430a-af40-136b429828a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:08.346931 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f412fe-f655-430a-af40-136b429828a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:45:08.349038 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f412fe-f655-430a-af40-136b429828a2 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:45:08.374190 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f0928c-bceb-4561-a7d6-1b54a995f343 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:45:08.381821 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 905/1789] 10.222.0.102 () {58 vars in 1127 bytes} [Mon Aug 1 15:45:08 2022] GET /identity/v3/roles => generated 1427 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:45:08.395862 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f412fe-f655-430a-af40-136b429828a2 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:45:08.424075 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c034b5e-d6e5-47ba-929d-3020ad3a7926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:45:08.427485 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f412fe-f655-430a-af40-136b429828a2 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:45:08.432182 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c034b5e-d6e5-47ba-929d-3020ad3a7926 admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:08.435657 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c034b5e-d6e5-47ba-929d-3020ad3a7926 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:08.437256 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c034b5e-d6e5-47ba-929d-3020ad3a7926 admin admin] PATH_INFO: `/v3/projects` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:08.439352 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c034b5e-d6e5-47ba-929d-3020ad3a7926 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:45:08.441243 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccaf03f-d9d0-4181-8d22-f7bc30f79b98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:45:08.441243 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccaf03f-d9d0-4181-8d22-f7bc30f79b98 admin admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:08.441511 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccaf03f-d9d0-4181-8d22-f7bc30f79b98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:08.442307 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccaf03f-d9d0-4181-8d22-f7bc30f79b98 admin admin] PATH_INFO: `/v3/projects/45d2df4ec3da49758233f619c1a76948/users/ca6e3bd5d5d649b988bb95c2278c18d0/roles/27f5093ac0674d799cdbd17c68482e32` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:08.452451 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c034b5e-d6e5-47ba-929d-3020ad3a7926 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:45:08.489283 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccaf03f-d9d0-4181-8d22-f7bc30f79b98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=45d2df4ec3da49758233f619c1a76948, user_id=ca6e3bd5d5d649b988bb95c2278c18d0, role_id=27f5093ac0674d799cdbd17c68482e32)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:45:08.495301 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccaf03f-d9d0-4181-8d22-f7bc30f79b98 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:45:08.622083 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:45:08.754552 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 906/1790] 10.222.0.102 () {60 vars in 1488 bytes} [Mon Aug 1 15:45:08 2022] PUT /identity/v3/projects/45d2df4ec3da49758233f619c1a76948/users/ca6e3bd5d5d649b988bb95c2278c18d0/roles/27f5093ac0674d799cdbd17c68482e32 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:45:08.770700 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834cfbf6-85cb-42c3-9b4b-22513608e592 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:08.770984 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834cfbf6-85cb-42c3-9b4b-22513608e592 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:08.771224 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834cfbf6-85cb-42c3-9b4b-22513608e592 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:08.871842 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-834cfbf6-85cb-42c3-9b4b-22513608e592 None None] MFA Rules not processed for user `ca6e3bd5d5d649b988bb95c2278c18d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:45:08.871842 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-834cfbf6-85cb-42c3-9b4b-22513608e592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:45:08.874622 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 885/1791] 10.222.0.102 () {60 vars in 1158 bytes} [Mon Aug 1 15:45:08 2022] POST /identity/v3/projects => generated 386 bytes in 533 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:45:08.879347 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c034b5e-d6e5-47ba-929d-3020ad3a7926 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:45:09.101464 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c034b5e-d6e5-47ba-929d-3020ad3a7926 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:45:09.155536 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f334d78-7d43-40ba-a98c-7113f8ccad02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:45:09.155536 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f334d78-7d43-40ba-a98c-7113f8ccad02 admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:09.155536 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f334d78-7d43-40ba-a98c-7113f8ccad02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:09.155536 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f334d78-7d43-40ba-a98c-7113f8ccad02 admin admin] PATH_INFO: `/v3/users` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:09.156222 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f334d78-7d43-40ba-a98c-7113f8ccad02 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:45:09.156222 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f334d78-7d43-40ba-a98c-7113f8ccad02 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:45:09.282023 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 907/1792] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:45:08 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 503 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 15:45:09.283083 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834cfbf6-85cb-42c3-9b4b-22513608e592 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:45:09.352180 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 886/1793] 10.222.0.102 () {60 vars in 1149 bytes} [Mon Aug 1 15:45:08 2022] POST /identity/v3/users => generated 294 bytes in 474 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:45:09.356950 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f334d78-7d43-40ba-a98c-7113f8ccad02 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:45:09.387757 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f334d78-7d43-40ba-a98c-7113f8ccad02 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:45:09.424815 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f3a9b5-01be-43df-bb21-0eb2dc31414c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:45:09.425090 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f3a9b5-01be-43df-bb21-0eb2dc31414c admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:09.425556 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f3a9b5-01be-43df-bb21-0eb2dc31414c admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:09.425905 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f3a9b5-01be-43df-bb21-0eb2dc31414c admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:09.426696 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f3a9b5-01be-43df-bb21-0eb2dc31414c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:45:09.430579 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f3a9b5-01be-43df-bb21-0eb2dc31414c admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:45:09.451964 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834cfbf6-85cb-42c3-9b4b-22513608e592 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:45:09.469396 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec01c25-3855-4b20-9b9b-ef477474305a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:45:09.469396 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec01c25-3855-4b20-9b9b-ef477474305a admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:09.469396 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec01c25-3855-4b20-9b9b-ef477474305a admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:09.469858 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec01c25-3855-4b20-9b9b-ef477474305a admin admin] PATH_INFO: `/v3/projects` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:09.470345 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec01c25-3855-4b20-9b9b-ef477474305a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:45:09.473346 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec01c25-3855-4b20-9b9b-ef477474305a admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:45:09.473493 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 887/1794] 10.222.0.102 () {58 vars in 1127 bytes} [Mon Aug 1 15:45:09 2022] GET /identity/v3/roles => generated 1427 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:45:09.476827 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f3a9b5-01be-43df-bb21-0eb2dc31414c admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:45:09.519869 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f3a9b5-01be-43df-bb21-0eb2dc31414c admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:45:09.535756 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab35e70-e3ab-4fc4-ad34-18722bf852f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:45:09.536896 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab35e70-e3ab-4fc4-ad34-18722bf852f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:09.537391 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab35e70-e3ab-4fc4-ad34-18722bf852f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:09.537736 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab35e70-e3ab-4fc4-ad34-18722bf852f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:09.538861 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab35e70-e3ab-4fc4-ad34-18722bf852f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:45:09.543422 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab35e70-e3ab-4fc4-ad34-18722bf852f6 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:45:09.569593 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 888/1795] 10.222.0.102 () {58 vars in 1127 bytes} [Mon Aug 1 15:45:09 2022] GET /identity/v3/roles => generated 1427 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:45:09.571272 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e72cfd-c00e-4a65-8966-901ade1491b3 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:09.571764 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e72cfd-c00e-4a65-8966-901ade1491b3 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:09.572465 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e72cfd-c00e-4a65-8966-901ade1491b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:09.589068 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 908/1796] 10.222.0.102 () {60 vars in 1158 bytes} [Mon Aug 1 15:45:09 2022] POST /identity/v3/projects => generated 378 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:45:09.589068 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec01c25-3855-4b20-9b9b-ef477474305a admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:45:09.613702 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-c5e72cfd-c00e-4a65-8966-901ade1491b3 None None] MFA Rules not processed for user `a856a413100443939fe9b10daa868518`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:45:09.615412 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-c5e72cfd-c00e-4a65-8966-901ade1491b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:45:09.778931 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 889/1797] 10.222.0.65 () {58 vars in 1019 bytes} [Mon Aug 1 15:45:09 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:45:09.781336 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e72cfd-c00e-4a65-8966-901ade1491b3 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:45:09.790546 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec01c25-3855-4b20-9b9b-ef477474305a admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:45:09.796991 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c79aa8-d39f-4f7e-a1cf-464ec0527cac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:45:09.797973 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c79aa8-d39f-4f7e-a1cf-464ec0527cac admin admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:09.798322 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c79aa8-d39f-4f7e-a1cf-464ec0527cac admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:09.798667 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c79aa8-d39f-4f7e-a1cf-464ec0527cac admin admin] PATH_INFO: `/v3/projects/d0b32ae554ff4692a62b4032b76a8588/users/36457c919fac492f907555d7c6bb6d9e/roles/27f5093ac0674d799cdbd17c68482e32` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:09.806476 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e72cfd-c00e-4a65-8966-901ade1491b3 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:45:09.820124 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c79aa8-d39f-4f7e-a1cf-464ec0527cac admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0b32ae554ff4692a62b4032b76a8588, user_id=36457c919fac492f907555d7c6bb6d9e, role_id=27f5093ac0674d799cdbd17c68482e32)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:45:09.823522 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c79aa8-d39f-4f7e-a1cf-464ec0527cac admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:45:09.841175 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4c36ae-0109-4c45-adc1-dbf1057b1f33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:45:09.844562 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4c36ae-0109-4c45-adc1-dbf1057b1f33 admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:09.845840 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4c36ae-0109-4c45-adc1-dbf1057b1f33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:09.850485 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4c36ae-0109-4c45-adc1-dbf1057b1f33 admin admin] PATH_INFO: `/v3/users` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:09.851311 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4c36ae-0109-4c45-adc1-dbf1057b1f33 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:45:09.853511 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4c36ae-0109-4c45-adc1-dbf1057b1f33 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:45:09.981937 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 909/1798] 10.222.0.102 () {60 vars in 1488 bytes} [Mon Aug 1 15:45:09 2022] PUT /identity/v3/projects/d0b32ae554ff4692a62b4032b76a8588/users/36457c919fac492f907555d7c6bb6d9e/roles/27f5093ac0674d799cdbd17c68482e32 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:45:09.995859 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c79aa8-d39f-4f7e-a1cf-464ec0527cac admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:45:09.999362 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-c3c79aa8-d39f-4f7e-a1cf-464ec0527cac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:45:10.075486 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:45:10.086247 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 890/1799] 10.222.0.102 () {60 vars in 1149 bytes} [Mon Aug 1 15:45:09 2022] POST /identity/v3/users => generated 296 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:45:10.086247 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47d2065-8741-46f5-a392-5526b4a5a28c None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:10.086247 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47d2065-8741-46f5-a392-5526b4a5a28c None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:10.086734 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47d2065-8741-46f5-a392-5526b4a5a28c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:10.162688 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c79aa8-d39f-4f7e-a1cf-464ec0527cac admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:45:10.166843 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7739a834-4492-4900-9e22-cf6425ab68e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a856a413100443939fe9b10daa868518', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:45:10.167574 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7739a834-4492-4900-9e22-cf6425ab68e4 service neutron] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:10.167861 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7739a834-4492-4900-9e22-cf6425ab68e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:10.168131 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7739a834-4492-4900-9e22-cf6425ab68e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:10.173401 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-e47d2065-8741-46f5-a392-5526b4a5a28c None None] MFA Rules not processed for user `36457c919fac492f907555d7c6bb6d9e`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:45:10.175024 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-e47d2065-8741-46f5-a392-5526b4a5a28c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:45:10.177777 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7739a834-4492-4900-9e22-cf6425ab68e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:45:10.182342 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7739a834-4492-4900-9e22-cf6425ab68e4 service neutron] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:45:10.208970 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 910/1800] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:45:09 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:45:10.208970 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7739a834-4492-4900-9e22-cf6425ab68e4 service neutron] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:45:10.319875 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 891/1801] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:45:10 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:45:10.321584 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47d2065-8741-46f5-a392-5526b4a5a28c None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:45:10.366839 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47d2065-8741-46f5-a392-5526b4a5a28c None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:45:10.372701 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d38a1b1-dd82-4376-932f-75301367364f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a856a413100443939fe9b10daa868518', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:45:10.373841 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d38a1b1-dd82-4376-932f-75301367364f service neutron] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:10.374539 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d38a1b1-dd82-4376-932f-75301367364f service neutron] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:10.375324 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d38a1b1-dd82-4376-932f-75301367364f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:10.393870 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d38a1b1-dd82-4376-932f-75301367364f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:45:10.396432 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d38a1b1-dd82-4376-932f-75301367364f service neutron] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:45:10.418215 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 892/1802] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:45:10 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:45:10.419417 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d38a1b1-dd82-4376-932f-75301367364f service neutron] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:45:10.455622 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7739a834-4492-4900-9e22-cf6425ab68e4 service neutron] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:45:10.470335 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1889089-a6fe-4130-94b7-d61110e77102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:45:10.471422 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1889089-a6fe-4130-94b7-d61110e77102 admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:10.473467 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1889089-a6fe-4130-94b7-d61110e77102 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:10.474013 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1889089-a6fe-4130-94b7-d61110e77102 admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:10.474961 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1889089-a6fe-4130-94b7-d61110e77102 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:45:10.476999 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1889089-a6fe-4130-94b7-d61110e77102 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:45:10.504579 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 911/1803] 10.222.0.102 () {58 vars in 1127 bytes} [Mon Aug 1 15:45:10 2022] GET /identity/v3/roles => generated 1427 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:45:10.510330 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1889089-a6fe-4130-94b7-d61110e77102 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:45:10.534477 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1889089-a6fe-4130-94b7-d61110e77102 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:45:10.548882 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8dccf6-ced5-45ed-9713-9c2bee81eea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:45:10.549616 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8dccf6-ced5-45ed-9713-9c2bee81eea2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:10.549906 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8dccf6-ced5-45ed-9713-9c2bee81eea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:10.550164 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8dccf6-ced5-45ed-9713-9c2bee81eea2 admin admin] PATH_INFO: `/v3/projects/49bfdaf6bcf0402ca789b501364e336f/users/0ba6d140d13d4d7489b9b8d25a44e23d/roles/de1374f966c04c27b579515b54334fd2` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:10.590346 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8dccf6-ced5-45ed-9713-9c2bee81eea2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=49bfdaf6bcf0402ca789b501364e336f, user_id=0ba6d140d13d4d7489b9b8d25a44e23d, role_id=de1374f966c04c27b579515b54334fd2)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:45:10.594068 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8dccf6-ced5-45ed-9713-9c2bee81eea2 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:45:10.641182 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d38a1b1-dd82-4376-932f-75301367364f service neutron] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:45:10.656439 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9168a56d-831f-485a-843d-a1afff5e81c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:45:10.657890 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9168a56d-831f-485a-843d-a1afff5e81c4 admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:10.658764 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9168a56d-831f-485a-843d-a1afff5e81c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:10.659112 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9168a56d-831f-485a-843d-a1afff5e81c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:10.664423 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9168a56d-831f-485a-843d-a1afff5e81c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:45:10.666996 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9168a56d-831f-485a-843d-a1afff5e81c4 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:45:10.730323 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:45:10.914426 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 912/1804] 10.222.0.102 () {60 vars in 1488 bytes} [Mon Aug 1 15:45:10 2022] PUT /identity/v3/projects/49bfdaf6bcf0402ca789b501364e336f/users/0ba6d140d13d4d7489b9b8d25a44e23d/roles/de1374f966c04c27b579515b54334fd2 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:45:10.920463 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8dccf6-ced5-45ed-9713-9c2bee81eea2 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:45:10.959403 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 893/1805] 10.222.0.102 () {60 vars in 1158 bytes} [Mon Aug 1 15:45:10 2022] POST /identity/v3/projects => generated 388 bytes in 540 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:45:10.962743 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9168a56d-831f-485a-843d-a1afff5e81c4 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:45:11.170273 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9168a56d-831f-485a-843d-a1afff5e81c4 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:45:11.175885 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8dccf6-ced5-45ed-9713-9c2bee81eea2 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:45:11.187870 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2f7dac-cf5b-4fbf-8093-f7836ccb3ec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:45:11.191732 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2f7dac-cf5b-4fbf-8093-f7836ccb3ec9 admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:11.192274 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38393f99-6cf4-4452-bd97-52916ceb2d96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:45:11.193074 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38393f99-6cf4-4452-bd97-52916ceb2d96 admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:11.193313 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2f7dac-cf5b-4fbf-8093-f7836ccb3ec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:11.193419 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38393f99-6cf4-4452-bd97-52916ceb2d96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:11.193615 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38393f99-6cf4-4452-bd97-52916ceb2d96 admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:11.194327 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38393f99-6cf4-4452-bd97-52916ceb2d96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:45:11.194691 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2f7dac-cf5b-4fbf-8093-f7836ccb3ec9 admin admin] PATH_INFO: `/v3/users` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:11.196040 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38393f99-6cf4-4452-bd97-52916ceb2d96 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:45:11.197720 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2f7dac-cf5b-4fbf-8093-f7836ccb3ec9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:45:11.200015 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2f7dac-cf5b-4fbf-8093-f7836ccb3ec9 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:45:11.236789 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 913/1806] 10.222.0.102 () {58 vars in 1127 bytes} [Mon Aug 1 15:45:10 2022] GET /identity/v3/roles => generated 1427 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:45:11.245881 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38393f99-6cf4-4452-bd97-52916ceb2d96 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:45:11.269801 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38393f99-6cf4-4452-bd97-52916ceb2d96 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:45:11.298167 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05689dec-4b08-46a6-b73d-8f6f0e1fd54f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:45:11.299054 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05689dec-4b08-46a6-b73d-8f6f0e1fd54f admin admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:11.299547 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05689dec-4b08-46a6-b73d-8f6f0e1fd54f admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:11.299906 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05689dec-4b08-46a6-b73d-8f6f0e1fd54f admin admin] PATH_INFO: `/v3/projects/49bfdaf6bcf0402ca789b501364e336f/users/0ba6d140d13d4d7489b9b8d25a44e23d/roles/de1374f966c04c27b579515b54334fd2` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:11.307586 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05689dec-4b08-46a6-b73d-8f6f0e1fd54f admin admin] RBAC: Authorizing `identity:create_grant(project_id=49bfdaf6bcf0402ca789b501364e336f, user_id=0ba6d140d13d4d7489b9b8d25a44e23d, role_id=de1374f966c04c27b579515b54334fd2)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:45:11.312652 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 894/1807] 10.222.0.102 () {60 vars in 1149 bytes} [Mon Aug 1 15:45:10 2022] POST /identity/v3/users => generated 295 bytes in 353 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:45:11.319377 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2f7dac-cf5b-4fbf-8093-f7836ccb3ec9 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:45:11.322927 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05689dec-4b08-46a6-b73d-8f6f0e1fd54f admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:45:11.349569 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2f7dac-cf5b-4fbf-8093-f7836ccb3ec9 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:45:11.362852 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 914/1808] 10.222.0.102 () {60 vars in 1488 bytes} [Mon Aug 1 15:45:11 2022] PUT /identity/v3/projects/49bfdaf6bcf0402ca789b501364e336f/users/0ba6d140d13d4d7489b9b8d25a44e23d/roles/de1374f966c04c27b579515b54334fd2 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:45:11.371228 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f632d6b9-5fc3-4c28-9623-516f9bbaa243 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:11.371444 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f632d6b9-5fc3-4c28-9623-516f9bbaa243 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:11.371919 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f632d6b9-5fc3-4c28-9623-516f9bbaa243 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:11.448073 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-f632d6b9-5fc3-4c28-9623-516f9bbaa243 None None] MFA Rules not processed for user `0ba6d140d13d4d7489b9b8d25a44e23d`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:45:11.449878 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-f632d6b9-5fc3-4c28-9623-516f9bbaa243 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:45:11.563022 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214eaa94-c613-4ac4-8e19-6006988f7509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:45:11.564237 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214eaa94-c613-4ac4-8e19-6006988f7509 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:11.564577 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214eaa94-c613-4ac4-8e19-6006988f7509 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:11.564883 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214eaa94-c613-4ac4-8e19-6006988f7509 admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:11.565589 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214eaa94-c613-4ac4-8e19-6006988f7509 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:45:11.567374 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214eaa94-c613-4ac4-8e19-6006988f7509 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:45:11.596727 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 895/1809] 10.222.0.102 () {58 vars in 1127 bytes} [Mon Aug 1 15:45:11 2022] GET /identity/v3/roles => generated 1427 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:45:11.602865 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214eaa94-c613-4ac4-8e19-6006988f7509 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:45:11.625469 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214eaa94-c613-4ac4-8e19-6006988f7509 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:45:11.630416 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 915/1810] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:45:11 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 15:45:11.645588 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12078bf4-b4ff-414a-a311-8ecf71cd9ef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:45:11.647754 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f632d6b9-5fc3-4c28-9623-516f9bbaa243 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:45:11.648028 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12078bf4-b4ff-414a-a311-8ecf71cd9ef0 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:11.648325 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12078bf4-b4ff-414a-a311-8ecf71cd9ef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:11.648603 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12078bf4-b4ff-414a-a311-8ecf71cd9ef0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:11.649212 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-f632d6b9-5fc3-4c28-9623-516f9bbaa243 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:45:11.649405 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12078bf4-b4ff-414a-a311-8ecf71cd9ef0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:45:11.653903 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12078bf4-b4ff-414a-a311-8ecf71cd9ef0 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:45:11.693744 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 896/1811] 10.222.0.102 () {58 vars in 1127 bytes} [Mon Aug 1 15:45:11 2022] GET /identity/v3/roles => generated 1427 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:45:11.694664 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12078bf4-b4ff-414a-a311-8ecf71cd9ef0 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:45:11.708246 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:45:11.741949 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12078bf4-b4ff-414a-a311-8ecf71cd9ef0 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:45:11.754502 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c67a89a-c462-4c7f-af3a-06288b975525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:45:11.758277 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c67a89a-c462-4c7f-af3a-06288b975525 admin admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:11.759410 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c67a89a-c462-4c7f-af3a-06288b975525 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:11.760193 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c67a89a-c462-4c7f-af3a-06288b975525 admin admin] PATH_INFO: `/v3/projects/74ec82f47d4d40028562eeeff49481af/users/a2761e4e9a2e4b549dbd776f81c3b291/roles/27f5093ac0674d799cdbd17c68482e32` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:11.806789 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c67a89a-c462-4c7f-af3a-06288b975525 admin admin] RBAC: Authorizing `identity:create_grant(project_id=74ec82f47d4d40028562eeeff49481af, user_id=a2761e4e9a2e4b549dbd776f81c3b291, role_id=27f5093ac0674d799cdbd17c68482e32)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:45:11.824379 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f632d6b9-5fc3-4c28-9623-516f9bbaa243 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:45:11.842547 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af72e1f-1e9b-4399-ab2f-d95294bf3c30 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff810b37183c4729859c1b05edff1703', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:45:11.843201 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af72e1f-1e9b-4399-ab2f-d95294bf3c30 service cinder] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:11.843484 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af72e1f-1e9b-4399-ab2f-d95294bf3c30 service cinder] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:11.845666 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af72e1f-1e9b-4399-ab2f-d95294bf3c30 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:11.851524 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c67a89a-c462-4c7f-af3a-06288b975525 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:45:11.873002 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af72e1f-1e9b-4399-ab2f-d95294bf3c30 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:45:11.877013 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af72e1f-1e9b-4399-ab2f-d95294bf3c30 service cinder] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:45:11.897114 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 916/1812] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:45:11 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:45:12.054124 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 897/1813] 10.222.0.102 () {60 vars in 1488 bytes} [Mon Aug 1 15:45:11 2022] PUT /identity/v3/projects/74ec82f47d4d40028562eeeff49481af/users/a2761e4e9a2e4b549dbd776f81c3b291/roles/27f5093ac0674d799cdbd17c68482e32 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:45:12.065876 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50e8ae9-74fb-498c-899c-a340a42df54f None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:12.067062 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50e8ae9-74fb-498c-899c-a340a42df54f None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:12.067602 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50e8ae9-74fb-498c-899c-a340a42df54f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:12.076978 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c67a89a-c462-4c7f-af3a-06288b975525 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:45:12.128412 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-f50e8ae9-74fb-498c-899c-a340a42df54f None None] MFA Rules not processed for user `a2761e4e9a2e4b549dbd776f81c3b291`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:45:12.130752 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-f50e8ae9-74fb-498c-899c-a340a42df54f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:45:12.227663 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c67a89a-c462-4c7f-af3a-06288b975525 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:45:12.239187 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c708bf-fc37-47c2-b4b4-e2c83bfeb295 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff810b37183c4729859c1b05edff1703', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:45:12.241699 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c708bf-fc37-47c2-b4b4-e2c83bfeb295 service cinder] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:12.241963 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c708bf-fc37-47c2-b4b4-e2c83bfeb295 service cinder] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:12.243157 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c708bf-fc37-47c2-b4b4-e2c83bfeb295 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:12.257197 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-a3c708bf-fc37-47c2-b4b4-e2c83bfeb295 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:45:12.347621 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 917/1814] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:45:12 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:45:12.348514 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50e8ae9-74fb-498c-899c-a340a42df54f None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:45:12.349659 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:45:12.521416 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c708bf-fc37-47c2-b4b4-e2c83bfeb295 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:45:12.524492 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c708bf-fc37-47c2-b4b4-e2c83bfeb295 service cinder] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:45:12.573878 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 898/1815] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:45:12 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 495 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 15:45:12.583234 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50e8ae9-74fb-498c-899c-a340a42df54f None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:45:12.590177 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ae11e4-a82a-4f32-ba7a-13a0aae37565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:45:12.591228 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ae11e4-a82a-4f32-ba7a-13a0aae37565 admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:12.591608 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ae11e4-a82a-4f32-ba7a-13a0aae37565 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:12.592332 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ae11e4-a82a-4f32-ba7a-13a0aae37565 admin admin] PATH_INFO: `/v3/projects` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:12.592748 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ae11e4-a82a-4f32-ba7a-13a0aae37565 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:45:12.596842 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ae11e4-a82a-4f32-ba7a-13a0aae37565 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:45:12.768702 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:45:12.774097 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 918/1816] 10.222.0.102 () {60 vars in 1158 bytes} [Mon Aug 1 15:45:12 2022] POST /identity/v3/projects => generated 386 bytes in 426 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:45:12.780788 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c708bf-fc37-47c2-b4b4-e2c83bfeb295 service cinder] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:45:12.800117 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c708bf-fc37-47c2-b4b4-e2c83bfeb295 service cinder] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:45:12.940016 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965873c6-b6cf-4333-a912-cb3f87bc37f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:45:12.941221 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965873c6-b6cf-4333-a912-cb3f87bc37f4 admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:12.947465 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965873c6-b6cf-4333-a912-cb3f87bc37f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:12.947465 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965873c6-b6cf-4333-a912-cb3f87bc37f4 admin admin] PATH_INFO: `/v3/users` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:12.947465 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965873c6-b6cf-4333-a912-cb3f87bc37f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:45:12.947465 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965873c6-b6cf-4333-a912-cb3f87bc37f4 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:45:13.085875 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 899/1817] 10.222.0.102 () {60 vars in 1149 bytes} [Mon Aug 1 15:45:12 2022] POST /identity/v3/users => generated 300 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:45:13.089387 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ae11e4-a82a-4f32-ba7a-13a0aae37565 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:45:13.101633 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ae11e4-a82a-4f32-ba7a-13a0aae37565 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:45:13.107487 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5ee496-d17b-4b89-9572-732a72f1e646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:45:13.108460 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5ee496-d17b-4b89-9572-732a72f1e646 admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:13.108980 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5ee496-d17b-4b89-9572-732a72f1e646 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:13.109469 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5ee496-d17b-4b89-9572-732a72f1e646 admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:13.110674 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5ee496-d17b-4b89-9572-732a72f1e646 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:45:13.112581 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5ee496-d17b-4b89-9572-732a72f1e646 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:45:13.124263 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 919/1818] 10.222.0.102 () {58 vars in 1127 bytes} [Mon Aug 1 15:45:13 2022] GET /identity/v3/roles => generated 1427 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:45:13.129264 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965873c6-b6cf-4333-a912-cb3f87bc37f4 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:45:13.144295 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965873c6-b6cf-4333-a912-cb3f87bc37f4 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:45:13.173688 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbb97bc-d754-41ad-af22-6815665d571c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:45:13.173688 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbb97bc-d754-41ad-af22-6815665d571c admin admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:13.173688 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbb97bc-d754-41ad-af22-6815665d571c admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:13.173688 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbb97bc-d754-41ad-af22-6815665d571c admin admin] PATH_INFO: `/v3/projects/121bde86503c43e9a9bc0820ba45d7aa/users/e6d5a80b83fb4cf080fb10f9106c99e0/roles/de1374f966c04c27b579515b54334fd2` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:13.187185 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbb97bc-d754-41ad-af22-6815665d571c admin admin] RBAC: Authorizing `identity:create_grant(project_id=121bde86503c43e9a9bc0820ba45d7aa, user_id=e6d5a80b83fb4cf080fb10f9106c99e0, role_id=de1374f966c04c27b579515b54334fd2)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:45:13.191035 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbb97bc-d754-41ad-af22-6815665d571c admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:45:13.615424 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 900/1819] 10.222.0.102 () {60 vars in 1488 bytes} [Mon Aug 1 15:45:13 2022] PUT /identity/v3/projects/121bde86503c43e9a9bc0820ba45d7aa/users/e6d5a80b83fb4cf080fb10f9106c99e0/roles/de1374f966c04c27b579515b54334fd2 => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:45:13.617287 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5ee496-d17b-4b89-9572-732a72f1e646 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:45:13.631697 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5ee496-d17b-4b89-9572-732a72f1e646 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:45:13.777809 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f791cf61-9fe0-4fc2-b790-2717cf01bb36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:45:13.780363 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f791cf61-9fe0-4fc2-b790-2717cf01bb36 admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:13.781543 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f791cf61-9fe0-4fc2-b790-2717cf01bb36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:13.782936 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f791cf61-9fe0-4fc2-b790-2717cf01bb36 admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:13.788602 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f791cf61-9fe0-4fc2-b790-2717cf01bb36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:45:13.790496 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f791cf61-9fe0-4fc2-b790-2717cf01bb36 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:45:13.949932 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 920/1820] 10.222.0.102 () {58 vars in 1127 bytes} [Mon Aug 1 15:45:13 2022] GET /identity/v3/roles => generated 1427 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:45:13.951979 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a1b108-a930-4eac-91c6-8bfe950c16ca None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:13.951979 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a1b108-a930-4eac-91c6-8bfe950c16ca None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:13.951979 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a1b108-a930-4eac-91c6-8bfe950c16ca None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:13.951979 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 901/1821] 10.222.0.102 () {54 vars in 926 bytes} [Mon Aug 1 15:45:13 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 15:45:13.952791 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef7e34c-1e44-4d46-8e4d-65ea0099411a None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:13.952791 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef7e34c-1e44-4d46-8e4d-65ea0099411a None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:13.952791 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef7e34c-1e44-4d46-8e4d-65ea0099411a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:13.952791 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-5ef7e34c-1e44-4d46-8e4d-65ea0099411a None None] MFA Rules not processed for user `77b43f1ee8cc4be3907a494abe90c1cc`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:45:13.952791 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-5ef7e34c-1e44-4d46-8e4d-65ea0099411a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:45:13.953293 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a1b108-a930-4eac-91c6-8bfe950c16ca None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:45:14.054548 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a1b108-a930-4eac-91c6-8bfe950c16ca None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:45:14.070964 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d91194-7b95-4644-9f47-4b93a5d8f135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:45:14.071753 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d91194-7b95-4644-9f47-4b93a5d8f135 admin admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:14.072013 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d91194-7b95-4644-9f47-4b93a5d8f135 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:14.072295 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d91194-7b95-4644-9f47-4b93a5d8f135 admin admin] PATH_INFO: `/v3/projects/121bde86503c43e9a9bc0820ba45d7aa/users/e6d5a80b83fb4cf080fb10f9106c99e0/roles/de1374f966c04c27b579515b54334fd2` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:14.079075 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d91194-7b95-4644-9f47-4b93a5d8f135 admin admin] RBAC: Authorizing `identity:create_grant(project_id=121bde86503c43e9a9bc0820ba45d7aa, user_id=e6d5a80b83fb4cf080fb10f9106c99e0, role_id=de1374f966c04c27b579515b54334fd2)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:45:14.081445 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d91194-7b95-4644-9f47-4b93a5d8f135 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:45:14.153793 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 921/1822] 10.222.0.102 () {58 vars in 1023 bytes} [Mon Aug 1 15:45:13 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:45:14.164906 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 902/1823] 10.222.0.102 () {60 vars in 1488 bytes} [Mon Aug 1 15:45:13 2022] PUT /identity/v3/projects/121bde86503c43e9a9bc0820ba45d7aa/users/e6d5a80b83fb4cf080fb10f9106c99e0/roles/de1374f966c04c27b579515b54334fd2 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:45:14.170547 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c9c90a-42ce-4039-a213-fc2aa9000ac0 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:14.171193 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c9c90a-42ce-4039-a213-fc2aa9000ac0 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:14.171606 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c9c90a-42ce-4039-a213-fc2aa9000ac0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:14.208568 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-80c9c90a-42ce-4039-a213-fc2aa9000ac0 None None] MFA Rules not processed for user `e6d5a80b83fb4cf080fb10f9106c99e0`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:45:14.209940 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-80c9c90a-42ce-4039-a213-fc2aa9000ac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:45:14.299492 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 922/1824] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:45:14 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 15:45:14.314672 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d91194-7b95-4644-9f47-4b93a5d8f135 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:45:14.318088 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10bd926-8bdc-4719-a901-3a9d4fde7bac None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:14.318469 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10bd926-8bdc-4719-a901-3a9d4fde7bac None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:14.318647 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10bd926-8bdc-4719-a901-3a9d4fde7bac None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:14.320024 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 923/1825] 10.222.0.102 () {54 vars in 926 bytes} [Mon Aug 1 15:45:14 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 15:45:14.361799 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d406eb0-0c56-4b80-b3ac-ed041bd02afd None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:14.368341 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d406eb0-0c56-4b80-b3ac-ed041bd02afd None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:14.368341 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d406eb0-0c56-4b80-b3ac-ed041bd02afd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:14.396415 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-0d406eb0-0c56-4b80-b3ac-ed041bd02afd None None] MFA Rules not processed for user `77b43f1ee8cc4be3907a494abe90c1cc`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:45:14.398564 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-0d406eb0-0c56-4b80-b3ac-ed041bd02afd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:45:14.492882 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d91194-7b95-4644-9f47-4b93a5d8f135 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:45:14.499545 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfce278-6523-4dc6-8268-a9b43f9c3080 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff810b37183c4729859c1b05edff1703', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:45:14.500266 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfce278-6523-4dc6-8268-a9b43f9c3080 service cinder] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:14.501754 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfce278-6523-4dc6-8268-a9b43f9c3080 service cinder] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:14.502030 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfce278-6523-4dc6-8268-a9b43f9c3080 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:14.535850 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfce278-6523-4dc6-8268-a9b43f9c3080 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:45:14.538225 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfce278-6523-4dc6-8268-a9b43f9c3080 service cinder] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:45:14.584045 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 903/1826] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:45:14 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:45:14.584952 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfce278-6523-4dc6-8268-a9b43f9c3080 service cinder] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:45:14.604677 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-acfce278-6523-4dc6-8268-a9b43f9c3080 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:45:14.638864 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 924/1827] 10.222.0.102 () {58 vars in 1023 bytes} [Mon Aug 1 15:45:14 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:45:14.654413 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfce278-6523-4dc6-8268-a9b43f9c3080 service cinder] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:45:14.666879 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1a03e8-8a3a-4e56-99ec-2448b329e3ad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77b43f1ee8cc4be3907a494abe90c1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:45:14.667705 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1a03e8-8a3a-4e56-99ec-2448b329e3ad service nova] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:14.668217 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1a03e8-8a3a-4e56-99ec-2448b329e3ad service nova] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:14.668887 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1a03e8-8a3a-4e56-99ec-2448b329e3ad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:14.679885 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1a03e8-8a3a-4e56-99ec-2448b329e3ad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:45:14.681909 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1a03e8-8a3a-4e56-99ec-2448b329e3ad service nova] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:45:14.695227 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 904/1828] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:45:14 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:45:14.821365 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:45:14.909917 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d406eb0-0c56-4b80-b3ac-ed041bd02afd None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:45:14.929854 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d406eb0-0c56-4b80-b3ac-ed041bd02afd None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:45:14.952968 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7643838-43c2-4354-9533-4601239151c0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77b43f1ee8cc4be3907a494abe90c1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:45:14.955716 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7643838-43c2-4354-9533-4601239151c0 service nova] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:14.956190 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7643838-43c2-4354-9533-4601239151c0 service nova] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:14.956475 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7643838-43c2-4354-9533-4601239151c0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:14.985500 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7643838-43c2-4354-9533-4601239151c0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:45:14.988623 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7643838-43c2-4354-9533-4601239151c0 service nova] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:45:15.030628 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 925/1829] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:45:14 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:45:18.030081 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1a03e8-8a3a-4e56-99ec-2448b329e3ad service nova] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:45:18.046485 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1a03e8-8a3a-4e56-99ec-2448b329e3ad service nova] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:45:18.054731 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4643c5-b6d3-477e-965d-76e9e6c0e87e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff810b37183c4729859c1b05edff1703', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:45:18.055584 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4643c5-b6d3-477e-965d-76e9e6c0e87e service cinder] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:18.055977 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4643c5-b6d3-477e-965d-76e9e6c0e87e service cinder] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:18.056343 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4643c5-b6d3-477e-965d-76e9e6c0e87e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:18.142932 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4643c5-b6d3-477e-965d-76e9e6c0e87e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:45:18.144494 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4643c5-b6d3-477e-965d-76e9e6c0e87e service cinder] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:45:18.188016 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 905/1830] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:45:18 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:45:18.536981 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:45:19.198827 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:45:21.206954 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7643838-43c2-4354-9533-4601239151c0 service nova] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:45:21.268830 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7643838-43c2-4354-9533-4601239151c0 service nova] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:45:21.273278 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b5c8ea-7270-4016-8947-b72396889670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:45:21.273914 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b5c8ea-7270-4016-8947-b72396889670 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:21.274194 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b5c8ea-7270-4016-8947-b72396889670 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:21.274469 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b5c8ea-7270-4016-8947-b72396889670 admin admin] PATH_INFO: `/v3/users/fd748920cbc445398cc522eb3b4408f8` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:21.276099 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b5c8ea-7270-4016-8947-b72396889670 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd748920cbc445398cc522eb3b4408f8)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:45:21.277694 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b5c8ea-7270-4016-8947-b72396889670 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:45:21.509012 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-41b5c8ea-7270-4016-8947-b72396889670 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd748920cbc445398cc522eb3b4408f8'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:45:21.520911 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-41b5c8ea-7270-4016-8947-b72396889670 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd748920cbc445398cc522eb3b4408f8'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:45:21.527817 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-41b5c8ea-7270-4016-8947-b72396889670 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd748920cbc445398cc522eb3b4408f8'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:45:21.528664 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-41b5c8ea-7270-4016-8947-b72396889670 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd748920cbc445398cc522eb3b4408f8'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:45:21.532880 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-41b5c8ea-7270-4016-8947-b72396889670 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd748920cbc445398cc522eb3b4408f8'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:45:21.655635 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 926/1831] 10.222.0.102 () {58 vars in 1229 bytes} [Mon Aug 1 15:45:21 2022] DELETE /identity/v3/users/fd748920cbc445398cc522eb3b4408f8 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:45:21.662782 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3181d817-c496-407b-86d3-63635358feba None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:21.662782 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3181d817-c496-407b-86d3-63635358feba None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:21.663562 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3181d817-c496-407b-86d3-63635358feba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:21.682635 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-3181d817-c496-407b-86d3-63635358feba None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:45:21.684068 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-3181d817-c496-407b-86d3-63635358feba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:45:21.752328 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 906/1832] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:45:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 15:45:21.762314 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b5c8ea-7270-4016-8947-b72396889670 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:45:21.764040 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-41b5c8ea-7270-4016-8947-b72396889670 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:45:21.825771 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b5c8ea-7270-4016-8947-b72396889670 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:45:21.829753 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3279297-e8cd-4675-9333-932165efc531 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a856a413100443939fe9b10daa868518', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:45:21.830364 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3279297-e8cd-4675-9333-932165efc531 service neutron] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:21.830641 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3279297-e8cd-4675-9333-932165efc531 service neutron] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:21.830915 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3279297-e8cd-4675-9333-932165efc531 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:21.840308 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3279297-e8cd-4675-9333-932165efc531 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:45:21.841906 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3279297-e8cd-4675-9333-932165efc531 service neutron] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:45:21.855626 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 927/1833] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:45:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:45:22.665342 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:45:22.746002 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:45:22.779077 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3181d817-c496-407b-86d3-63635358feba None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:45:22.780519 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-3181d817-c496-407b-86d3-63635358feba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:45:22.802520 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3181d817-c496-407b-86d3-63635358feba None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:45:22.810604 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7faf44-3936-4528-9123-e9ee88c82f57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:45:22.811796 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7faf44-3936-4528-9123-e9ee88c82f57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:22.812239 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7faf44-3936-4528-9123-e9ee88c82f57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:22.812900 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7faf44-3936-4528-9123-e9ee88c82f57 admin admin] PATH_INFO: `/v3/users/ae3dcda8c8cd48029a1a4286aa8ec5cd` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:22.815475 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7faf44-3936-4528-9123-e9ee88c82f57 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae3dcda8c8cd48029a1a4286aa8ec5cd)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:45:22.818990 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7faf44-3936-4528-9123-e9ee88c82f57 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:45:22.884996 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3279297-e8cd-4675-9333-932165efc531 service neutron] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:45:22.893147 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-f3279297-e8cd-4675-9333-932165efc531 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:45:22.915009 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3279297-e8cd-4675-9333-932165efc531 service neutron] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:45:22.918753 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67e7cf0-da8b-4eb8-8716-c2224ee65b72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:45:22.921021 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67e7cf0-da8b-4eb8-8716-c2224ee65b72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:22.921316 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67e7cf0-da8b-4eb8-8716-c2224ee65b72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:22.921595 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67e7cf0-da8b-4eb8-8716-c2224ee65b72 admin admin] PATH_INFO: `/v3/projects/0e773c0bbedb4e55b67308934847e31e` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:22.922964 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67e7cf0-da8b-4eb8-8716-c2224ee65b72 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e773c0bbedb4e55b67308934847e31e)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:45:22.929480 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67e7cf0-da8b-4eb8-8716-c2224ee65b72 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:45:23.122206 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-2a7faf44-3936-4528-9123-e9ee88c82f57 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae3dcda8c8cd48029a1a4286aa8ec5cd'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:45:23.124023 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-f67e7cf0-da8b-4eb8-8716-c2224ee65b72 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e773c0bbedb4e55b67308934847e31e', 'request_id': 'req-f67e7cf0-da8b-4eb8-8716-c2224ee65b72'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:45:23.131698 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-f67e7cf0-da8b-4eb8-8716-c2224ee65b72 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e773c0bbedb4e55b67308934847e31e', 'request_id': 'req-f67e7cf0-da8b-4eb8-8716-c2224ee65b72'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:45:23.230932 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-2a7faf44-3936-4528-9123-e9ee88c82f57 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae3dcda8c8cd48029a1a4286aa8ec5cd'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:45:23.246946 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-2a7faf44-3936-4528-9123-e9ee88c82f57 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae3dcda8c8cd48029a1a4286aa8ec5cd'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:45:23.247697 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-2a7faf44-3936-4528-9123-e9ee88c82f57 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae3dcda8c8cd48029a1a4286aa8ec5cd'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:45:23.248315 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-2a7faf44-3936-4528-9123-e9ee88c82f57 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae3dcda8c8cd48029a1a4286aa8ec5cd'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:45:23.270072 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 907/1834] 10.222.0.102 () {58 vars in 1229 bytes} [Mon Aug 1 15:45:22 2022] DELETE /identity/v3/users/ae3dcda8c8cd48029a1a4286aa8ec5cd => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:45:23.275157 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c9c975-3a57-42bf-8cc1-0958ac7a012f None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:23.275515 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c9c975-3a57-42bf-8cc1-0958ac7a012f None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:23.275856 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c9c975-3a57-42bf-8cc1-0958ac7a012f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:23.287649 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-f67e7cf0-da8b-4eb8-8716-c2224ee65b72 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e773c0bbedb4e55b67308934847e31e', 'request_id': 'req-f67e7cf0-da8b-4eb8-8716-c2224ee65b72'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:45:23.297521 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-24c9c975-3a57-42bf-8cc1-0958ac7a012f None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:45:23.299341 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-24c9c975-3a57-42bf-8cc1-0958ac7a012f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:45:23.301396 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-f67e7cf0-da8b-4eb8-8716-c2224ee65b72 admin admin] The token cache is being invalidate because project 0e773c0bbedb4e55b67308934847e31e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80352) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 15:45:23.301867 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-f67e7cf0-da8b-4eb8-8716-c2224ee65b72 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:45:23.302558 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-f67e7cf0-da8b-4eb8-8716-c2224ee65b72 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:45:23.304585 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 928/1835] 10.222.0.102 () {58 vars in 1238 bytes} [Mon Aug 1 15:45:22 2022] DELETE /identity/v3/projects/0e773c0bbedb4e55b67308934847e31e => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 15:45:23.308241 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67e7cf0-da8b-4eb8-8716-c2224ee65b72 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:45:23.309617 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-f67e7cf0-da8b-4eb8-8716-c2224ee65b72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:45:23.367507 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 908/1836] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:45:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:45:23.384070 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c9c975-3a57-42bf-8cc1-0958ac7a012f None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:45:23.384070 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-24c9c975-3a57-42bf-8cc1-0958ac7a012f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:45:23.431820 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67e7cf0-da8b-4eb8-8716-c2224ee65b72 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:45:23.446945 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3418bb9-d324-46df-a4fc-33f68df68be6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:45:23.447811 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3418bb9-d324-46df-a4fc-33f68df68be6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:23.448089 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3418bb9-d324-46df-a4fc-33f68df68be6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:23.449516 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3418bb9-d324-46df-a4fc-33f68df68be6 admin admin] PATH_INFO: `/v3/users/ca6e3bd5d5d649b988bb95c2278c18d0` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:23.450834 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3418bb9-d324-46df-a4fc-33f68df68be6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca6e3bd5d5d649b988bb95c2278c18d0)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:45:23.452460 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c9c975-3a57-42bf-8cc1-0958ac7a012f None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:45:23.454327 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3418bb9-d324-46df-a4fc-33f68df68be6 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:45:23.457728 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1295c91f-e73b-4e93-9ff4-a0225b76c106 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a856a413100443939fe9b10daa868518', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:45:23.458364 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1295c91f-e73b-4e93-9ff4-a0225b76c106 service neutron] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:23.458657 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1295c91f-e73b-4e93-9ff4-a0225b76c106 service neutron] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:23.458914 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1295c91f-e73b-4e93-9ff4-a0225b76c106 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:23.469393 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1295c91f-e73b-4e93-9ff4-a0225b76c106 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:45:23.471678 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1295c91f-e73b-4e93-9ff4-a0225b76c106 service neutron] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:45:23.482773 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 909/1837] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:45:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:45:23.673295 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-f3418bb9-d324-46df-a4fc-33f68df68be6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca6e3bd5d5d649b988bb95c2278c18d0'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:45:23.689655 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-f3418bb9-d324-46df-a4fc-33f68df68be6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca6e3bd5d5d649b988bb95c2278c18d0'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:45:23.697992 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-f3418bb9-d324-46df-a4fc-33f68df68be6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca6e3bd5d5d649b988bb95c2278c18d0'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:45:23.700590 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-f3418bb9-d324-46df-a4fc-33f68df68be6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca6e3bd5d5d649b988bb95c2278c18d0'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:45:23.700590 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-f3418bb9-d324-46df-a4fc-33f68df68be6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca6e3bd5d5d649b988bb95c2278c18d0'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:45:23.837554 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 929/1838] 10.222.0.102 () {58 vars in 1229 bytes} [Mon Aug 1 15:45:23 2022] DELETE /identity/v3/users/ca6e3bd5d5d649b988bb95c2278c18d0 => generated 0 bytes in 530 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:45:23.925075 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1295c91f-e73b-4e93-9ff4-a0225b76c106 service neutron] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:45:23.928526 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-1295c91f-e73b-4e93-9ff4-a0225b76c106 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:45:23.948179 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1295c91f-e73b-4e93-9ff4-a0225b76c106 service neutron] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:45:24.020817 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df5e98a-cbde-4e75-bcf3-6ea5e9a075fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:45:24.020817 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df5e98a-cbde-4e75-bcf3-6ea5e9a075fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:24.020817 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df5e98a-cbde-4e75-bcf3-6ea5e9a075fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:24.020817 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df5e98a-cbde-4e75-bcf3-6ea5e9a075fb admin admin] PATH_INFO: `/v3/projects/059bac2dc3d541859196e165b3fd36e4` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:24.021878 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df5e98a-cbde-4e75-bcf3-6ea5e9a075fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=059bac2dc3d541859196e165b3fd36e4)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:45:24.023805 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df5e98a-cbde-4e75-bcf3-6ea5e9a075fb admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:45:24.134755 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-1df5e98a-cbde-4e75-bcf3-6ea5e9a075fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '059bac2dc3d541859196e165b3fd36e4', 'request_id': 'req-1df5e98a-cbde-4e75-bcf3-6ea5e9a075fb'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:45:24.203804 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-1df5e98a-cbde-4e75-bcf3-6ea5e9a075fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '059bac2dc3d541859196e165b3fd36e4', 'request_id': 'req-1df5e98a-cbde-4e75-bcf3-6ea5e9a075fb'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:45:24.210700 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-1df5e98a-cbde-4e75-bcf3-6ea5e9a075fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '059bac2dc3d541859196e165b3fd36e4', 'request_id': 'req-1df5e98a-cbde-4e75-bcf3-6ea5e9a075fb'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:45:24.222069 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-1df5e98a-cbde-4e75-bcf3-6ea5e9a075fb admin admin] The token cache is being invalidate because project 059bac2dc3d541859196e165b3fd36e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80353) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 15:45:24.222824 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-1df5e98a-cbde-4e75-bcf3-6ea5e9a075fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:45:24.223513 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-1df5e98a-cbde-4e75-bcf3-6ea5e9a075fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:45:24.225168 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 910/1839] 10.222.0.102 () {58 vars in 1238 bytes} [Mon Aug 1 15:45:23 2022] DELETE /identity/v3/projects/059bac2dc3d541859196e165b3fd36e4 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:45:24.229291 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3418bb9-d324-46df-a4fc-33f68df68be6 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:45:24.230841 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-f3418bb9-d324-46df-a4fc-33f68df68be6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:45:24.246006 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3418bb9-d324-46df-a4fc-33f68df68be6 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:45:24.302872 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db97b08a-58d6-47f1-872b-648fdfc96dfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:45:24.303520 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db97b08a-58d6-47f1-872b-648fdfc96dfb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:24.303804 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db97b08a-58d6-47f1-872b-648fdfc96dfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:24.304078 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db97b08a-58d6-47f1-872b-648fdfc96dfb admin admin] PATH_INFO: `/v3/users/4043273ee0bc429fa61ce10e0d3a579c` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:24.305284 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db97b08a-58d6-47f1-872b-648fdfc96dfb admin admin] RBAC: Authorizing `identity:delete_user(user_id=4043273ee0bc429fa61ce10e0d3a579c)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:45:24.307219 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db97b08a-58d6-47f1-872b-648fdfc96dfb admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:45:24.325541 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df5e98a-cbde-4e75-bcf3-6ea5e9a075fb admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:45:24.329573 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-1df5e98a-cbde-4e75-bcf3-6ea5e9a075fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:45:24.341307 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df5e98a-cbde-4e75-bcf3-6ea5e9a075fb admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:45:24.347457 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d43ad7-52a5-4fcb-89f1-4810764c9e7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:45:24.352525 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d43ad7-52a5-4fcb-89f1-4810764c9e7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:24.352525 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d43ad7-52a5-4fcb-89f1-4810764c9e7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:24.352525 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d43ad7-52a5-4fcb-89f1-4810764c9e7e admin admin] PATH_INFO: `/v3/projects/45d2df4ec3da49758233f619c1a76948` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:24.352525 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d43ad7-52a5-4fcb-89f1-4810764c9e7e admin admin] RBAC: Authorizing `identity:delete_project(project_id=45d2df4ec3da49758233f619c1a76948)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:45:24.353281 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d43ad7-52a5-4fcb-89f1-4810764c9e7e admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:45:24.555973 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-db97b08a-58d6-47f1-872b-648fdfc96dfb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4043273ee0bc429fa61ce10e0d3a579c'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:45:24.558590 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-93d43ad7-52a5-4fcb-89f1-4810764c9e7e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45d2df4ec3da49758233f619c1a76948', 'request_id': 'req-93d43ad7-52a5-4fcb-89f1-4810764c9e7e'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:45:24.570719 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-db97b08a-58d6-47f1-872b-648fdfc96dfb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4043273ee0bc429fa61ce10e0d3a579c'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:45:24.577948 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-db97b08a-58d6-47f1-872b-648fdfc96dfb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4043273ee0bc429fa61ce10e0d3a579c'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:45:24.578673 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-db97b08a-58d6-47f1-872b-648fdfc96dfb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4043273ee0bc429fa61ce10e0d3a579c'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:45:24.579330 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-db97b08a-58d6-47f1-872b-648fdfc96dfb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4043273ee0bc429fa61ce10e0d3a579c'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:45:24.661461 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:45:24.666550 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-93d43ad7-52a5-4fcb-89f1-4810764c9e7e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45d2df4ec3da49758233f619c1a76948', 'request_id': 'req-93d43ad7-52a5-4fcb-89f1-4810764c9e7e'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:45:24.670269 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-93d43ad7-52a5-4fcb-89f1-4810764c9e7e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45d2df4ec3da49758233f619c1a76948', 'request_id': 'req-93d43ad7-52a5-4fcb-89f1-4810764c9e7e'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:45:24.680904 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-93d43ad7-52a5-4fcb-89f1-4810764c9e7e admin admin] The token cache is being invalidate because project 45d2df4ec3da49758233f619c1a76948 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80353) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 15:45:24.681195 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-93d43ad7-52a5-4fcb-89f1-4810764c9e7e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:45:24.681856 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-93d43ad7-52a5-4fcb-89f1-4810764c9e7e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:45:24.686329 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 911/1840] 10.222.0.102 () {58 vars in 1238 bytes} [Mon Aug 1 15:45:24 2022] DELETE /identity/v3/projects/45d2df4ec3da49758233f619c1a76948 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 15:45:24.687329 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d43ad7-52a5-4fcb-89f1-4810764c9e7e admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:45:24.688644 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-93d43ad7-52a5-4fcb-89f1-4810764c9e7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:45:24.751719 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d43ad7-52a5-4fcb-89f1-4810764c9e7e admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:45:24.756623 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5bb6c2-f1ff-4d72-85d3-454ac32714cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:45:24.757349 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5bb6c2-f1ff-4d72-85d3-454ac32714cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:24.757627 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5bb6c2-f1ff-4d72-85d3-454ac32714cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:24.757906 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5bb6c2-f1ff-4d72-85d3-454ac32714cd admin admin] PATH_INFO: `/v3/users/0ba6d140d13d4d7489b9b8d25a44e23d` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:24.759141 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5bb6c2-f1ff-4d72-85d3-454ac32714cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ba6d140d13d4d7489b9b8d25a44e23d)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:45:24.761197 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5bb6c2-f1ff-4d72-85d3-454ac32714cd admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:45:24.765783 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 930/1841] 10.222.0.102 () {58 vars in 1229 bytes} [Mon Aug 1 15:45:24 2022] DELETE /identity/v3/users/4043273ee0bc429fa61ce10e0d3a579c => generated 0 bytes in 537 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:45:25.051492 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-cd5bb6c2-f1ff-4d72-85d3-454ac32714cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ba6d140d13d4d7489b9b8d25a44e23d'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:45:25.146892 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-cd5bb6c2-f1ff-4d72-85d3-454ac32714cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ba6d140d13d4d7489b9b8d25a44e23d'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:45:25.174826 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-cd5bb6c2-f1ff-4d72-85d3-454ac32714cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ba6d140d13d4d7489b9b8d25a44e23d'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:45:25.175573 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-cd5bb6c2-f1ff-4d72-85d3-454ac32714cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ba6d140d13d4d7489b9b8d25a44e23d'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:45:25.176190 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-cd5bb6c2-f1ff-4d72-85d3-454ac32714cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ba6d140d13d4d7489b9b8d25a44e23d'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:45:25.188436 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 912/1842] 10.222.0.102 () {58 vars in 1229 bytes} [Mon Aug 1 15:45:24 2022] DELETE /identity/v3/users/0ba6d140d13d4d7489b9b8d25a44e23d => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 15:45:25.354245 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db97b08a-58d6-47f1-872b-648fdfc96dfb admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:45:25.355804 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-db97b08a-58d6-47f1-872b-648fdfc96dfb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:45:25.421534 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db97b08a-58d6-47f1-872b-648fdfc96dfb admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:45:25.465062 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:45:25.487228 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd3382b-7bc2-4f9f-9c7c-7330e5d6a7d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:45:25.487228 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd3382b-7bc2-4f9f-9c7c-7330e5d6a7d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:25.487228 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd3382b-7bc2-4f9f-9c7c-7330e5d6a7d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:25.487228 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd3382b-7bc2-4f9f-9c7c-7330e5d6a7d3 admin admin] PATH_INFO: `/v3/projects/d50e61c618974f5b84c0d33495f63e05` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:25.488509 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd3382b-7bc2-4f9f-9c7c-7330e5d6a7d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d50e61c618974f5b84c0d33495f63e05)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:45:25.490945 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd3382b-7bc2-4f9f-9c7c-7330e5d6a7d3 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:45:25.628200 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-4cd3382b-7bc2-4f9f-9c7c-7330e5d6a7d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd50e61c618974f5b84c0d33495f63e05', 'request_id': 'req-4cd3382b-7bc2-4f9f-9c7c-7330e5d6a7d3'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:45:25.635913 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-4cd3382b-7bc2-4f9f-9c7c-7330e5d6a7d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd50e61c618974f5b84c0d33495f63e05', 'request_id': 'req-4cd3382b-7bc2-4f9f-9c7c-7330e5d6a7d3'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:45:25.707106 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-4cd3382b-7bc2-4f9f-9c7c-7330e5d6a7d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd50e61c618974f5b84c0d33495f63e05', 'request_id': 'req-4cd3382b-7bc2-4f9f-9c7c-7330e5d6a7d3'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:45:25.725270 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-4cd3382b-7bc2-4f9f-9c7c-7330e5d6a7d3 admin admin] The token cache is being invalidate because project d50e61c618974f5b84c0d33495f63e05 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80352) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 15:45:25.725576 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-4cd3382b-7bc2-4f9f-9c7c-7330e5d6a7d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:45:25.727321 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-4cd3382b-7bc2-4f9f-9c7c-7330e5d6a7d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:45:25.730502 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 931/1843] 10.222.0.102 () {58 vars in 1238 bytes} [Mon Aug 1 15:45:25 2022] DELETE /identity/v3/projects/d50e61c618974f5b84c0d33495f63e05 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:45:25.735213 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99fb8ba-9aea-4e0e-98a5-ff9b438e09af None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:25.740158 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99fb8ba-9aea-4e0e-98a5-ff9b438e09af None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:25.740158 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99fb8ba-9aea-4e0e-98a5-ff9b438e09af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:25.765640 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-a99fb8ba-9aea-4e0e-98a5-ff9b438e09af None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:45:25.767183 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-a99fb8ba-9aea-4e0e-98a5-ff9b438e09af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:45:25.848210 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 913/1844] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:45:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:45:25.856743 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b3c06f-452d-4152-af2e-b82359f9a815 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:25.858937 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b3c06f-452d-4152-af2e-b82359f9a815 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:25.858937 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b3c06f-452d-4152-af2e-b82359f9a815 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:25.888479 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-a5b3c06f-452d-4152-af2e-b82359f9a815 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:45:25.890028 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-a5b3c06f-452d-4152-af2e-b82359f9a815 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:45:25.900801 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 932/1845] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:45:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:45:25.905566 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99fb8ba-9aea-4e0e-98a5-ff9b438e09af None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:45:25.916834 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99fb8ba-9aea-4e0e-98a5-ff9b438e09af None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:45:25.922135 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fb93a3-33c3-4b76-9c05-9c79f956bb6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:45:25.922856 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fb93a3-33c3-4b76-9c05-9c79f956bb6e admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:25.923212 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fb93a3-33c3-4b76-9c05-9c79f956bb6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:25.924083 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fb93a3-33c3-4b76-9c05-9c79f956bb6e admin admin] PATH_INFO: `/v3/domains` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:25.924787 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fb93a3-33c3-4b76-9c05-9c79f956bb6e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:45:25.925202 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fb93a3-33c3-4b76-9c05-9c79f956bb6e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:45:25.926907 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fb93a3-33c3-4b76-9c05-9c79f956bb6e admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:45:25.948042 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b3c06f-452d-4152-af2e-b82359f9a815 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:45:25.961751 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-a5b3c06f-452d-4152-af2e-b82359f9a815 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:45:25.968511 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=89,keystone:INSERT=5,keystone:DELETE=6 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:45:25.974144 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 914/1846] 10.222.0.102 () {58 vars in 1158 bytes} [Mon Aug 1 15:45:25 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:45:25.975045 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fb93a3-33c3-4b76-9c05-9c79f956bb6e admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:45:25.989914 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b3c06f-452d-4152-af2e-b82359f9a815 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:45:25.997092 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fb93a3-33c3-4b76-9c05-9c79f956bb6e admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:45:25.997592 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ccb470-40f5-468c-b74b-4fc1b277b53e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:45:25.997993 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6866e2-87ea-4583-ac31-ff4a50aa1e5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:45:25.998283 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ccb470-40f5-468c-b74b-4fc1b277b53e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:25.998283 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ccb470-40f5-468c-b74b-4fc1b277b53e admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:25.998416 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6866e2-87ea-4583-ac31-ff4a50aa1e5c admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:25.998493 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ccb470-40f5-468c-b74b-4fc1b277b53e admin admin] PATH_INFO: `/v3/projects/49bfdaf6bcf0402ca789b501364e336f` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:25.998564 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6866e2-87ea-4583-ac31-ff4a50aa1e5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:25.998564 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6866e2-87ea-4583-ac31-ff4a50aa1e5c admin admin] PATH_INFO: `/v3/projects` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:25.998683 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ccb470-40f5-468c-b74b-4fc1b277b53e admin admin] RBAC: Authorizing `identity:delete_project(project_id=49bfdaf6bcf0402ca789b501364e336f)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:45:25.998750 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6866e2-87ea-4583-ac31-ff4a50aa1e5c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:45:26.000373 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6866e2-87ea-4583-ac31-ff4a50aa1e5c admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:45:26.000695 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ccb470-40f5-468c-b74b-4fc1b277b53e admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:45:26.143548 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 915/1847] 10.222.0.102 () {60 vars in 1158 bytes} [Mon Aug 1 15:45:25 2022] POST /identity/v3/projects => generated 356 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:45:26.145469 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6866e2-87ea-4583-ac31-ff4a50aa1e5c admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:45:26.151024 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-4e6866e2-87ea-4583-ac31-ff4a50aa1e5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:45:26.157602 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-d4ccb470-40f5-468c-b74b-4fc1b277b53e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49bfdaf6bcf0402ca789b501364e336f', 'request_id': 'req-d4ccb470-40f5-468c-b74b-4fc1b277b53e'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:45:26.164688 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-d4ccb470-40f5-468c-b74b-4fc1b277b53e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49bfdaf6bcf0402ca789b501364e336f', 'request_id': 'req-d4ccb470-40f5-468c-b74b-4fc1b277b53e'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:45:26.211681 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6866e2-87ea-4583-ac31-ff4a50aa1e5c admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:45:26.213372 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-d4ccb470-40f5-468c-b74b-4fc1b277b53e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49bfdaf6bcf0402ca789b501364e336f', 'request_id': 'req-d4ccb470-40f5-468c-b74b-4fc1b277b53e'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:45:26.215772 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98a137d-d7d3-4513-bd1f-73d6fe3796d9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff810b37183c4729859c1b05edff1703', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:45:26.216659 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98a137d-d7d3-4513-bd1f-73d6fe3796d9 service cinder] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:26.216973 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98a137d-d7d3-4513-bd1f-73d6fe3796d9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:26.217251 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98a137d-d7d3-4513-bd1f-73d6fe3796d9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:26.219123 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-b98a137d-d7d3-4513-bd1f-73d6fe3796d9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:45:26.225952 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-d4ccb470-40f5-468c-b74b-4fc1b277b53e admin admin] The token cache is being invalidate because project 49bfdaf6bcf0402ca789b501364e336f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80352) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 15:45:26.227676 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-d4ccb470-40f5-468c-b74b-4fc1b277b53e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:45:26.227676 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-d4ccb470-40f5-468c-b74b-4fc1b277b53e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:45:26.228557 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 933/1848] 10.222.0.102 () {58 vars in 1238 bytes} [Mon Aug 1 15:45:25 2022] DELETE /identity/v3/projects/49bfdaf6bcf0402ca789b501364e336f => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:45:26.229504 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ccb470-40f5-468c-b74b-4fc1b277b53e admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:45:26.230800 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-d4ccb470-40f5-468c-b74b-4fc1b277b53e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:45:26.303189 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98a137d-d7d3-4513-bd1f-73d6fe3796d9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:45:26.304682 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98a137d-d7d3-4513-bd1f-73d6fe3796d9 service cinder] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:45:26.316477 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 916/1849] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:45:26 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:45:26.317894 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a5bb0d-3a76-4aa3-8cbe-9ed01f315df9 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:26.318189 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a5bb0d-3a76-4aa3-8cbe-9ed01f315df9 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:26.318583 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a5bb0d-3a76-4aa3-8cbe-9ed01f315df9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:26.327889 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ccb470-40f5-468c-b74b-4fc1b277b53e admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:45:26.341542 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-69a5bb0d-3a76-4aa3-8cbe-9ed01f315df9 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:45:26.342753 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-69a5bb0d-3a76-4aa3-8cbe-9ed01f315df9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:45:26.391759 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71c9fa8-d869-4798-87f8-2ae2f6b092a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:45:26.392485 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71c9fa8-d869-4798-87f8-2ae2f6b092a7 admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:26.393326 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71c9fa8-d869-4798-87f8-2ae2f6b092a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:26.393710 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71c9fa8-d869-4798-87f8-2ae2f6b092a7 admin admin] PATH_INFO: `/v3/users` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:26.394525 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71c9fa8-d869-4798-87f8-2ae2f6b092a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:45:26.396909 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71c9fa8-d869-4798-87f8-2ae2f6b092a7 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:45:26.420216 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 917/1850] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:45:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:45:26.428441 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce8dbdb-eb39-4c4d-b670-8fd527a6d445 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:26.430519 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce8dbdb-eb39-4c4d-b670-8fd527a6d445 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:26.430519 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce8dbdb-eb39-4c4d-b670-8fd527a6d445 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:26.449066 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-dce8dbdb-eb39-4c4d-b670-8fd527a6d445 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:45:26.450262 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-dce8dbdb-eb39-4c4d-b670-8fd527a6d445 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:45:26.459216 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 918/1851] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:45:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 15:45:26.463395 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce8dbdb-eb39-4c4d-b670-8fd527a6d445 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:45:26.472235 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce8dbdb-eb39-4c4d-b670-8fd527a6d445 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:45:26.476862 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e594bfe4-190f-4d64-8f32-1cc4c38a4c16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:45:26.477482 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e594bfe4-190f-4d64-8f32-1cc4c38a4c16 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:26.477764 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e594bfe4-190f-4d64-8f32-1cc4c38a4c16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:26.478039 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e594bfe4-190f-4d64-8f32-1cc4c38a4c16 admin admin] PATH_INFO: `/v3/domains` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:26.478746 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e594bfe4-190f-4d64-8f32-1cc4c38a4c16 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:45:26.479056 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e594bfe4-190f-4d64-8f32-1cc4c38a4c16 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:45:26.480822 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e594bfe4-190f-4d64-8f32-1cc4c38a4c16 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:45:26.496130 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 919/1852] 10.222.0.102 () {58 vars in 1158 bytes} [Mon Aug 1 15:45:26 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:45:26.497211 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e594bfe4-190f-4d64-8f32-1cc4c38a4c16 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:45:26.507887 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e594bfe4-190f-4d64-8f32-1cc4c38a4c16 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:45:26.513355 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d734b3c-7c3d-47ec-96e4-4568e1f59939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:45:26.513908 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d734b3c-7c3d-47ec-96e4-4568e1f59939 admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:26.514186 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d734b3c-7c3d-47ec-96e4-4568e1f59939 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:26.514628 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d734b3c-7c3d-47ec-96e4-4568e1f59939 admin admin] PATH_INFO: `/v3/projects` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:26.515436 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d734b3c-7c3d-47ec-96e4-4568e1f59939 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:45:26.517320 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d734b3c-7c3d-47ec-96e4-4568e1f59939 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:45:26.540367 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 934/1853] 10.222.0.102 () {60 vars in 1149 bytes} [Mon Aug 1 15:45:26 2022] POST /identity/v3/users => generated 279 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:45:26.544258 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71c9fa8-d869-4798-87f8-2ae2f6b092a7 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:45:26.554723 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71c9fa8-d869-4798-87f8-2ae2f6b092a7 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:45:26.559528 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d36687c-ea06-45e8-bfbc-1b237b7f583a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:45:26.560132 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d36687c-ea06-45e8-bfbc-1b237b7f583a admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:26.568686 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d36687c-ea06-45e8-bfbc-1b237b7f583a admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:26.568686 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d36687c-ea06-45e8-bfbc-1b237b7f583a admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:26.568686 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d36687c-ea06-45e8-bfbc-1b237b7f583a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:45:26.568686 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d36687c-ea06-45e8-bfbc-1b237b7f583a admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:45:26.577348 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 935/1854] 10.222.0.102 () {58 vars in 1127 bytes} [Mon Aug 1 15:45:26 2022] GET /identity/v3/roles => generated 1427 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 15:45:26.578350 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d36687c-ea06-45e8-bfbc-1b237b7f583a admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:45:26.588015 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d36687c-ea06-45e8-bfbc-1b237b7f583a admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:45:26.592738 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0016b7e4-287a-4992-b2af-c8e9a3ea6f57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:45:26.593299 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0016b7e4-287a-4992-b2af-c8e9a3ea6f57 admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:26.593577 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0016b7e4-287a-4992-b2af-c8e9a3ea6f57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:26.593886 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0016b7e4-287a-4992-b2af-c8e9a3ea6f57 admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:26.594540 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0016b7e4-287a-4992-b2af-c8e9a3ea6f57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:45:26.596739 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0016b7e4-287a-4992-b2af-c8e9a3ea6f57 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:45:26.607944 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 936/1855] 10.222.0.102 () {58 vars in 1127 bytes} [Mon Aug 1 15:45:26 2022] GET /identity/v3/roles => generated 1427 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 15:45:26.612518 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0016b7e4-287a-4992-b2af-c8e9a3ea6f57 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:45:26.626679 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 920/1856] 10.222.0.102 () {60 vars in 1158 bytes} [Mon Aug 1 15:45:26 2022] POST /identity/v3/projects => generated 384 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 15:45:26.626887 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0016b7e4-287a-4992-b2af-c8e9a3ea6f57 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:45:26.627741 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d734b3c-7c3d-47ec-96e4-4568e1f59939 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:45:26.699865 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d79c047-7c0b-437d-9c46-85847a604704 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:45:26.701220 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d79c047-7c0b-437d-9c46-85847a604704 admin admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:26.702016 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d79c047-7c0b-437d-9c46-85847a604704 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:26.703438 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d79c047-7c0b-437d-9c46-85847a604704 admin admin] PATH_INFO: `/v3/projects/7d0496b7693b4a1fae6fb881645b3981/users/3596fde9478b465cb000c2f3d2f7f194/roles/27f5093ac0674d799cdbd17c68482e32` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:26.708277 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d734b3c-7c3d-47ec-96e4-4568e1f59939 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:45:26.712617 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a19fe5-fd02-4bbe-ac5e-282b30e97d6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:45:26.713373 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a19fe5-fd02-4bbe-ac5e-282b30e97d6e admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:26.713725 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a19fe5-fd02-4bbe-ac5e-282b30e97d6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:26.714086 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a19fe5-fd02-4bbe-ac5e-282b30e97d6e admin admin] PATH_INFO: `/v3/users` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:26.715240 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a19fe5-fd02-4bbe-ac5e-282b30e97d6e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:45:26.717311 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a19fe5-fd02-4bbe-ac5e-282b30e97d6e admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:45:26.725081 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d79c047-7c0b-437d-9c46-85847a604704 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d0496b7693b4a1fae6fb881645b3981, user_id=3596fde9478b465cb000c2f3d2f7f194, role_id=27f5093ac0674d799cdbd17c68482e32)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:45:26.728592 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d79c047-7c0b-437d-9c46-85847a604704 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:45:26.844703 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 921/1857] 10.222.0.102 () {60 vars in 1149 bytes} [Mon Aug 1 15:45:26 2022] POST /identity/v3/users => generated 293 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:45:26.848672 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 937/1858] 10.222.0.102 () {60 vars in 1488 bytes} [Mon Aug 1 15:45:26 2022] PUT /identity/v3/projects/7d0496b7693b4a1fae6fb881645b3981/users/3596fde9478b465cb000c2f3d2f7f194/roles/27f5093ac0674d799cdbd17c68482e32 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 15:45:26.857210 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a19fe5-fd02-4bbe-ac5e-282b30e97d6e admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:45:26.858908 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d724e7fa-c587-4f63-99f1-56da06ea413a None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:26.859185 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d724e7fa-c587-4f63-99f1-56da06ea413a None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:26.859519 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d724e7fa-c587-4f63-99f1-56da06ea413a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:26.859856 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a19fe5-fd02-4bbe-ac5e-282b30e97d6e admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:45:26.887795 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-d724e7fa-c587-4f63-99f1-56da06ea413a None None] MFA Rules not processed for user `3596fde9478b465cb000c2f3d2f7f194`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:45:26.889078 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-d724e7fa-c587-4f63-99f1-56da06ea413a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:45:26.922609 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b126e06a-412c-4f04-9d9a-19d579eb3077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:45:26.923576 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b126e06a-412c-4f04-9d9a-19d579eb3077 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:26.923860 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b126e06a-412c-4f04-9d9a-19d579eb3077 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:26.924160 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b126e06a-412c-4f04-9d9a-19d579eb3077 admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:26.924914 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b126e06a-412c-4f04-9d9a-19d579eb3077 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:45:26.926582 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b126e06a-412c-4f04-9d9a-19d579eb3077 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:45:26.938821 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 922/1859] 10.222.0.102 () {58 vars in 1127 bytes} [Mon Aug 1 15:45:26 2022] GET /identity/v3/roles => generated 1427 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 15:45:26.943553 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b126e06a-412c-4f04-9d9a-19d579eb3077 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:45:26.957934 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b126e06a-412c-4f04-9d9a-19d579eb3077 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:45:26.963782 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 938/1860] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:45:26 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 15:45:26.964413 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e2e3bf-fc33-4fa1-b39c-52dc1fb91d66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:45:26.964413 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e2e3bf-fc33-4fa1-b39c-52dc1fb91d66 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:26.964413 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e2e3bf-fc33-4fa1-b39c-52dc1fb91d66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:26.964413 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e2e3bf-fc33-4fa1-b39c-52dc1fb91d66 admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:26.964747 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e2e3bf-fc33-4fa1-b39c-52dc1fb91d66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:45:26.966469 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e2e3bf-fc33-4fa1-b39c-52dc1fb91d66 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:45:26.966828 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d724e7fa-c587-4f63-99f1-56da06ea413a None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:45:26.980127 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 923/1861] 10.222.0.102 () {58 vars in 1127 bytes} [Mon Aug 1 15:45:26 2022] GET /identity/v3/roles => generated 1427 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:45:26.984067 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e2e3bf-fc33-4fa1-b39c-52dc1fb91d66 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:45:26.985435 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d724e7fa-c587-4f63-99f1-56da06ea413a None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:45:26.990776 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2ac7f1-a48f-4edb-91aa-d9ed2ae718b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:45:26.991691 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2ac7f1-a48f-4edb-91aa-d9ed2ae718b4 admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:26.991813 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2ac7f1-a48f-4edb-91aa-d9ed2ae718b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:26.992274 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2ac7f1-a48f-4edb-91aa-d9ed2ae718b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:26.993022 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2ac7f1-a48f-4edb-91aa-d9ed2ae718b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:45:26.994843 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e2e3bf-fc33-4fa1-b39c-52dc1fb91d66 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:45:26.995023 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2ac7f1-a48f-4edb-91aa-d9ed2ae718b4 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:45:27.000173 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3212b905-f2db-4ef0-b292-68960d4d0bfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:45:27.000902 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3212b905-f2db-4ef0-b292-68960d4d0bfb admin admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:27.001167 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3212b905-f2db-4ef0-b292-68960d4d0bfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:27.001449 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3212b905-f2db-4ef0-b292-68960d4d0bfb admin admin] PATH_INFO: `/v3/projects/70ac04fb322b40459c525a82bef3cbb8/users/7d55d8f3ec434c2b9e32fe1c8dc2dea3/roles/27f5093ac0674d799cdbd17c68482e32` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:27.020378 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3212b905-f2db-4ef0-b292-68960d4d0bfb admin admin] RBAC: Authorizing `identity:create_grant(project_id=70ac04fb322b40459c525a82bef3cbb8, user_id=7d55d8f3ec434c2b9e32fe1c8dc2dea3, role_id=27f5093ac0674d799cdbd17c68482e32)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:45:27.022985 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3212b905-f2db-4ef0-b292-68960d4d0bfb admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:45:27.121300 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 924/1862] 10.222.0.102 () {60 vars in 1488 bytes} [Mon Aug 1 15:45:26 2022] PUT /identity/v3/projects/70ac04fb322b40459c525a82bef3cbb8/users/7d55d8f3ec434c2b9e32fe1c8dc2dea3/roles/27f5093ac0674d799cdbd17c68482e32 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 15:45:27.122036 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 939/1863] 10.222.0.102 () {60 vars in 1158 bytes} [Mon Aug 1 15:45:26 2022] POST /identity/v3/projects => generated 358 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 15:45:27.130254 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3212b905-f2db-4ef0-b292-68960d4d0bfb admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:45:27.134207 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8628b769-253b-4d89-9f02-eeb5978d91a5 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:27.134561 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8628b769-253b-4d89-9f02-eeb5978d91a5 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:27.134927 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8628b769-253b-4d89-9f02-eeb5978d91a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:27.169975 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-8628b769-253b-4d89-9f02-eeb5978d91a5 None None] MFA Rules not processed for user `7d55d8f3ec434c2b9e32fe1c8dc2dea3`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:45:27.171324 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-8628b769-253b-4d89-9f02-eeb5978d91a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:45:27.208789 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3212b905-f2db-4ef0-b292-68960d4d0bfb admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:45:27.222361 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:45:27.250375 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 940/1864] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:45:27 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 15:45:27.255346 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8628b769-253b-4d89-9f02-eeb5978d91a5 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:45:27.271416 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187cca14-7d7f-495f-82b6-df0c5872ebee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:45:27.272033 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187cca14-7d7f-495f-82b6-df0c5872ebee admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:27.272313 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187cca14-7d7f-495f-82b6-df0c5872ebee admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:27.272585 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187cca14-7d7f-495f-82b6-df0c5872ebee admin admin] PATH_INFO: `/v3/users` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:27.273296 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187cca14-7d7f-495f-82b6-df0c5872ebee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:45:27.275385 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187cca14-7d7f-495f-82b6-df0c5872ebee admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:45:27.319517 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8628b769-253b-4d89-9f02-eeb5978d91a5 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:45:27.324104 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76897130-e61c-4ebc-98f6-a33ff5296370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:45:27.324748 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76897130-e61c-4ebc-98f6-a33ff5296370 admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:27.325054 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76897130-e61c-4ebc-98f6-a33ff5296370 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:27.325347 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76897130-e61c-4ebc-98f6-a33ff5296370 admin admin] PATH_INFO: `/v3/projects` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:27.326006 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76897130-e61c-4ebc-98f6-a33ff5296370 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:45:27.328221 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76897130-e61c-4ebc-98f6-a33ff5296370 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:45:27.399233 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 925/1865] 10.222.0.102 () {60 vars in 1149 bytes} [Mon Aug 1 15:45:27 2022] POST /identity/v3/users => generated 286 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 15:45:27.403348 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187cca14-7d7f-495f-82b6-df0c5872ebee admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:45:27.413522 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187cca14-7d7f-495f-82b6-df0c5872ebee admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:45:27.419860 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9c2ac4-6b1e-468e-a075-32ea4886f939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:45:27.420583 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9c2ac4-6b1e-468e-a075-32ea4886f939 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:27.420971 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9c2ac4-6b1e-468e-a075-32ea4886f939 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:27.421317 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9c2ac4-6b1e-468e-a075-32ea4886f939 admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:27.422093 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9c2ac4-6b1e-468e-a075-32ea4886f939 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:45:27.423831 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9c2ac4-6b1e-468e-a075-32ea4886f939 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:45:27.435303 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 926/1866] 10.222.0.102 () {58 vars in 1127 bytes} [Mon Aug 1 15:45:27 2022] GET /identity/v3/roles => generated 1427 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:45:27.440667 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9c2ac4-6b1e-468e-a075-32ea4886f939 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:45:27.452497 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9c2ac4-6b1e-468e-a075-32ea4886f939 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:45:27.457425 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd7fdb6-bd4b-4b74-94e4-1871e7c01305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:45:27.458095 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd7fdb6-bd4b-4b74-94e4-1871e7c01305 admin admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:27.458377 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd7fdb6-bd4b-4b74-94e4-1871e7c01305 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:27.458836 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd7fdb6-bd4b-4b74-94e4-1871e7c01305 admin admin] PATH_INFO: `/v3/projects/861a00d7b4344ac4bb8181c60af8ecd1/users/2b454e308c7347e1968cf79fb7158360/roles/de1374f966c04c27b579515b54334fd2` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:27.474915 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 941/1867] 10.222.0.102 () {60 vars in 1158 bytes} [Mon Aug 1 15:45:27 2022] POST /identity/v3/projects => generated 384 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 15:45:27.476238 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd7fdb6-bd4b-4b74-94e4-1871e7c01305 admin admin] RBAC: Authorizing `identity:create_grant(project_id=861a00d7b4344ac4bb8181c60af8ecd1, user_id=2b454e308c7347e1968cf79fb7158360, role_id=de1374f966c04c27b579515b54334fd2)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:45:27.479065 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd7fdb6-bd4b-4b74-94e4-1871e7c01305 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:45:27.479516 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76897130-e61c-4ebc-98f6-a33ff5296370 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:45:27.565607 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 927/1868] 10.222.0.102 () {60 vars in 1488 bytes} [Mon Aug 1 15:45:27 2022] PUT /identity/v3/projects/861a00d7b4344ac4bb8181c60af8ecd1/users/2b454e308c7347e1968cf79fb7158360/roles/de1374f966c04c27b579515b54334fd2 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 15:45:27.565607 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd7fdb6-bd4b-4b74-94e4-1871e7c01305 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:45:27.591389 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76897130-e61c-4ebc-98f6-a33ff5296370 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:45:27.646321 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd7fdb6-bd4b-4b74-94e4-1871e7c01305 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:45:27.651557 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906d3d46-faf9-4c58-8a20-a827f4fd1242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:45:27.652277 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906d3d46-faf9-4c58-8a20-a827f4fd1242 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:27.653067 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906d3d46-faf9-4c58-8a20-a827f4fd1242 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:27.653067 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906d3d46-faf9-4c58-8a20-a827f4fd1242 admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:27.653653 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906d3d46-faf9-4c58-8a20-a827f4fd1242 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:45:27.655254 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906d3d46-faf9-4c58-8a20-a827f4fd1242 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:45:27.665761 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 928/1869] 10.222.0.102 () {58 vars in 1127 bytes} [Mon Aug 1 15:45:27 2022] GET /identity/v3/roles => generated 1427 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 15:45:27.669748 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906d3d46-faf9-4c58-8a20-a827f4fd1242 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:45:27.672225 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef9bcbd-2175-4c7d-86c9-bc87c008455e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:45:27.673087 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef9bcbd-2175-4c7d-86c9-bc87c008455e admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:27.673514 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef9bcbd-2175-4c7d-86c9-bc87c008455e admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:27.674471 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef9bcbd-2175-4c7d-86c9-bc87c008455e admin admin] PATH_INFO: `/v3/users` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:27.675321 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef9bcbd-2175-4c7d-86c9-bc87c008455e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:45:27.677502 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef9bcbd-2175-4c7d-86c9-bc87c008455e admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:45:27.682208 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906d3d46-faf9-4c58-8a20-a827f4fd1242 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:45:27.687408 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6684e264-6397-4c36-8760-2d929793b8a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:45:27.688108 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6684e264-6397-4c36-8760-2d929793b8a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:27.688385 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6684e264-6397-4c36-8760-2d929793b8a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:27.688653 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6684e264-6397-4c36-8760-2d929793b8a7 admin admin] PATH_INFO: `/v3/projects/861a00d7b4344ac4bb8181c60af8ecd1/users/2b454e308c7347e1968cf79fb7158360/roles/de1374f966c04c27b579515b54334fd2` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:27.691518 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6684e264-6397-4c36-8760-2d929793b8a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=861a00d7b4344ac4bb8181c60af8ecd1, user_id=2b454e308c7347e1968cf79fb7158360, role_id=de1374f966c04c27b579515b54334fd2)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:45:27.694516 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6684e264-6397-4c36-8760-2d929793b8a7 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:45:27.706891 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 929/1870] 10.222.0.102 () {60 vars in 1488 bytes} [Mon Aug 1 15:45:27 2022] PUT /identity/v3/projects/861a00d7b4344ac4bb8181c60af8ecd1/users/2b454e308c7347e1968cf79fb7158360/roles/de1374f966c04c27b579515b54334fd2 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 15:45:27.718029 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef72144-87c9-4589-8dc1-883f5270875d None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:27.718029 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef72144-87c9-4589-8dc1-883f5270875d None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:27.718236 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef72144-87c9-4589-8dc1-883f5270875d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:27.753945 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-1ef72144-87c9-4589-8dc1-883f5270875d None None] MFA Rules not processed for user `2b454e308c7347e1968cf79fb7158360`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:45:27.755174 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-1ef72144-87c9-4589-8dc1-883f5270875d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:45:27.774203 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:45:27.779851 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 942/1871] 10.222.0.102 () {60 vars in 1149 bytes} [Mon Aug 1 15:45:27 2022] POST /identity/v3/users => generated 299 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:45:27.780740 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef9bcbd-2175-4c7d-86c9-bc87c008455e admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:45:27.794978 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef9bcbd-2175-4c7d-86c9-bc87c008455e admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:45:27.881889 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 930/1872] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:45:27 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 15:45:27.892386 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5eb0aa-464a-4cac-a201-b9c28781501b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:45:27.892890 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5eb0aa-464a-4cac-a201-b9c28781501b admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:27.893170 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5eb0aa-464a-4cac-a201-b9c28781501b admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:27.893591 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5eb0aa-464a-4cac-a201-b9c28781501b admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:27.893688 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef72144-87c9-4589-8dc1-883f5270875d None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:45:27.894291 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5eb0aa-464a-4cac-a201-b9c28781501b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:45:27.894980 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-1ef72144-87c9-4589-8dc1-883f5270875d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:45:27.895920 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5eb0aa-464a-4cac-a201-b9c28781501b admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:45:27.906810 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 943/1873] 10.222.0.102 () {58 vars in 1127 bytes} [Mon Aug 1 15:45:27 2022] GET /identity/v3/roles => generated 1427 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 15:45:27.911618 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5eb0aa-464a-4cac-a201-b9c28781501b admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:45:27.921902 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5eb0aa-464a-4cac-a201-b9c28781501b admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:45:27.927721 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d84cef-7fb9-4b88-8fc3-968d532c5054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:45:27.928386 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d84cef-7fb9-4b88-8fc3-968d532c5054 admin admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:27.928661 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d84cef-7fb9-4b88-8fc3-968d532c5054 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:27.929015 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d84cef-7fb9-4b88-8fc3-968d532c5054 admin admin] PATH_INFO: `/v3/projects/8f5425ca83da45f187ccde0fd00e73bc/users/6421faab6df641e18b8493f7deff8e2d/roles/de1374f966c04c27b579515b54334fd2` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:27.950064 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d84cef-7fb9-4b88-8fc3-968d532c5054 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f5425ca83da45f187ccde0fd00e73bc, user_id=6421faab6df641e18b8493f7deff8e2d, role_id=de1374f966c04c27b579515b54334fd2)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:45:27.951873 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d84cef-7fb9-4b88-8fc3-968d532c5054 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:45:27.964801 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef72144-87c9-4589-8dc1-883f5270875d None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:45:27.968542 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096a9824-41ca-431b-b6a5-94d2f0bbc85e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff810b37183c4729859c1b05edff1703', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:45:27.969291 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096a9824-41ca-431b-b6a5-94d2f0bbc85e service cinder] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:27.969567 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096a9824-41ca-431b-b6a5-94d2f0bbc85e service cinder] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:27.969862 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096a9824-41ca-431b-b6a5-94d2f0bbc85e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:27.979323 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096a9824-41ca-431b-b6a5-94d2f0bbc85e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:45:27.980768 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096a9824-41ca-431b-b6a5-94d2f0bbc85e service cinder] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:45:27.990982 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 931/1874] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:45:27 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 15:45:28.049573 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 944/1875] 10.222.0.102 () {60 vars in 1488 bytes} [Mon Aug 1 15:45:27 2022] PUT /identity/v3/projects/8f5425ca83da45f187ccde0fd00e73bc/users/6421faab6df641e18b8493f7deff8e2d/roles/de1374f966c04c27b579515b54334fd2 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:45:28.053697 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096a9824-41ca-431b-b6a5-94d2f0bbc85e service cinder] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:45:28.064159 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096a9824-41ca-431b-b6a5-94d2f0bbc85e service cinder] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:45:28.122054 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437327ca-560e-4dcc-aa7a-2bae79391a71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:45:28.122594 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437327ca-560e-4dcc-aa7a-2bae79391a71 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:28.122874 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437327ca-560e-4dcc-aa7a-2bae79391a71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:28.123146 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437327ca-560e-4dcc-aa7a-2bae79391a71 admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:28.123834 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437327ca-560e-4dcc-aa7a-2bae79391a71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:45:28.125473 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437327ca-560e-4dcc-aa7a-2bae79391a71 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:45:28.135775 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 932/1876] 10.222.0.102 () {58 vars in 1127 bytes} [Mon Aug 1 15:45:28 2022] GET /identity/v3/roles => generated 1427 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:45:28.140051 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d84cef-7fb9-4b88-8fc3-968d532c5054 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:45:28.150831 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d84cef-7fb9-4b88-8fc3-968d532c5054 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:45:28.155533 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff84a57b-b702-4a7b-8838-2181868daeba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:45:28.156194 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff84a57b-b702-4a7b-8838-2181868daeba admin admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:28.156576 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff84a57b-b702-4a7b-8838-2181868daeba admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:28.156893 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff84a57b-b702-4a7b-8838-2181868daeba admin admin] PATH_INFO: `/v3/projects/8f5425ca83da45f187ccde0fd00e73bc/users/6421faab6df641e18b8493f7deff8e2d/roles/de1374f966c04c27b579515b54334fd2` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:28.159089 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff84a57b-b702-4a7b-8838-2181868daeba admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f5425ca83da45f187ccde0fd00e73bc, user_id=6421faab6df641e18b8493f7deff8e2d, role_id=de1374f966c04c27b579515b54334fd2)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:45:28.161791 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff84a57b-b702-4a7b-8838-2181868daeba admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:45:28.172960 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 945/1877] 10.222.0.102 () {60 vars in 1488 bytes} [Mon Aug 1 15:45:28 2022] PUT /identity/v3/projects/8f5425ca83da45f187ccde0fd00e73bc/users/6421faab6df641e18b8493f7deff8e2d/roles/de1374f966c04c27b579515b54334fd2 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:45:28.186103 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0413a9-7eef-4840-add8-e551a27bf821 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:28.186381 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0413a9-7eef-4840-add8-e551a27bf821 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:28.186658 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0413a9-7eef-4840-add8-e551a27bf821 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:28.214998 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-fb0413a9-7eef-4840-add8-e551a27bf821 None None] MFA Rules not processed for user `6421faab6df641e18b8493f7deff8e2d`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:45:28.216200 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-fb0413a9-7eef-4840-add8-e551a27bf821 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:45:28.282030 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff84a57b-b702-4a7b-8838-2181868daeba admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:45:28.322029 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 933/1878] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:45:28 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:45:28.341643 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0413a9-7eef-4840-add8-e551a27bf821 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:45:28.343910 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-fb0413a9-7eef-4840-add8-e551a27bf821 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:45:28.376682 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff84a57b-b702-4a7b-8838-2181868daeba admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:45:28.382637 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce02457-3fc4-4ced-8a2f-072837bdf7ad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff810b37183c4729859c1b05edff1703', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:45:28.383753 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce02457-3fc4-4ced-8a2f-072837bdf7ad service cinder] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:28.384038 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce02457-3fc4-4ced-8a2f-072837bdf7ad service cinder] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:28.384307 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce02457-3fc4-4ced-8a2f-072837bdf7ad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:28.412242 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0413a9-7eef-4840-add8-e551a27bf821 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:45:28.416212 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a402a254-17ee-4939-bf16-1241314a9e19 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff810b37183c4729859c1b05edff1703', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:45:28.416865 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a402a254-17ee-4939-bf16-1241314a9e19 service cinder] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:28.417163 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a402a254-17ee-4939-bf16-1241314a9e19 service cinder] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:28.417587 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a402a254-17ee-4939-bf16-1241314a9e19 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:28.429385 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a402a254-17ee-4939-bf16-1241314a9e19 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:45:28.430988 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a402a254-17ee-4939-bf16-1241314a9e19 service cinder] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:45:28.444191 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 934/1879] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:45:28 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 15:45:28.453213 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce02457-3fc4-4ced-8a2f-072837bdf7ad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:45:28.456591 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce02457-3fc4-4ced-8a2f-072837bdf7ad service cinder] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:45:28.466317 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 946/1880] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:45:28 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:45:28.610236 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a402a254-17ee-4939-bf16-1241314a9e19 service cinder] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:45:28.621604 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a402a254-17ee-4939-bf16-1241314a9e19 service cinder] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:45:28.628316 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256ff12d-359d-4d62-965b-652e892943cf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff810b37183c4729859c1b05edff1703', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:45:28.628899 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256ff12d-359d-4d62-965b-652e892943cf service cinder] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:28.629182 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256ff12d-359d-4d62-965b-652e892943cf service cinder] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:28.629452 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256ff12d-359d-4d62-965b-652e892943cf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:28.688575 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256ff12d-359d-4d62-965b-652e892943cf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:45:28.690070 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256ff12d-359d-4d62-965b-652e892943cf service cinder] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:45:28.699430 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 935/1881] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:45:28 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:45:29.094091 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beafa4b-5d92-43e5-a52f-755846135b4b None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:29.094880 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beafa4b-5d92-43e5-a52f-755846135b4b None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:29.095299 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beafa4b-5d92-43e5-a52f-755846135b4b None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:29.096924 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 947/1882] 10.222.0.102 () {54 vars in 926 bytes} [Mon Aug 1 15:45:29 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 15:45:29.105752 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93438f04-e28a-4800-bbbb-c468dd076910 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:29.108485 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93438f04-e28a-4800-bbbb-c468dd076910 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:29.108485 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93438f04-e28a-4800-bbbb-c468dd076910 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:29.136977 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-93438f04-e28a-4800-bbbb-c468dd076910 None None] MFA Rules not processed for user `77b43f1ee8cc4be3907a494abe90c1cc`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:45:29.136977 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-93438f04-e28a-4800-bbbb-c468dd076910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:45:29.199459 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 936/1883] 10.222.0.102 () {58 vars in 1023 bytes} [Mon Aug 1 15:45:29 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:45:29.212952 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2beafa4b-5d92-43e5-a52f-755846135b4b None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:45:29.215014 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-2beafa4b-5d92-43e5-a52f-755846135b4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:45:29.236718 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2beafa4b-5d92-43e5-a52f-755846135b4b None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:45:29.242557 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6728e782-a97f-4c67-b970-8388bcbbb59c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77b43f1ee8cc4be3907a494abe90c1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:45:29.246214 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6728e782-a97f-4c67-b970-8388bcbbb59c service nova] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:29.246214 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6728e782-a97f-4c67-b970-8388bcbbb59c service nova] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:29.246214 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6728e782-a97f-4c67-b970-8388bcbbb59c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:29.253685 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6728e782-a97f-4c67-b970-8388bcbbb59c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:45:29.255318 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6728e782-a97f-4c67-b970-8388bcbbb59c service nova] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:45:29.266434 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 948/1884] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:45:29 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:45:29.337821 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93438f04-e28a-4800-bbbb-c468dd076910 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:45:29.401657 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93438f04-e28a-4800-bbbb-c468dd076910 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:45:29.401880 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:45:29.406339 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefe85fc-fafb-46d7-89b4-e9665b51a853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:45:29.410561 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefe85fc-fafb-46d7-89b4-e9665b51a853 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:29.410561 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefe85fc-fafb-46d7-89b4-e9665b51a853 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:29.410561 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefe85fc-fafb-46d7-89b4-e9665b51a853 admin admin] PATH_INFO: `/v3/users/7d55d8f3ec434c2b9e32fe1c8dc2dea3` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:29.410561 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefe85fc-fafb-46d7-89b4-e9665b51a853 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d55d8f3ec434c2b9e32fe1c8dc2dea3)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:45:29.411126 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefe85fc-fafb-46d7-89b4-e9665b51a853 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:45:29.638767 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-eefe85fc-fafb-46d7-89b4-e9665b51a853 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d55d8f3ec434c2b9e32fe1c8dc2dea3'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:45:29.704972 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-eefe85fc-fafb-46d7-89b4-e9665b51a853 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d55d8f3ec434c2b9e32fe1c8dc2dea3'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:45:29.717870 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-eefe85fc-fafb-46d7-89b4-e9665b51a853 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d55d8f3ec434c2b9e32fe1c8dc2dea3'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:45:29.718584 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-eefe85fc-fafb-46d7-89b4-e9665b51a853 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d55d8f3ec434c2b9e32fe1c8dc2dea3'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:45:29.719206 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-eefe85fc-fafb-46d7-89b4-e9665b51a853 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d55d8f3ec434c2b9e32fe1c8dc2dea3'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:45:29.732028 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 937/1885] 10.222.0.102 () {58 vars in 1229 bytes} [Mon Aug 1 15:45:29 2022] DELETE /identity/v3/users/7d55d8f3ec434c2b9e32fe1c8dc2dea3 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:45:29.737386 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7cc1b8-95cd-449b-9d05-3a14bd871f2e None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:29.737661 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7cc1b8-95cd-449b-9d05-3a14bd871f2e None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:29.737935 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7cc1b8-95cd-449b-9d05-3a14bd871f2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:29.759797 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-bc7cc1b8-95cd-449b-9d05-3a14bd871f2e None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:45:29.761045 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-bc7cc1b8-95cd-449b-9d05-3a14bd871f2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:45:29.826178 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 949/1886] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:45:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:45:29.833484 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefe85fc-fafb-46d7-89b4-e9665b51a853 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:45:29.838355 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-eefe85fc-fafb-46d7-89b4-e9665b51a853 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:45:29.911291 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefe85fc-fafb-46d7-89b4-e9665b51a853 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:45:29.915166 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb603375-5f43-487b-8814-46a66bd4dc94 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a856a413100443939fe9b10daa868518', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:45:29.915798 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb603375-5f43-487b-8814-46a66bd4dc94 service neutron] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:29.916079 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb603375-5f43-487b-8814-46a66bd4dc94 service neutron] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:29.916355 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb603375-5f43-487b-8814-46a66bd4dc94 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:29.926397 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb603375-5f43-487b-8814-46a66bd4dc94 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:45:29.927864 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb603375-5f43-487b-8814-46a66bd4dc94 service neutron] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:45:29.937776 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 938/1887] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:45:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:45:30.023762 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:45:30.438139 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7cc1b8-95cd-449b-9d05-3a14bd871f2e None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:45:30.439683 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-bc7cc1b8-95cd-449b-9d05-3a14bd871f2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:45:30.456011 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7cc1b8-95cd-449b-9d05-3a14bd871f2e None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:45:30.460947 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775b6c5a-5512-4c31-a8ab-d14a75efd690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:45:30.461603 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775b6c5a-5512-4c31-a8ab-d14a75efd690 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:30.464092 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775b6c5a-5512-4c31-a8ab-d14a75efd690 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:30.464092 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775b6c5a-5512-4c31-a8ab-d14a75efd690 admin admin] PATH_INFO: `/v3/projects/70ac04fb322b40459c525a82bef3cbb8` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:30.464092 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775b6c5a-5512-4c31-a8ab-d14a75efd690 admin admin] RBAC: Authorizing `identity:delete_project(project_id=70ac04fb322b40459c525a82bef3cbb8)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:45:30.466116 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775b6c5a-5512-4c31-a8ab-d14a75efd690 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:45:30.587411 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-775b6c5a-5512-4c31-a8ab-d14a75efd690 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70ac04fb322b40459c525a82bef3cbb8', 'request_id': 'req-775b6c5a-5512-4c31-a8ab-d14a75efd690'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:45:30.593910 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-775b6c5a-5512-4c31-a8ab-d14a75efd690 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70ac04fb322b40459c525a82bef3cbb8', 'request_id': 'req-775b6c5a-5512-4c31-a8ab-d14a75efd690'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:45:30.638498 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:45:30.683660 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-775b6c5a-5512-4c31-a8ab-d14a75efd690 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70ac04fb322b40459c525a82bef3cbb8', 'request_id': 'req-775b6c5a-5512-4c31-a8ab-d14a75efd690'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:45:30.695265 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-775b6c5a-5512-4c31-a8ab-d14a75efd690 admin admin] The token cache is being invalidate because project 70ac04fb322b40459c525a82bef3cbb8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80352) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 15:45:30.695488 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-775b6c5a-5512-4c31-a8ab-d14a75efd690 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:45:30.696132 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-775b6c5a-5512-4c31-a8ab-d14a75efd690 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:45:30.708164 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 950/1888] 10.222.0.102 () {58 vars in 1238 bytes} [Mon Aug 1 15:45:30 2022] DELETE /identity/v3/projects/70ac04fb322b40459c525a82bef3cbb8 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:45:30.712151 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb603375-5f43-487b-8814-46a66bd4dc94 service neutron] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:45:30.722551 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb603375-5f43-487b-8814-46a66bd4dc94 service neutron] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:45:30.786684 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2948180-ac41-491d-81d7-5f652105c101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:45:30.787606 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2948180-ac41-491d-81d7-5f652105c101 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:30.787893 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2948180-ac41-491d-81d7-5f652105c101 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:30.788171 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2948180-ac41-491d-81d7-5f652105c101 admin admin] PATH_INFO: `/v3/users/6421faab6df641e18b8493f7deff8e2d` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:30.789428 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2948180-ac41-491d-81d7-5f652105c101 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6421faab6df641e18b8493f7deff8e2d)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:45:30.791679 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2948180-ac41-491d-81d7-5f652105c101 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:45:30.938268 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775b6c5a-5512-4c31-a8ab-d14a75efd690 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:45:30.950857 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-775b6c5a-5512-4c31-a8ab-d14a75efd690 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:45:30.956355 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775b6c5a-5512-4c31-a8ab-d14a75efd690 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:45:30.966163 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18902b5-d9fd-4da8-8a5e-3a52dcaf8bfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:45:30.966866 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18902b5-d9fd-4da8-8a5e-3a52dcaf8bfd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:30.967149 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18902b5-d9fd-4da8-8a5e-3a52dcaf8bfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:30.967429 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18902b5-d9fd-4da8-8a5e-3a52dcaf8bfd admin admin] PATH_INFO: `/v3/users/36457c919fac492f907555d7c6bb6d9e` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:30.968633 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18902b5-d9fd-4da8-8a5e-3a52dcaf8bfd admin admin] RBAC: Authorizing `identity:delete_user(user_id=36457c919fac492f907555d7c6bb6d9e)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:45:30.970611 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18902b5-d9fd-4da8-8a5e-3a52dcaf8bfd admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:45:31.024075 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-b2948180-ac41-491d-81d7-5f652105c101 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6421faab6df641e18b8493f7deff8e2d'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:45:31.099240 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-b2948180-ac41-491d-81d7-5f652105c101 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6421faab6df641e18b8493f7deff8e2d'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:45:31.114493 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-b2948180-ac41-491d-81d7-5f652105c101 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6421faab6df641e18b8493f7deff8e2d'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:45:31.115249 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-b2948180-ac41-491d-81d7-5f652105c101 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6421faab6df641e18b8493f7deff8e2d'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:45:31.115864 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-b2948180-ac41-491d-81d7-5f652105c101 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6421faab6df641e18b8493f7deff8e2d'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:45:31.129996 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 939/1889] 10.222.0.102 () {58 vars in 1229 bytes} [Mon Aug 1 15:45:30 2022] DELETE /identity/v3/users/6421faab6df641e18b8493f7deff8e2d => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:45:31.188136 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-d18902b5-d9fd-4da8-8a5e-3a52dcaf8bfd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36457c919fac492f907555d7c6bb6d9e'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:45:31.202773 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-d18902b5-d9fd-4da8-8a5e-3a52dcaf8bfd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36457c919fac492f907555d7c6bb6d9e'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:45:31.211811 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-d18902b5-d9fd-4da8-8a5e-3a52dcaf8bfd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36457c919fac492f907555d7c6bb6d9e'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:45:31.213452 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-d18902b5-d9fd-4da8-8a5e-3a52dcaf8bfd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36457c919fac492f907555d7c6bb6d9e'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:45:31.214504 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-d18902b5-d9fd-4da8-8a5e-3a52dcaf8bfd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36457c919fac492f907555d7c6bb6d9e'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:45:31.313773 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 951/1890] 10.222.0.102 () {58 vars in 1229 bytes} [Mon Aug 1 15:45:30 2022] DELETE /identity/v3/users/36457c919fac492f907555d7c6bb6d9e => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:45:31.318345 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637524e7-9ee9-4661-8402-01f500542c67 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:31.318641 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637524e7-9ee9-4661-8402-01f500542c67 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:31.318926 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637524e7-9ee9-4661-8402-01f500542c67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:31.339866 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-637524e7-9ee9-4661-8402-01f500542c67 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:45:31.341125 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-637524e7-9ee9-4661-8402-01f500542c67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:45:31.413019 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 940/1891] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:45:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:45:31.422715 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18902b5-d9fd-4da8-8a5e-3a52dcaf8bfd admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:45:31.424338 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-d18902b5-d9fd-4da8-8a5e-3a52dcaf8bfd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:45:31.484507 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18902b5-d9fd-4da8-8a5e-3a52dcaf8bfd admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:45:31.488200 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b714776-075a-4b2c-8a11-7737cbbe4ede service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a856a413100443939fe9b10daa868518', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:45:31.488814 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b714776-075a-4b2c-8a11-7737cbbe4ede service neutron] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:31.489129 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b714776-075a-4b2c-8a11-7737cbbe4ede service neutron] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:31.489399 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b714776-075a-4b2c-8a11-7737cbbe4ede service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:31.498533 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b714776-075a-4b2c-8a11-7737cbbe4ede service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:45:31.499950 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b714776-075a-4b2c-8a11-7737cbbe4ede service neutron] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:45:31.509830 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 952/1892] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:45:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:45:31.592204 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637524e7-9ee9-4661-8402-01f500542c67 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:45:31.593979 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-637524e7-9ee9-4661-8402-01f500542c67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:45:31.609789 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637524e7-9ee9-4661-8402-01f500542c67 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:45:31.619630 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:45:31.624182 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be644193-1856-48fc-b03f-6d6f5308ed1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:45:31.629742 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be644193-1856-48fc-b03f-6d6f5308ed1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:31.629742 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be644193-1856-48fc-b03f-6d6f5308ed1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:31.629742 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be644193-1856-48fc-b03f-6d6f5308ed1d admin admin] PATH_INFO: `/v3/projects/8f5425ca83da45f187ccde0fd00e73bc` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:31.629742 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be644193-1856-48fc-b03f-6d6f5308ed1d admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f5425ca83da45f187ccde0fd00e73bc)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:45:31.630269 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be644193-1856-48fc-b03f-6d6f5308ed1d admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:45:31.789971 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-be644193-1856-48fc-b03f-6d6f5308ed1d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f5425ca83da45f187ccde0fd00e73bc', 'request_id': 'req-be644193-1856-48fc-b03f-6d6f5308ed1d'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:45:31.850631 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-be644193-1856-48fc-b03f-6d6f5308ed1d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f5425ca83da45f187ccde0fd00e73bc', 'request_id': 'req-be644193-1856-48fc-b03f-6d6f5308ed1d'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:45:31.858578 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-be644193-1856-48fc-b03f-6d6f5308ed1d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f5425ca83da45f187ccde0fd00e73bc', 'request_id': 'req-be644193-1856-48fc-b03f-6d6f5308ed1d'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:45:31.871172 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-be644193-1856-48fc-b03f-6d6f5308ed1d admin admin] The token cache is being invalidate because project 8f5425ca83da45f187ccde0fd00e73bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80353) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 15:45:31.871471 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-be644193-1856-48fc-b03f-6d6f5308ed1d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:45:31.872150 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-be644193-1856-48fc-b03f-6d6f5308ed1d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:45:31.873993 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 941/1893] 10.222.0.102 () {58 vars in 1238 bytes} [Mon Aug 1 15:45:31 2022] DELETE /identity/v3/projects/8f5425ca83da45f187ccde0fd00e73bc => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:45:31.878898 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1737b4b4-3585-46b7-8dc6-08db5fa7d164 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:31.879485 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1737b4b4-3585-46b7-8dc6-08db5fa7d164 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:31.879873 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1737b4b4-3585-46b7-8dc6-08db5fa7d164 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:31.904061 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-1737b4b4-3585-46b7-8dc6-08db5fa7d164 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:45:31.905315 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-1737b4b4-3585-46b7-8dc6-08db5fa7d164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:45:31.964958 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 953/1894] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:45:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:45:31.974526 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9b073c-7217-4396-ba64-0d6de3d79fa2 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:31.974755 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9b073c-7217-4396-ba64-0d6de3d79fa2 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:31.975035 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9b073c-7217-4396-ba64-0d6de3d79fa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:31.995302 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-0f9b073c-7217-4396-ba64-0d6de3d79fa2 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:45:31.996536 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-0f9b073c-7217-4396-ba64-0d6de3d79fa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:45:32.004577 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 942/1895] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:45:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:45:32.009727 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1737b4b4-3585-46b7-8dc6-08db5fa7d164 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:45:32.024794 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9b073c-7217-4396-ba64-0d6de3d79fa2 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:45:32.024794 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-0f9b073c-7217-4396-ba64-0d6de3d79fa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:45:32.030746 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9b073c-7217-4396-ba64-0d6de3d79fa2 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:45:32.033975 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1737b4b4-3585-46b7-8dc6-08db5fa7d164 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:45:32.036138 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb097aba-5ee7-49ab-ba02-00f61611817f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:45:32.036940 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb097aba-5ee7-49ab-ba02-00f61611817f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:32.037403 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb097aba-5ee7-49ab-ba02-00f61611817f admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:32.037759 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb097aba-5ee7-49ab-ba02-00f61611817f admin admin] PATH_INFO: `/v3/projects/d0b32ae554ff4692a62b4032b76a8588` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:32.039009 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb097aba-5ee7-49ab-ba02-00f61611817f admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0b32ae554ff4692a62b4032b76a8588)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:45:32.039792 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d56ab1-5470-4011-9531-4c0ef9d3b889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:45:32.040456 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d56ab1-5470-4011-9531-4c0ef9d3b889 admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:32.040694 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d56ab1-5470-4011-9531-4c0ef9d3b889 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:32.041067 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d56ab1-5470-4011-9531-4c0ef9d3b889 admin admin] PATH_INFO: `/v3/domains` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:32.041464 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb097aba-5ee7-49ab-ba02-00f61611817f admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:45:32.042248 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d56ab1-5470-4011-9531-4c0ef9d3b889 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:45:32.042248 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d56ab1-5470-4011-9531-4c0ef9d3b889 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:45:32.043703 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d56ab1-5470-4011-9531-4c0ef9d3b889 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:45:32.057142 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 954/1896] 10.222.0.102 () {58 vars in 1158 bytes} [Mon Aug 1 15:45:32 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:45:32.061437 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d56ab1-5470-4011-9531-4c0ef9d3b889 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:45:32.072867 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d56ab1-5470-4011-9531-4c0ef9d3b889 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:45:32.078153 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1945d1-a383-42ae-842b-1ebdfaafd143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:45:32.078902 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1945d1-a383-42ae-842b-1ebdfaafd143 admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:32.079186 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1945d1-a383-42ae-842b-1ebdfaafd143 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:32.079458 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1945d1-a383-42ae-842b-1ebdfaafd143 admin admin] PATH_INFO: `/v3/projects` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:32.080627 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1945d1-a383-42ae-842b-1ebdfaafd143 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:45:32.085773 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1945d1-a383-42ae-842b-1ebdfaafd143 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:45:32.202654 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-bb097aba-5ee7-49ab-ba02-00f61611817f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0b32ae554ff4692a62b4032b76a8588', 'request_id': 'req-bb097aba-5ee7-49ab-ba02-00f61611817f'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:45:32.293874 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-bb097aba-5ee7-49ab-ba02-00f61611817f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0b32ae554ff4692a62b4032b76a8588', 'request_id': 'req-bb097aba-5ee7-49ab-ba02-00f61611817f'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:45:32.303024 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-bb097aba-5ee7-49ab-ba02-00f61611817f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0b32ae554ff4692a62b4032b76a8588', 'request_id': 'req-bb097aba-5ee7-49ab-ba02-00f61611817f'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:45:32.303223 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 955/1897] 10.222.0.102 () {60 vars in 1158 bytes} [Mon Aug 1 15:45:32 2022] POST /identity/v3/projects => generated 374 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 15:45:32.307613 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1945d1-a383-42ae-842b-1ebdfaafd143 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:45:32.319446 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-bb097aba-5ee7-49ab-ba02-00f61611817f admin admin] The token cache is being invalidate because project d0b32ae554ff4692a62b4032b76a8588 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80353) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 15:45:32.319739 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-bb097aba-5ee7-49ab-ba02-00f61611817f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:45:32.320419 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-bb097aba-5ee7-49ab-ba02-00f61611817f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:45:32.325667 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 943/1898] 10.222.0.102 () {58 vars in 1238 bytes} [Mon Aug 1 15:45:32 2022] DELETE /identity/v3/projects/d0b32ae554ff4692a62b4032b76a8588 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:45:32.326760 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb097aba-5ee7-49ab-ba02-00f61611817f admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:45:32.328245 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-bb097aba-5ee7-49ab-ba02-00f61611817f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:45:32.407064 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:45:32.426599 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1945d1-a383-42ae-842b-1ebdfaafd143 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:45:32.449225 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3616608f-48c8-4133-9d7b-596a2ce6434f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:45:32.449956 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3616608f-48c8-4133-9d7b-596a2ce6434f admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:32.450334 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3616608f-48c8-4133-9d7b-596a2ce6434f admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:32.450694 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3616608f-48c8-4133-9d7b-596a2ce6434f admin admin] PATH_INFO: `/v3/users` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:32.451742 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3616608f-48c8-4133-9d7b-596a2ce6434f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:45:32.454221 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3616608f-48c8-4133-9d7b-596a2ce6434f admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:45:32.460873 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:45:32.511498 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb097aba-5ee7-49ab-ba02-00f61611817f admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:45:32.536459 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dec605-a392-4367-a09e-6b428de1834c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:45:32.537498 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dec605-a392-4367-a09e-6b428de1834c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:32.537897 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dec605-a392-4367-a09e-6b428de1834c admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:32.538271 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dec605-a392-4367-a09e-6b428de1834c admin admin] PATH_INFO: `/v3/users/a2761e4e9a2e4b549dbd776f81c3b291` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:32.539942 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dec605-a392-4367-a09e-6b428de1834c admin admin] RBAC: Authorizing `identity:delete_user(user_id=a2761e4e9a2e4b549dbd776f81c3b291)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:45:32.542524 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dec605-a392-4367-a09e-6b428de1834c admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:45:32.574293 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 956/1899] 10.222.0.102 () {60 vars in 1149 bytes} [Mon Aug 1 15:45:32 2022] POST /identity/v3/users => generated 288 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 15:45:32.578839 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3616608f-48c8-4133-9d7b-596a2ce6434f admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:45:32.583383 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-3616608f-48c8-4133-9d7b-596a2ce6434f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:45:32.610211 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3616608f-48c8-4133-9d7b-596a2ce6434f admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:45:32.616432 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b92f7e9-e874-4556-8c44-7762f034d7f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:45:32.617352 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b92f7e9-e874-4556-8c44-7762f034d7f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:32.617824 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b92f7e9-e874-4556-8c44-7762f034d7f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:32.618533 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b92f7e9-e874-4556-8c44-7762f034d7f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:32.619638 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b92f7e9-e874-4556-8c44-7762f034d7f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:45:32.621517 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b92f7e9-e874-4556-8c44-7762f034d7f0 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:45:32.636102 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 957/1900] 10.222.0.102 () {58 vars in 1127 bytes} [Mon Aug 1 15:45:32 2022] GET /identity/v3/roles => generated 1427 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:45:32.639919 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b92f7e9-e874-4556-8c44-7762f034d7f0 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:45:32.662216 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b92f7e9-e874-4556-8c44-7762f034d7f0 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:45:32.668927 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe54dcdd-2acd-4b37-a865-9e3fd330c7e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:45:32.668927 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe54dcdd-2acd-4b37-a865-9e3fd330c7e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:32.668927 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe54dcdd-2acd-4b37-a865-9e3fd330c7e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:32.669371 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe54dcdd-2acd-4b37-a865-9e3fd330c7e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:32.670255 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe54dcdd-2acd-4b37-a865-9e3fd330c7e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:45:32.672082 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe54dcdd-2acd-4b37-a865-9e3fd330c7e6 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:45:32.688878 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 958/1901] 10.222.0.102 () {58 vars in 1127 bytes} [Mon Aug 1 15:45:32 2022] GET /identity/v3/roles => generated 1427 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 15:45:32.689878 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe54dcdd-2acd-4b37-a865-9e3fd330c7e6 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:45:32.701758 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe54dcdd-2acd-4b37-a865-9e3fd330c7e6 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:45:32.714835 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4cbd49-45bd-47cd-a33b-2883a25ebdbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:45:32.714835 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4cbd49-45bd-47cd-a33b-2883a25ebdbf admin admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:32.716593 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4cbd49-45bd-47cd-a33b-2883a25ebdbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:32.717065 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4cbd49-45bd-47cd-a33b-2883a25ebdbf admin admin] PATH_INFO: `/v3/projects/080ed86efe41426eb9d8764223a3dea1/users/69079c4cf9f74cde986147848f080322/roles/27f5093ac0674d799cdbd17c68482e32` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:32.741418 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4cbd49-45bd-47cd-a33b-2883a25ebdbf admin admin] RBAC: Authorizing `identity:create_grant(project_id=080ed86efe41426eb9d8764223a3dea1, user_id=69079c4cf9f74cde986147848f080322, role_id=27f5093ac0674d799cdbd17c68482e32)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:45:32.745315 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4cbd49-45bd-47cd-a33b-2883a25ebdbf admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:45:32.832219 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-08dec605-a392-4367-a09e-6b428de1834c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a2761e4e9a2e4b549dbd776f81c3b291'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:45:32.835330 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 959/1902] 10.222.0.102 () {60 vars in 1488 bytes} [Mon Aug 1 15:45:32 2022] PUT /identity/v3/projects/080ed86efe41426eb9d8764223a3dea1/users/69079c4cf9f74cde986147848f080322/roles/27f5093ac0674d799cdbd17c68482e32 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:45:32.842526 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418c66bf-1123-47e8-b294-e99034de666b None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:32.842954 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418c66bf-1123-47e8-b294-e99034de666b None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:32.843369 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418c66bf-1123-47e8-b294-e99034de666b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:32.872341 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-418c66bf-1123-47e8-b294-e99034de666b None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:45:32.877046 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-418c66bf-1123-47e8-b294-e99034de666b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:45:32.951209 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-08dec605-a392-4367-a09e-6b428de1834c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a2761e4e9a2e4b549dbd776f81c3b291'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:45:32.975011 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 960/1903] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:45:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:45:32.982946 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-08dec605-a392-4367-a09e-6b428de1834c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a2761e4e9a2e4b549dbd776f81c3b291'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:45:32.984104 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-08dec605-a392-4367-a09e-6b428de1834c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a2761e4e9a2e4b549dbd776f81c3b291'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:45:32.984949 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-08dec605-a392-4367-a09e-6b428de1834c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a2761e4e9a2e4b549dbd776f81c3b291'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:45:32.995885 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418c66bf-1123-47e8-b294-e99034de666b None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:45:32.999755 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-418c66bf-1123-47e8-b294-e99034de666b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:45:33.023983 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 944/1904] 10.222.0.102 () {58 vars in 1229 bytes} [Mon Aug 1 15:45:32 2022] DELETE /identity/v3/users/a2761e4e9a2e4b549dbd776f81c3b291 => generated 0 bytes in 698 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:45:33.147020 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418c66bf-1123-47e8-b294-e99034de666b None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:45:33.213190 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6144bade-2c80-48d1-b276-55ec9c84f681 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a856a413100443939fe9b10daa868518', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:45:33.215169 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6144bade-2c80-48d1-b276-55ec9c84f681 service neutron] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:33.215452 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6144bade-2c80-48d1-b276-55ec9c84f681 service neutron] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:33.215724 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6144bade-2c80-48d1-b276-55ec9c84f681 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:33.218153 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-6144bade-2c80-48d1-b276-55ec9c84f681 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:45:33.311407 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6144bade-2c80-48d1-b276-55ec9c84f681 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:45:33.313139 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6144bade-2c80-48d1-b276-55ec9c84f681 service neutron] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:45:33.335464 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 961/1905] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:45:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:45:34.376070 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dec605-a392-4367-a09e-6b428de1834c admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:45:34.377830 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-08dec605-a392-4367-a09e-6b428de1834c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:45:34.391742 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dec605-a392-4367-a09e-6b428de1834c admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:45:34.415678 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82800e87-71f9-47fe-95a3-2f5ef95bc09d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:45:34.416632 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82800e87-71f9-47fe-95a3-2f5ef95bc09d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:34.418941 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82800e87-71f9-47fe-95a3-2f5ef95bc09d admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:34.419589 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82800e87-71f9-47fe-95a3-2f5ef95bc09d admin admin] PATH_INFO: `/v3/projects/74ec82f47d4d40028562eeeff49481af` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:34.421817 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82800e87-71f9-47fe-95a3-2f5ef95bc09d admin admin] RBAC: Authorizing `identity:delete_project(project_id=74ec82f47d4d40028562eeeff49481af)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:45:34.424732 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82800e87-71f9-47fe-95a3-2f5ef95bc09d admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:45:34.439585 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:45:34.520642 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-82800e87-71f9-47fe-95a3-2f5ef95bc09d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74ec82f47d4d40028562eeeff49481af', 'request_id': 'req-82800e87-71f9-47fe-95a3-2f5ef95bc09d'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:45:34.605205 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:45:34.626224 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-82800e87-71f9-47fe-95a3-2f5ef95bc09d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74ec82f47d4d40028562eeeff49481af', 'request_id': 'req-82800e87-71f9-47fe-95a3-2f5ef95bc09d'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:45:34.633085 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-82800e87-71f9-47fe-95a3-2f5ef95bc09d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74ec82f47d4d40028562eeeff49481af', 'request_id': 'req-82800e87-71f9-47fe-95a3-2f5ef95bc09d'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:45:34.643251 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-82800e87-71f9-47fe-95a3-2f5ef95bc09d admin admin] The token cache is being invalidate because project 74ec82f47d4d40028562eeeff49481af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80353) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 15:45:34.643587 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-82800e87-71f9-47fe-95a3-2f5ef95bc09d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:45:34.644208 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-82800e87-71f9-47fe-95a3-2f5ef95bc09d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:45:34.645820 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 945/1906] 10.222.0.102 () {58 vars in 1238 bytes} [Mon Aug 1 15:45:34 2022] DELETE /identity/v3/projects/74ec82f47d4d40028562eeeff49481af => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:45:34.649729 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6144bade-2c80-48d1-b276-55ec9c84f681 service neutron] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:45:34.660081 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6144bade-2c80-48d1-b276-55ec9c84f681 service neutron] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:45:34.717188 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b012d6a1-bcbb-414c-a6c3-f18b254e74fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:45:34.717839 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b012d6a1-bcbb-414c-a6c3-f18b254e74fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:34.718130 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b012d6a1-bcbb-414c-a6c3-f18b254e74fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:34.718387 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b012d6a1-bcbb-414c-a6c3-f18b254e74fa admin admin] PATH_INFO: `/v3/users/e6d5a80b83fb4cf080fb10f9106c99e0` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:34.719579 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b012d6a1-bcbb-414c-a6c3-f18b254e74fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6d5a80b83fb4cf080fb10f9106c99e0)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:45:34.723369 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b012d6a1-bcbb-414c-a6c3-f18b254e74fa admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:45:35.001298 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-b012d6a1-bcbb-414c-a6c3-f18b254e74fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6d5a80b83fb4cf080fb10f9106c99e0'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:45:35.033159 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-b012d6a1-bcbb-414c-a6c3-f18b254e74fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6d5a80b83fb4cf080fb10f9106c99e0'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:45:35.045727 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-b012d6a1-bcbb-414c-a6c3-f18b254e74fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6d5a80b83fb4cf080fb10f9106c99e0'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:45:35.047913 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-b012d6a1-bcbb-414c-a6c3-f18b254e74fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6d5a80b83fb4cf080fb10f9106c99e0'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:45:35.050286 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-b012d6a1-bcbb-414c-a6c3-f18b254e74fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6d5a80b83fb4cf080fb10f9106c99e0'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:45:35.185901 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 962/1907] 10.222.0.102 () {58 vars in 1229 bytes} [Mon Aug 1 15:45:34 2022] DELETE /identity/v3/users/e6d5a80b83fb4cf080fb10f9106c99e0 => generated 0 bytes in 536 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:45:35.842172 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82800e87-71f9-47fe-95a3-2f5ef95bc09d admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:45:35.843674 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-82800e87-71f9-47fe-95a3-2f5ef95bc09d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:45:35.857171 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82800e87-71f9-47fe-95a3-2f5ef95bc09d admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:45:35.951860 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1fc6fb-7892-4147-bcc8-373a498077dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:45:35.952783 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1fc6fb-7892-4147-bcc8-373a498077dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:35.953102 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1fc6fb-7892-4147-bcc8-373a498077dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:35.953383 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1fc6fb-7892-4147-bcc8-373a498077dd admin admin] PATH_INFO: `/v3/projects/121bde86503c43e9a9bc0820ba45d7aa` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:35.954720 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1fc6fb-7892-4147-bcc8-373a498077dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=121bde86503c43e9a9bc0820ba45d7aa)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:45:35.957468 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1fc6fb-7892-4147-bcc8-373a498077dd admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:45:36.117463 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15419ff-87aa-4e8c-a61c-557ee198df31 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:36.118110 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-dd1fc6fb-7892-4147-bcc8-373a498077dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '121bde86503c43e9a9bc0820ba45d7aa', 'request_id': 'req-dd1fc6fb-7892-4147-bcc8-373a498077dd'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:45:36.118542 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15419ff-87aa-4e8c-a61c-557ee198df31 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:36.119031 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15419ff-87aa-4e8c-a61c-557ee198df31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:36.148038 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-e15419ff-87aa-4e8c-a61c-557ee198df31 None None] MFA Rules not processed for user `69079c4cf9f74cde986147848f080322`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:45:36.149382 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-e15419ff-87aa-4e8c-a61c-557ee198df31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:45:36.190731 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-dd1fc6fb-7892-4147-bcc8-373a498077dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '121bde86503c43e9a9bc0820ba45d7aa', 'request_id': 'req-dd1fc6fb-7892-4147-bcc8-373a498077dd'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:45:36.200652 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-dd1fc6fb-7892-4147-bcc8-373a498077dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '121bde86503c43e9a9bc0820ba45d7aa', 'request_id': 'req-dd1fc6fb-7892-4147-bcc8-373a498077dd'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:45:36.214727 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-dd1fc6fb-7892-4147-bcc8-373a498077dd admin admin] The token cache is being invalidate because project 121bde86503c43e9a9bc0820ba45d7aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80353) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 15:45:36.215082 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-dd1fc6fb-7892-4147-bcc8-373a498077dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:45:36.215836 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-dd1fc6fb-7892-4147-bcc8-373a498077dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:45:36.217660 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 946/1908] 10.222.0.102 () {58 vars in 1238 bytes} [Mon Aug 1 15:45:35 2022] DELETE /identity/v3/projects/121bde86503c43e9a9bc0820ba45d7aa => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:45:36.224527 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbb425c-a658-4da7-8252-9f3376e2c843 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:36.226340 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbb425c-a658-4da7-8252-9f3376e2c843 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:36.226623 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbb425c-a658-4da7-8252-9f3376e2c843 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:36.231958 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 963/1909] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:45:36 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 15:45:36.236380 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15419ff-87aa-4e8c-a61c-557ee198df31 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:45:36.238255 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-e15419ff-87aa-4e8c-a61c-557ee198df31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:45:36.252369 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-3fbb425c-a658-4da7-8252-9f3376e2c843 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:45:36.253644 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-3fbb425c-a658-4da7-8252-9f3376e2c843 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:45:36.305619 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15419ff-87aa-4e8c-a61c-557ee198df31 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:45:36.310849 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d33ea8-a0cd-4303-801d-633fa7320a45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:45:36.311476 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d33ea8-a0cd-4303-801d-633fa7320a45 admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:36.311812 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d33ea8-a0cd-4303-801d-633fa7320a45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:36.312087 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d33ea8-a0cd-4303-801d-633fa7320a45 admin admin] PATH_INFO: `/v3/projects` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:36.312793 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d33ea8-a0cd-4303-801d-633fa7320a45 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:45:36.314861 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d33ea8-a0cd-4303-801d-633fa7320a45 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:45:36.329055 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 947/1910] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:45:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 15:45:36.343910 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e193019-d5c8-4290-834a-11aa02ff757a None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:36.344451 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e193019-d5c8-4290-834a-11aa02ff757a None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:36.344732 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e193019-d5c8-4290-834a-11aa02ff757a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:36.366622 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-2e193019-d5c8-4290-834a-11aa02ff757a None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:45:36.367844 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-2e193019-d5c8-4290-834a-11aa02ff757a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:45:36.379465 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 948/1911] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:45:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 15:45:36.381232 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e193019-d5c8-4290-834a-11aa02ff757a None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:45:36.387370 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:45:36.392621 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e193019-d5c8-4290-834a-11aa02ff757a None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:45:36.400490 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a820d3-c84d-460f-bb94-457f89461f95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:45:36.400490 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a820d3-c84d-460f-bb94-457f89461f95 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:36.400490 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a820d3-c84d-460f-bb94-457f89461f95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:36.400490 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a820d3-c84d-460f-bb94-457f89461f95 admin admin] PATH_INFO: `/v3/domains` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:36.400904 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a820d3-c84d-460f-bb94-457f89461f95 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:45:36.400904 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a820d3-c84d-460f-bb94-457f89461f95 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:45:36.401247 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a820d3-c84d-460f-bb94-457f89461f95 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:45:36.414099 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 949/1912] 10.222.0.102 () {58 vars in 1158 bytes} [Mon Aug 1 15:45:36 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:45:36.418470 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a820d3-c84d-460f-bb94-457f89461f95 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:45:36.430875 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a820d3-c84d-460f-bb94-457f89461f95 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:45:36.433170 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 964/1913] 10.222.0.102 () {60 vars in 1158 bytes} [Mon Aug 1 15:45:36 2022] POST /identity/v3/projects => generated 374 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 15:45:36.437320 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d33ea8-a0cd-4303-801d-633fa7320a45 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:45:36.439305 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-19d33ea8-a0cd-4303-801d-633fa7320a45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:45:36.441843 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f68b654-52b6-45a9-829c-6dbfd2921b8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:45:36.446390 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f68b654-52b6-45a9-829c-6dbfd2921b8f admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:36.446390 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f68b654-52b6-45a9-829c-6dbfd2921b8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:36.446390 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f68b654-52b6-45a9-829c-6dbfd2921b8f admin admin] PATH_INFO: `/v3/projects` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:36.446390 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f68b654-52b6-45a9-829c-6dbfd2921b8f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:45:36.446752 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f68b654-52b6-45a9-829c-6dbfd2921b8f admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:45:36.498235 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:45:36.517159 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d33ea8-a0cd-4303-801d-633fa7320a45 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:45:36.522693 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc7c2e1-1d13-49e2-91f1-f31251e813c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:45:36.523382 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc7c2e1-1d13-49e2-91f1-f31251e813c9 admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:36.523715 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc7c2e1-1d13-49e2-91f1-f31251e813c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:36.526680 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc7c2e1-1d13-49e2-91f1-f31251e813c9 admin admin] PATH_INFO: `/v3/users` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:36.526680 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc7c2e1-1d13-49e2-91f1-f31251e813c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:45:36.526680 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc7c2e1-1d13-49e2-91f1-f31251e813c9 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:45:36.557873 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 950/1914] 10.222.0.102 () {60 vars in 1158 bytes} [Mon Aug 1 15:45:36 2022] POST /identity/v3/projects => generated 384 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 15:45:36.562001 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f68b654-52b6-45a9-829c-6dbfd2921b8f admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:45:36.615293 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 965/1915] 10.222.0.102 () {60 vars in 1149 bytes} [Mon Aug 1 15:45:36 2022] POST /identity/v3/users => generated 294 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:45:36.619236 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc7c2e1-1d13-49e2-91f1-f31251e813c9 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:45:36.625763 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f68b654-52b6-45a9-829c-6dbfd2921b8f admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:45:36.630702 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0113823c-2614-43b9-953e-ac8da7d824d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:45:36.631229 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc7c2e1-1d13-49e2-91f1-f31251e813c9 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:45:36.631373 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0113823c-2614-43b9-953e-ac8da7d824d2 admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:36.631651 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0113823c-2614-43b9-953e-ac8da7d824d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:36.631962 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0113823c-2614-43b9-953e-ac8da7d824d2 admin admin] PATH_INFO: `/v3/users` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:36.632626 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0113823c-2614-43b9-953e-ac8da7d824d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:45:36.634876 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0113823c-2614-43b9-953e-ac8da7d824d2 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:45:36.635942 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbee331-d5e6-46ab-a5f2-fe7de9acf85a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:45:36.636575 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbee331-d5e6-46ab-a5f2-fe7de9acf85a admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:36.636873 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbee331-d5e6-46ab-a5f2-fe7de9acf85a admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:36.637151 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbee331-d5e6-46ab-a5f2-fe7de9acf85a admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:36.637864 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbee331-d5e6-46ab-a5f2-fe7de9acf85a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:45:36.639444 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbee331-d5e6-46ab-a5f2-fe7de9acf85a admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:45:36.650276 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 966/1916] 10.222.0.102 () {58 vars in 1127 bytes} [Mon Aug 1 15:45:36 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:45:36.654189 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbee331-d5e6-46ab-a5f2-fe7de9acf85a admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:45:36.664667 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbee331-d5e6-46ab-a5f2-fe7de9acf85a admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:45:36.669666 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4607b773-5abd-4415-986d-b299bb02f3f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:45:36.670480 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4607b773-5abd-4415-986d-b299bb02f3f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:36.670773 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4607b773-5abd-4415-986d-b299bb02f3f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:36.671087 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4607b773-5abd-4415-986d-b299bb02f3f2 admin admin] PATH_INFO: `/v3/projects/5491feaf62ca4fe1826dbdf61ba69728/users/219244970f7741138535157810d2117c/roles/de1374f966c04c27b579515b54334fd2` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:36.687063 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4607b773-5abd-4415-986d-b299bb02f3f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5491feaf62ca4fe1826dbdf61ba69728, user_id=219244970f7741138535157810d2117c, role_id=de1374f966c04c27b579515b54334fd2)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:45:36.689924 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4607b773-5abd-4415-986d-b299bb02f3f2 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:45:36.704631 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 951/1917] 10.222.0.102 () {60 vars in 1149 bytes} [Mon Aug 1 15:45:36 2022] POST /identity/v3/users => generated 293 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 15:45:36.706275 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0113823c-2614-43b9-953e-ac8da7d824d2 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:45:36.717102 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0113823c-2614-43b9-953e-ac8da7d824d2 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:45:36.723898 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8661586f-7169-47a9-9dd7-ae2162f69b93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:45:36.723898 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8661586f-7169-47a9-9dd7-ae2162f69b93 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:36.723898 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8661586f-7169-47a9-9dd7-ae2162f69b93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:36.723898 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8661586f-7169-47a9-9dd7-ae2162f69b93 admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:36.724388 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8661586f-7169-47a9-9dd7-ae2162f69b93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:45:36.726014 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8661586f-7169-47a9-9dd7-ae2162f69b93 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:45:36.736667 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 952/1918] 10.222.0.102 () {58 vars in 1127 bytes} [Mon Aug 1 15:45:36 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 15:45:36.740556 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8661586f-7169-47a9-9dd7-ae2162f69b93 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:45:36.751049 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8661586f-7169-47a9-9dd7-ae2162f69b93 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:45:36.755161 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1f2a78-bbe8-4b29-8550-7ab3fbf522c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:45:36.755753 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1f2a78-bbe8-4b29-8550-7ab3fbf522c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:36.756037 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1f2a78-bbe8-4b29-8550-7ab3fbf522c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:36.756320 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1f2a78-bbe8-4b29-8550-7ab3fbf522c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:36.757091 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1f2a78-bbe8-4b29-8550-7ab3fbf522c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:45:36.758651 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1f2a78-bbe8-4b29-8550-7ab3fbf522c8 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:45:36.770188 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 953/1919] 10.222.0.102 () {58 vars in 1127 bytes} [Mon Aug 1 15:45:36 2022] GET /identity/v3/roles => generated 1427 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 15:45:36.774229 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1f2a78-bbe8-4b29-8550-7ab3fbf522c8 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:45:36.784194 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1f2a78-bbe8-4b29-8550-7ab3fbf522c8 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:45:36.789062 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476a6afe-6f34-434a-aa4d-8bf4e73e9b8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:45:36.789714 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476a6afe-6f34-434a-aa4d-8bf4e73e9b8f admin admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:36.789993 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476a6afe-6f34-434a-aa4d-8bf4e73e9b8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:36.790289 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476a6afe-6f34-434a-aa4d-8bf4e73e9b8f admin admin] PATH_INFO: `/v3/projects/c4bd7da7048b4961b9d940c296480822/users/f8c81b028bc14bbd8f24e1ebae02ec6e/roles/27f5093ac0674d799cdbd17c68482e32` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:36.807999 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476a6afe-6f34-434a-aa4d-8bf4e73e9b8f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4bd7da7048b4961b9d940c296480822, user_id=f8c81b028bc14bbd8f24e1ebae02ec6e, role_id=27f5093ac0674d799cdbd17c68482e32)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:45:36.810610 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476a6afe-6f34-434a-aa4d-8bf4e73e9b8f admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:45:36.827969 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 967/1920] 10.222.0.102 () {60 vars in 1488 bytes} [Mon Aug 1 15:45:36 2022] PUT /identity/v3/projects/5491feaf62ca4fe1826dbdf61ba69728/users/219244970f7741138535157810d2117c/roles/de1374f966c04c27b579515b54334fd2 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:45:36.832096 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4607b773-5abd-4415-986d-b299bb02f3f2 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:45:36.919937 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 954/1921] 10.222.0.102 () {60 vars in 1488 bytes} [Mon Aug 1 15:45:36 2022] PUT /identity/v3/projects/c4bd7da7048b4961b9d940c296480822/users/f8c81b028bc14bbd8f24e1ebae02ec6e/roles/27f5093ac0674d799cdbd17c68482e32 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 15:45:36.934346 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41480e52-d613-4f58-a825-4fd554b6dd69 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:36.934892 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41480e52-d613-4f58-a825-4fd554b6dd69 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:36.935316 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41480e52-d613-4f58-a825-4fd554b6dd69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:37.023943 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4607b773-5abd-4415-986d-b299bb02f3f2 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:45:37.036912 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-41480e52-d613-4f58-a825-4fd554b6dd69 None None] MFA Rules not processed for user `f8c81b028bc14bbd8f24e1ebae02ec6e`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:45:37.044243 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-41480e52-d613-4f58-a825-4fd554b6dd69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:45:37.164152 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdae7f78-137f-4468-a2ec-ce7d58fd46a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:45:37.164585 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdae7f78-137f-4468-a2ec-ce7d58fd46a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:37.164585 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdae7f78-137f-4468-a2ec-ce7d58fd46a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:37.164834 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdae7f78-137f-4468-a2ec-ce7d58fd46a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:37.165562 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdae7f78-137f-4468-a2ec-ce7d58fd46a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:45:37.167174 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdae7f78-137f-4468-a2ec-ce7d58fd46a6 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:45:37.180941 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 968/1922] 10.222.0.102 () {58 vars in 1127 bytes} [Mon Aug 1 15:45:36 2022] GET /identity/v3/roles => generated 1427 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:45:37.182931 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 955/1923] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:45:36 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 15:45:37.183070 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdae7f78-137f-4468-a2ec-ce7d58fd46a6 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:45:37.183805 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41480e52-d613-4f58-a825-4fd554b6dd69 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:45:37.194358 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdae7f78-137f-4468-a2ec-ce7d58fd46a6 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:45:37.197748 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41480e52-d613-4f58-a825-4fd554b6dd69 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:45:37.200273 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b5474b-6c1e-4b72-a76f-65877dbcb34f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:45:37.202070 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b5474b-6c1e-4b72-a76f-65877dbcb34f admin admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:37.202632 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b5474b-6c1e-4b72-a76f-65877dbcb34f admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:37.203092 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b5474b-6c1e-4b72-a76f-65877dbcb34f admin admin] PATH_INFO: `/v3/projects/5491feaf62ca4fe1826dbdf61ba69728/users/219244970f7741138535157810d2117c/roles/de1374f966c04c27b579515b54334fd2` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:37.206460 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db453a7-a450-4e25-b635-8e3b01c013f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:45:37.207168 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db453a7-a450-4e25-b635-8e3b01c013f5 admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:37.207490 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b5474b-6c1e-4b72-a76f-65877dbcb34f admin admin] RBAC: Authorizing `identity:create_grant(project_id=5491feaf62ca4fe1826dbdf61ba69728, user_id=219244970f7741138535157810d2117c, role_id=de1374f966c04c27b579515b54334fd2)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:45:37.208000 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db453a7-a450-4e25-b635-8e3b01c013f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:37.208445 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db453a7-a450-4e25-b635-8e3b01c013f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:37.217533 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db453a7-a450-4e25-b635-8e3b01c013f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:45:37.217533 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db453a7-a450-4e25-b635-8e3b01c013f5 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:45:37.217765 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b5474b-6c1e-4b72-a76f-65877dbcb34f admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:45:37.235992 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 969/1924] 10.222.0.102 () {60 vars in 1488 bytes} [Mon Aug 1 15:45:37 2022] PUT /identity/v3/projects/5491feaf62ca4fe1826dbdf61ba69728/users/219244970f7741138535157810d2117c/roles/de1374f966c04c27b579515b54334fd2 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 15:45:37.354729 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 956/1925] 10.222.0.102 () {60 vars in 1158 bytes} [Mon Aug 1 15:45:37 2022] POST /identity/v3/projects => generated 386 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:45:37.359094 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b5474b-6c1e-4b72-a76f-65877dbcb34f admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:45:37.441581 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b5474b-6c1e-4b72-a76f-65877dbcb34f admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:45:37.502993 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83a1299-2200-4fc3-a562-638356866ce3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:45:37.503628 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83a1299-2200-4fc3-a562-638356866ce3 admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:37.503906 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83a1299-2200-4fc3-a562-638356866ce3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:37.504179 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83a1299-2200-4fc3-a562-638356866ce3 admin admin] PATH_INFO: `/v3/users` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:37.506118 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83a1299-2200-4fc3-a562-638356866ce3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:45:37.508492 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83a1299-2200-4fc3-a562-638356866ce3 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:45:37.638946 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 970/1926] 10.222.0.102 () {60 vars in 1149 bytes} [Mon Aug 1 15:45:37 2022] POST /identity/v3/users => generated 300 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:45:37.643338 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db453a7-a450-4e25-b635-8e3b01c013f5 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:45:37.655821 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db453a7-a450-4e25-b635-8e3b01c013f5 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:45:37.662324 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74588312-d175-4b4d-9b3a-b92893384687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:45:37.662999 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74588312-d175-4b4d-9b3a-b92893384687 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:37.663282 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74588312-d175-4b4d-9b3a-b92893384687 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:37.663562 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74588312-d175-4b4d-9b3a-b92893384687 admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:37.664276 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74588312-d175-4b4d-9b3a-b92893384687 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:45:37.665936 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74588312-d175-4b4d-9b3a-b92893384687 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:45:37.677515 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 957/1927] 10.222.0.102 () {58 vars in 1127 bytes} [Mon Aug 1 15:45:37 2022] GET /identity/v3/roles => generated 1427 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:45:37.682121 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83a1299-2200-4fc3-a562-638356866ce3 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:45:37.693251 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83a1299-2200-4fc3-a562-638356866ce3 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:45:37.698279 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c30bb30-ea2c-419d-a246-430ff96fa555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:45:37.699119 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c30bb30-ea2c-419d-a246-430ff96fa555 admin admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:37.699403 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c30bb30-ea2c-419d-a246-430ff96fa555 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:37.699681 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c30bb30-ea2c-419d-a246-430ff96fa555 admin admin] PATH_INFO: `/v3/projects/3f29cd18f0f24afc95bc2c6f775836a5/users/cd076ce9829f4b8ba9e16eabcfd8cc0c/roles/de1374f966c04c27b579515b54334fd2` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:37.718694 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c30bb30-ea2c-419d-a246-430ff96fa555 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f29cd18f0f24afc95bc2c6f775836a5, user_id=cd076ce9829f4b8ba9e16eabcfd8cc0c, role_id=de1374f966c04c27b579515b54334fd2)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:45:37.722050 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c30bb30-ea2c-419d-a246-430ff96fa555 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:45:37.890600 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 971/1928] 10.222.0.102 () {60 vars in 1488 bytes} [Mon Aug 1 15:45:37 2022] PUT /identity/v3/projects/3f29cd18f0f24afc95bc2c6f775836a5/users/cd076ce9829f4b8ba9e16eabcfd8cc0c/roles/de1374f966c04c27b579515b54334fd2 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:45:37.894645 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74588312-d175-4b4d-9b3a-b92893384687 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:45:37.904582 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74588312-d175-4b4d-9b3a-b92893384687 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:45:37.934251 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:45:37.967016 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf3234e-aa69-4576-9286-9616fee2a7bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:45:37.967648 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf3234e-aa69-4576-9286-9616fee2a7bd admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:37.967930 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf3234e-aa69-4576-9286-9616fee2a7bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:37.968234 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf3234e-aa69-4576-9286-9616fee2a7bd admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:37.968964 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf3234e-aa69-4576-9286-9616fee2a7bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:45:37.970604 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf3234e-aa69-4576-9286-9616fee2a7bd admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:45:37.984934 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 958/1929] 10.222.0.102 () {58 vars in 1127 bytes} [Mon Aug 1 15:45:37 2022] GET /identity/v3/roles => generated 1427 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 15:45:37.985997 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c30bb30-ea2c-419d-a246-430ff96fa555 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:45:37.996380 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c30bb30-ea2c-419d-a246-430ff96fa555 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:45:38.019734 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1229ac-8347-4722-a789-7ccb6f4df0ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:45:38.019734 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1229ac-8347-4722-a789-7ccb6f4df0ad admin admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:38.019734 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1229ac-8347-4722-a789-7ccb6f4df0ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:38.019734 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1229ac-8347-4722-a789-7ccb6f4df0ad admin admin] PATH_INFO: `/v3/projects/3f29cd18f0f24afc95bc2c6f775836a5/users/cd076ce9829f4b8ba9e16eabcfd8cc0c/roles/de1374f966c04c27b579515b54334fd2` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:38.020067 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1229ac-8347-4722-a789-7ccb6f4df0ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f29cd18f0f24afc95bc2c6f775836a5, user_id=cd076ce9829f4b8ba9e16eabcfd8cc0c, role_id=de1374f966c04c27b579515b54334fd2)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:45:38.020067 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1229ac-8347-4722-a789-7ccb6f4df0ad admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:45:38.041628 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 972/1930] 10.222.0.102 () {60 vars in 1488 bytes} [Mon Aug 1 15:45:37 2022] PUT /identity/v3/projects/3f29cd18f0f24afc95bc2c6f775836a5/users/cd076ce9829f4b8ba9e16eabcfd8cc0c/roles/de1374f966c04c27b579515b54334fd2 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:45:38.051756 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50122aa3-6cb6-497a-9764-788ceaf56272 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:38.052112 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50122aa3-6cb6-497a-9764-788ceaf56272 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:38.052478 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50122aa3-6cb6-497a-9764-788ceaf56272 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:38.087794 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-50122aa3-6cb6-497a-9764-788ceaf56272 None None] MFA Rules not processed for user `cd076ce9829f4b8ba9e16eabcfd8cc0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:45:38.089289 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-50122aa3-6cb6-497a-9764-788ceaf56272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:45:38.205263 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 959/1931] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:45:38 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:45:38.218869 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:45:38.228072 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1229ac-8347-4722-a789-7ccb6f4df0ad admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:45:38.234043 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-cb1229ac-8347-4722-a789-7ccb6f4df0ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:45:38.310222 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1229ac-8347-4722-a789-7ccb6f4df0ad admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:45:38.316191 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2c06c5-0bef-4cf4-abce-6b0aa4e0c186 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff810b37183c4729859c1b05edff1703', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:45:38.317024 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2c06c5-0bef-4cf4-abce-6b0aa4e0c186 service cinder] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:38.317401 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2c06c5-0bef-4cf4-abce-6b0aa4e0c186 service cinder] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:38.317802 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2c06c5-0bef-4cf4-abce-6b0aa4e0c186 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:38.412729 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2c06c5-0bef-4cf4-abce-6b0aa4e0c186 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:45:38.414474 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2c06c5-0bef-4cf4-abce-6b0aa4e0c186 service cinder] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:45:38.426105 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 973/1932] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:45:38 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:45:39.202309 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d0a691-5611-4774-a8c2-4e1dbf9d04d0 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:39.202863 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d0a691-5611-4774-a8c2-4e1dbf9d04d0 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:39.202863 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d0a691-5611-4774-a8c2-4e1dbf9d04d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:39.246105 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-09d0a691-5611-4774-a8c2-4e1dbf9d04d0 None None] MFA Rules not processed for user `219244970f7741138535157810d2117c`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:45:39.247731 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-09d0a691-5611-4774-a8c2-4e1dbf9d04d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:45:39.401403 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 960/1933] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:45:39 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:45:39.409257 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71408d22-95a4-4a33-887b-ee54409a2672 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:39.409636 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71408d22-95a4-4a33-887b-ee54409a2672 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:39.409636 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71408d22-95a4-4a33-887b-ee54409a2672 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:39.434676 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-71408d22-95a4-4a33-887b-ee54409a2672 None None] MFA Rules not processed for user `69079c4cf9f74cde986147848f080322`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:45:39.435882 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-71408d22-95a4-4a33-887b-ee54409a2672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:45:39.521164 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 974/1934] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:45:39 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:45:39.545242 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d0a691-5611-4774-a8c2-4e1dbf9d04d0 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:45:39.545242 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-09d0a691-5611-4774-a8c2-4e1dbf9d04d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:45:39.622956 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d0a691-5611-4774-a8c2-4e1dbf9d04d0 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:45:39.629383 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6971d455-826e-4b73-b767-6ddb50adda49 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77b43f1ee8cc4be3907a494abe90c1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:45:39.630034 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6971d455-826e-4b73-b767-6ddb50adda49 service nova] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:39.630324 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6971d455-826e-4b73-b767-6ddb50adda49 service nova] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:39.630597 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6971d455-826e-4b73-b767-6ddb50adda49 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:39.632397 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-6971d455-826e-4b73-b767-6ddb50adda49 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:45:39.646913 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6971d455-826e-4b73-b767-6ddb50adda49 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:45:39.653344 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6971d455-826e-4b73-b767-6ddb50adda49 service nova] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:45:39.661369 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 961/1935] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:45:39 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:45:39.824709 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:45:40.067147 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:45:40.562169 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:45:41.139862 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:45:42.803956 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:45:43.321998 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:45:45.226071 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:45:45.751487 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:45:46.260094 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71408d22-95a4-4a33-887b-ee54409a2672 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:45:46.262225 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-71408d22-95a4-4a33-887b-ee54409a2672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:45:46.277210 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71408d22-95a4-4a33-887b-ee54409a2672 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:45:46.284184 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbcbfe8-ff6f-42b9-84cf-f2adfeed9cbe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff810b37183c4729859c1b05edff1703', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:45:46.285135 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbcbfe8-ff6f-42b9-84cf-f2adfeed9cbe service cinder] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:46.285417 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbcbfe8-ff6f-42b9-84cf-f2adfeed9cbe service cinder] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:46.285852 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbcbfe8-ff6f-42b9-84cf-f2adfeed9cbe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:46.296557 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbcbfe8-ff6f-42b9-84cf-f2adfeed9cbe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:45:46.298408 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbcbfe8-ff6f-42b9-84cf-f2adfeed9cbe service cinder] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:45:46.311201 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 975/1936] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:45:46 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:45:47.261123 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:45:47.922306 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:45:49.344797 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:45:49.407855 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:45:50.894258 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:45:51.101291 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:45:53.420754 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:45:53.480431 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6971d455-826e-4b73-b767-6ddb50adda49 service nova] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:45:53.481871 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-6971d455-826e-4b73-b767-6ddb50adda49 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:45:53.549786 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6971d455-826e-4b73-b767-6ddb50adda49 service nova] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:45:53.555375 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f979669-beaf-4344-b568-90102ae1bb94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:45:53.556021 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f979669-beaf-4344-b568-90102ae1bb94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:53.556528 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f979669-beaf-4344-b568-90102ae1bb94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:53.556891 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f979669-beaf-4344-b568-90102ae1bb94 admin admin] PATH_INFO: `/v3/users/c8e525fa6fc04be79397f1a85346f340` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:53.558206 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f979669-beaf-4344-b568-90102ae1bb94 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c8e525fa6fc04be79397f1a85346f340)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:45:53.560139 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f979669-beaf-4344-b568-90102ae1bb94 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:45:53.712470 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:45:53.758160 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-0f979669-beaf-4344-b568-90102ae1bb94 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c8e525fa6fc04be79397f1a85346f340'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:45:53.841987 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-0f979669-beaf-4344-b568-90102ae1bb94 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c8e525fa6fc04be79397f1a85346f340'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:45:53.856116 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-0f979669-beaf-4344-b568-90102ae1bb94 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c8e525fa6fc04be79397f1a85346f340'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:45:53.856921 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-0f979669-beaf-4344-b568-90102ae1bb94 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c8e525fa6fc04be79397f1a85346f340'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:45:53.858158 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-0f979669-beaf-4344-b568-90102ae1bb94 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c8e525fa6fc04be79397f1a85346f340'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:45:53.871616 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 962/1937] 10.222.0.102 () {58 vars in 1229 bytes} [Mon Aug 1 15:45:53 2022] DELETE /identity/v3/users/c8e525fa6fc04be79397f1a85346f340 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:45:53.878105 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b609ffc4-0103-424a-8746-6a9d2f78d7c7 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:53.878479 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b609ffc4-0103-424a-8746-6a9d2f78d7c7 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:53.878859 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b609ffc4-0103-424a-8746-6a9d2f78d7c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:53.899846 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-b609ffc4-0103-424a-8746-6a9d2f78d7c7 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:45:53.901193 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-b609ffc4-0103-424a-8746-6a9d2f78d7c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:45:53.935320 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f979669-beaf-4344-b568-90102ae1bb94 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:45:53.939010 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-0f979669-beaf-4344-b568-90102ae1bb94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:45:53.971905 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 976/1938] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:45:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:45:53.985035 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b609ffc4-0103-424a-8746-6a9d2f78d7c7 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:45:53.985393 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-b609ffc4-0103-424a-8746-6a9d2f78d7c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:45:54.023183 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f979669-beaf-4344-b568-90102ae1bb94 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:45:54.032038 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9fccf6-813f-451b-8a56-d08a08dec779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:45:54.032701 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9fccf6-813f-451b-8a56-d08a08dec779 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:54.033039 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9fccf6-813f-451b-8a56-d08a08dec779 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:54.033316 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9fccf6-813f-451b-8a56-d08a08dec779 admin admin] PATH_INFO: `/v3/users/f8c81b028bc14bbd8f24e1ebae02ec6e` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:54.034737 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9fccf6-813f-451b-8a56-d08a08dec779 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8c81b028bc14bbd8f24e1ebae02ec6e)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:45:54.037014 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9fccf6-813f-451b-8a56-d08a08dec779 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:45:54.071703 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b609ffc4-0103-424a-8746-6a9d2f78d7c7 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:45:54.077797 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef48df9-ba0b-47c6-8ec9-ae6d3a6c8961 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a856a413100443939fe9b10daa868518', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:45:54.078430 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef48df9-ba0b-47c6-8ec9-ae6d3a6c8961 service neutron] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:54.078707 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef48df9-ba0b-47c6-8ec9-ae6d3a6c8961 service neutron] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:54.078979 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef48df9-ba0b-47c6-8ec9-ae6d3a6c8961 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:54.092713 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef48df9-ba0b-47c6-8ec9-ae6d3a6c8961 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:45:54.094190 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef48df9-ba0b-47c6-8ec9-ae6d3a6c8961 service neutron] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:45:54.104690 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 977/1939] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:45:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:45:54.190737 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef48df9-ba0b-47c6-8ec9-ae6d3a6c8961 service neutron] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:45:54.192215 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-aef48df9-ba0b-47c6-8ec9-ae6d3a6c8961 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:45:54.206030 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef48df9-ba0b-47c6-8ec9-ae6d3a6c8961 service neutron] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:45:54.210708 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752816b5-04c7-41ff-ac8c-b5d5315c4609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:45:54.211370 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752816b5-04c7-41ff-ac8c-b5d5315c4609 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:54.211649 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752816b5-04c7-41ff-ac8c-b5d5315c4609 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:54.211923 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752816b5-04c7-41ff-ac8c-b5d5315c4609 admin admin] PATH_INFO: `/v3/users/3596fde9478b465cb000c2f3d2f7f194` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:54.213121 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752816b5-04c7-41ff-ac8c-b5d5315c4609 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3596fde9478b465cb000c2f3d2f7f194)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:45:54.215114 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752816b5-04c7-41ff-ac8c-b5d5315c4609 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:45:54.262356 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-5c9fccf6-813f-451b-8a56-d08a08dec779 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8c81b028bc14bbd8f24e1ebae02ec6e'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:45:54.347188 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-5c9fccf6-813f-451b-8a56-d08a08dec779 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8c81b028bc14bbd8f24e1ebae02ec6e'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:45:54.360354 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-5c9fccf6-813f-451b-8a56-d08a08dec779 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8c81b028bc14bbd8f24e1ebae02ec6e'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:45:54.361305 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-5c9fccf6-813f-451b-8a56-d08a08dec779 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8c81b028bc14bbd8f24e1ebae02ec6e'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:45:54.363181 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-5c9fccf6-813f-451b-8a56-d08a08dec779 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8c81b028bc14bbd8f24e1ebae02ec6e'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:45:54.376222 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 963/1940] 10.222.0.102 () {58 vars in 1229 bytes} [Mon Aug 1 15:45:53 2022] DELETE /identity/v3/users/f8c81b028bc14bbd8f24e1ebae02ec6e => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 15:45:54.380700 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9033eab-30b5-4dde-bc93-d513d09d71c6 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:54.381120 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9033eab-30b5-4dde-bc93-d513d09d71c6 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:54.381463 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9033eab-30b5-4dde-bc93-d513d09d71c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:54.402290 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-e9033eab-30b5-4dde-bc93-d513d09d71c6 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:45:54.407691 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-e9033eab-30b5-4dde-bc93-d513d09d71c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:45:54.407925 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-752816b5-04c7-41ff-ac8c-b5d5315c4609 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3596fde9478b465cb000c2f3d2f7f194'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:45:54.422804 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-752816b5-04c7-41ff-ac8c-b5d5315c4609 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3596fde9478b465cb000c2f3d2f7f194'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:45:54.430921 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-752816b5-04c7-41ff-ac8c-b5d5315c4609 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3596fde9478b465cb000c2f3d2f7f194'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:45:54.431940 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-752816b5-04c7-41ff-ac8c-b5d5315c4609 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3596fde9478b465cb000c2f3d2f7f194'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:45:54.432771 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-752816b5-04c7-41ff-ac8c-b5d5315c4609 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3596fde9478b465cb000c2f3d2f7f194'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:45:54.439635 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:45:54.476734 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 964/1941] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:45:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 15:45:54.486439 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9033eab-30b5-4dde-bc93-d513d09d71c6 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:45:54.487872 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-e9033eab-30b5-4dde-bc93-d513d09d71c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:45:54.531173 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 978/1942] 10.222.0.102 () {58 vars in 1229 bytes} [Mon Aug 1 15:45:54 2022] DELETE /identity/v3/users/3596fde9478b465cb000c2f3d2f7f194 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 15:45:54.536639 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d16c3e-05b8-41e9-ae5c-b65e6dfef975 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:54.536998 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d16c3e-05b8-41e9-ae5c-b65e6dfef975 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:54.537283 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d16c3e-05b8-41e9-ae5c-b65e6dfef975 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:54.551151 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9033eab-30b5-4dde-bc93-d513d09d71c6 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:45:54.556587 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-c0d16c3e-05b8-41e9-ae5c-b65e6dfef975 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:45:54.557886 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-c0d16c3e-05b8-41e9-ae5c-b65e6dfef975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:45:54.600640 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe06fde-d961-4ba4-8656-101aa15d6922 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a856a413100443939fe9b10daa868518', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:45:54.601388 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe06fde-d961-4ba4-8656-101aa15d6922 service neutron] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:54.601687 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe06fde-d961-4ba4-8656-101aa15d6922 service neutron] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:54.601961 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe06fde-d961-4ba4-8656-101aa15d6922 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:54.623060 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 979/1943] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:45:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 15:45:54.623060 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d16c3e-05b8-41e9-ae5c-b65e6dfef975 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:45:54.630163 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-c0d16c3e-05b8-41e9-ae5c-b65e6dfef975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:45:54.643880 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d16c3e-05b8-41e9-ae5c-b65e6dfef975 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:45:54.649709 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ebda35-5e0a-41b4-bf37-808b202f097e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:45:54.650765 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ebda35-5e0a-41b4-bf37-808b202f097e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:54.651159 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ebda35-5e0a-41b4-bf37-808b202f097e admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:54.651436 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ebda35-5e0a-41b4-bf37-808b202f097e admin admin] PATH_INFO: `/v3/projects/0ca6e268674545739cd212a6cb871d17` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:54.652779 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ebda35-5e0a-41b4-bf37-808b202f097e admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ca6e268674545739cd212a6cb871d17)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:45:54.654736 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ebda35-5e0a-41b4-bf37-808b202f097e admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:45:54.677808 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe06fde-d961-4ba4-8656-101aa15d6922 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:45:54.679368 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe06fde-d961-4ba4-8656-101aa15d6922 service neutron] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:45:54.689149 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 965/1944] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:45:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 15:45:54.695239 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe06fde-d961-4ba4-8656-101aa15d6922 service neutron] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:45:54.698280 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe06fde-d961-4ba4-8656-101aa15d6922 service neutron] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:45:54.702260 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55b1c09-aeca-4754-b931-222189e8b789 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a856a413100443939fe9b10daa868518', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:45:54.702867 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55b1c09-aeca-4754-b931-222189e8b789 service neutron] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:54.703149 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55b1c09-aeca-4754-b931-222189e8b789 service neutron] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:54.703421 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55b1c09-aeca-4754-b931-222189e8b789 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:54.713624 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55b1c09-aeca-4754-b931-222189e8b789 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:45:54.715109 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55b1c09-aeca-4754-b931-222189e8b789 service neutron] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:45:54.725504 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 966/1945] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:45:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:45:54.747677 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-a7ebda35-5e0a-41b4-bf37-808b202f097e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ca6e268674545739cd212a6cb871d17', 'request_id': 'req-a7ebda35-5e0a-41b4-bf37-808b202f097e'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:45:54.754500 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-a7ebda35-5e0a-41b4-bf37-808b202f097e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ca6e268674545739cd212a6cb871d17', 'request_id': 'req-a7ebda35-5e0a-41b4-bf37-808b202f097e'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:45:54.824245 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-a7ebda35-5e0a-41b4-bf37-808b202f097e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ca6e268674545739cd212a6cb871d17', 'request_id': 'req-a7ebda35-5e0a-41b4-bf37-808b202f097e'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:45:54.836149 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-a7ebda35-5e0a-41b4-bf37-808b202f097e admin admin] The token cache is being invalidate because project 0ca6e268674545739cd212a6cb871d17 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80352) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 15:45:54.836436 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-a7ebda35-5e0a-41b4-bf37-808b202f097e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:45:54.837103 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-a7ebda35-5e0a-41b4-bf37-808b202f097e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:45:54.838673 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 980/1946] 10.222.0.102 () {58 vars in 1238 bytes} [Mon Aug 1 15:45:54 2022] DELETE /identity/v3/projects/0ca6e268674545739cd212a6cb871d17 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:45:54.842755 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55b1c09-aeca-4754-b931-222189e8b789 service neutron] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:45:54.853702 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55b1c09-aeca-4754-b931-222189e8b789 service neutron] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:45:54.911320 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3940d396-bcf8-413b-81cc-7e374ff3fb01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:45:54.911948 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3940d396-bcf8-413b-81cc-7e374ff3fb01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:54.912228 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3940d396-bcf8-413b-81cc-7e374ff3fb01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:54.912554 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3940d396-bcf8-413b-81cc-7e374ff3fb01 admin admin] PATH_INFO: `/v3/users/09e61a8af18f4db4907a8023e461c7c9` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:54.913713 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3940d396-bcf8-413b-81cc-7e374ff3fb01 admin admin] RBAC: Authorizing `identity:delete_user(user_id=09e61a8af18f4db4907a8023e461c7c9)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:45:54.915718 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3940d396-bcf8-413b-81cc-7e374ff3fb01 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:45:55.099795 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-3940d396-bcf8-413b-81cc-7e374ff3fb01 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '09e61a8af18f4db4907a8023e461c7c9'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:45:55.118150 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:45:55.190677 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ebda35-5e0a-41b4-bf37-808b202f097e admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:45:55.192991 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-3940d396-bcf8-413b-81cc-7e374ff3fb01 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '09e61a8af18f4db4907a8023e461c7c9'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:45:55.199928 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-a7ebda35-5e0a-41b4-bf37-808b202f097e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:45:55.208669 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ebda35-5e0a-41b4-bf37-808b202f097e admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:45:55.217207 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc74d5b-1e7e-439c-99be-9cf6c7c76621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:45:55.217462 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc74d5b-1e7e-439c-99be-9cf6c7c76621 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:55.217675 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc74d5b-1e7e-439c-99be-9cf6c7c76621 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:55.218103 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc74d5b-1e7e-439c-99be-9cf6c7c76621 admin admin] PATH_INFO: `/v3/projects/c4bd7da7048b4961b9d940c296480822` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:55.219717 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc74d5b-1e7e-439c-99be-9cf6c7c76621 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4bd7da7048b4961b9d940c296480822)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:45:55.222705 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc74d5b-1e7e-439c-99be-9cf6c7c76621 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:45:55.230395 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-3940d396-bcf8-413b-81cc-7e374ff3fb01 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '09e61a8af18f4db4907a8023e461c7c9'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:45:55.231378 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-3940d396-bcf8-413b-81cc-7e374ff3fb01 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '09e61a8af18f4db4907a8023e461c7c9'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:45:55.232289 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-3940d396-bcf8-413b-81cc-7e374ff3fb01 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '09e61a8af18f4db4907a8023e461c7c9'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:45:55.275506 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 967/1947] 10.222.0.102 () {58 vars in 1229 bytes} [Mon Aug 1 15:45:54 2022] DELETE /identity/v3/users/09e61a8af18f4db4907a8023e461c7c9 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:45:55.276627 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3940d396-bcf8-413b-81cc-7e374ff3fb01 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:45:55.278195 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-3940d396-bcf8-413b-81cc-7e374ff3fb01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:45:55.352839 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-efc74d5b-1e7e-439c-99be-9cf6c7c76621 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4bd7da7048b4961b9d940c296480822', 'request_id': 'req-efc74d5b-1e7e-439c-99be-9cf6c7c76621'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:45:55.361304 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-efc74d5b-1e7e-439c-99be-9cf6c7c76621 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4bd7da7048b4961b9d940c296480822', 'request_id': 'req-efc74d5b-1e7e-439c-99be-9cf6c7c76621'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:45:55.363407 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3940d396-bcf8-413b-81cc-7e374ff3fb01 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:45:55.426974 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33efe2f-0838-485c-a222-944f957aef8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:45:55.427628 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33efe2f-0838-485c-a222-944f957aef8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:55.427922 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33efe2f-0838-485c-a222-944f957aef8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:55.428198 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33efe2f-0838-485c-a222-944f957aef8d admin admin] PATH_INFO: `/v3/projects/7d0496b7693b4a1fae6fb881645b3981` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:55.429391 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33efe2f-0838-485c-a222-944f957aef8d admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d0496b7693b4a1fae6fb881645b3981)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:45:55.431325 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33efe2f-0838-485c-a222-944f957aef8d admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:45:55.494902 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-efc74d5b-1e7e-439c-99be-9cf6c7c76621 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4bd7da7048b4961b9d940c296480822', 'request_id': 'req-efc74d5b-1e7e-439c-99be-9cf6c7c76621'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:45:55.507445 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-efc74d5b-1e7e-439c-99be-9cf6c7c76621 admin admin] The token cache is being invalidate because project c4bd7da7048b4961b9d940c296480822 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80352) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 15:45:55.507741 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-efc74d5b-1e7e-439c-99be-9cf6c7c76621 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:45:55.508382 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-efc74d5b-1e7e-439c-99be-9cf6c7c76621 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:45:55.509968 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 981/1948] 10.222.0.102 () {58 vars in 1238 bytes} [Mon Aug 1 15:45:55 2022] DELETE /identity/v3/projects/c4bd7da7048b4961b9d940c296480822 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 15:45:55.513856 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc74d5b-1e7e-439c-99be-9cf6c7c76621 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:45:55.515136 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-efc74d5b-1e7e-439c-99be-9cf6c7c76621 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:45:55.529219 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc74d5b-1e7e-439c-99be-9cf6c7c76621 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:45:55.531665 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:45:55.539116 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3137cd51-5090-4e6a-8314-6fcdef0c2c7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:45:55.540142 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3137cd51-5090-4e6a-8314-6fcdef0c2c7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:55.540574 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3137cd51-5090-4e6a-8314-6fcdef0c2c7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:55.541053 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3137cd51-5090-4e6a-8314-6fcdef0c2c7d admin admin] PATH_INFO: `/v3/users/cd076ce9829f4b8ba9e16eabcfd8cc0c` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:55.548723 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3137cd51-5090-4e6a-8314-6fcdef0c2c7d admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd076ce9829f4b8ba9e16eabcfd8cc0c)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:45:55.548723 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3137cd51-5090-4e6a-8314-6fcdef0c2c7d admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:45:55.582543 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-d33efe2f-0838-485c-a222-944f957aef8d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d0496b7693b4a1fae6fb881645b3981', 'request_id': 'req-d33efe2f-0838-485c-a222-944f957aef8d'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:45:55.701083 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-d33efe2f-0838-485c-a222-944f957aef8d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d0496b7693b4a1fae6fb881645b3981', 'request_id': 'req-d33efe2f-0838-485c-a222-944f957aef8d'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:45:55.709446 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-d33efe2f-0838-485c-a222-944f957aef8d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d0496b7693b4a1fae6fb881645b3981', 'request_id': 'req-d33efe2f-0838-485c-a222-944f957aef8d'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:45:55.720251 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-d33efe2f-0838-485c-a222-944f957aef8d admin admin] The token cache is being invalidate because project 7d0496b7693b4a1fae6fb881645b3981 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80353) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 15:45:55.720569 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-d33efe2f-0838-485c-a222-944f957aef8d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:45:55.721246 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-d33efe2f-0838-485c-a222-944f957aef8d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:45:55.722837 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 968/1949] 10.222.0.102 () {58 vars in 1238 bytes} [Mon Aug 1 15:45:55 2022] DELETE /identity/v3/projects/7d0496b7693b4a1fae6fb881645b3981 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:45:55.726564 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33efe2f-0838-485c-a222-944f957aef8d admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:45:55.727894 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-d33efe2f-0838-485c-a222-944f957aef8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:45:55.775636 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-3137cd51-5090-4e6a-8314-6fcdef0c2c7d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd076ce9829f4b8ba9e16eabcfd8cc0c'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:45:55.787564 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-3137cd51-5090-4e6a-8314-6fcdef0c2c7d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd076ce9829f4b8ba9e16eabcfd8cc0c'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:45:55.790209 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33efe2f-0838-485c-a222-944f957aef8d admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:45:55.794653 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-3137cd51-5090-4e6a-8314-6fcdef0c2c7d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd076ce9829f4b8ba9e16eabcfd8cc0c'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:45:55.794913 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72408705-f869-499d-9673-6b9c4fc2bf56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:45:55.795334 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-3137cd51-5090-4e6a-8314-6fcdef0c2c7d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd076ce9829f4b8ba9e16eabcfd8cc0c'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:45:55.795556 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72408705-f869-499d-9673-6b9c4fc2bf56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:55.795839 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72408705-f869-499d-9673-6b9c4fc2bf56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:55.795953 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-3137cd51-5090-4e6a-8314-6fcdef0c2c7d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd076ce9829f4b8ba9e16eabcfd8cc0c'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:45:55.796113 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72408705-f869-499d-9673-6b9c4fc2bf56 admin admin] PATH_INFO: `/v3/users/2b454e308c7347e1968cf79fb7158360` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:55.797339 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72408705-f869-499d-9673-6b9c4fc2bf56 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b454e308c7347e1968cf79fb7158360)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:45:55.799313 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72408705-f869-499d-9673-6b9c4fc2bf56 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:45:55.884446 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 982/1950] 10.222.0.102 () {58 vars in 1229 bytes} [Mon Aug 1 15:45:55 2022] DELETE /identity/v3/users/cd076ce9829f4b8ba9e16eabcfd8cc0c => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 15:45:55.887830 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3137cd51-5090-4e6a-8314-6fcdef0c2c7d admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:45:55.887830 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-3137cd51-5090-4e6a-8314-6fcdef0c2c7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:45:55.961113 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3137cd51-5090-4e6a-8314-6fcdef0c2c7d admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:45:55.966632 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7748dd22-1283-4fad-8fd7-499bdbe76d30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:45:55.967291 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7748dd22-1283-4fad-8fd7-499bdbe76d30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:55.967569 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7748dd22-1283-4fad-8fd7-499bdbe76d30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:55.967906 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7748dd22-1283-4fad-8fd7-499bdbe76d30 admin admin] PATH_INFO: `/v3/projects/4e9e88cb8da84eceb0ff5ba693f33809` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:55.969100 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7748dd22-1283-4fad-8fd7-499bdbe76d30 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e9e88cb8da84eceb0ff5ba693f33809)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:45:55.971939 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7748dd22-1283-4fad-8fd7-499bdbe76d30 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:45:56.063365 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-72408705-f869-499d-9673-6b9c4fc2bf56 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b454e308c7347e1968cf79fb7158360'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:45:56.129130 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-72408705-f869-499d-9673-6b9c4fc2bf56 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b454e308c7347e1968cf79fb7158360'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:45:56.142933 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-72408705-f869-499d-9673-6b9c4fc2bf56 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b454e308c7347e1968cf79fb7158360'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:45:56.144166 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-72408705-f869-499d-9673-6b9c4fc2bf56 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b454e308c7347e1968cf79fb7158360'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:45:56.145227 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-72408705-f869-499d-9673-6b9c4fc2bf56 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b454e308c7347e1968cf79fb7158360'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:45:56.149600 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-7748dd22-1283-4fad-8fd7-499bdbe76d30 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e9e88cb8da84eceb0ff5ba693f33809', 'request_id': 'req-7748dd22-1283-4fad-8fd7-499bdbe76d30'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:45:56.156085 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-7748dd22-1283-4fad-8fd7-499bdbe76d30 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e9e88cb8da84eceb0ff5ba693f33809', 'request_id': 'req-7748dd22-1283-4fad-8fd7-499bdbe76d30'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:45:56.160690 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 969/1951] 10.222.0.102 () {58 vars in 1229 bytes} [Mon Aug 1 15:45:55 2022] DELETE /identity/v3/users/2b454e308c7347e1968cf79fb7158360 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 15:45:56.221620 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-7748dd22-1283-4fad-8fd7-499bdbe76d30 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e9e88cb8da84eceb0ff5ba693f33809', 'request_id': 'req-7748dd22-1283-4fad-8fd7-499bdbe76d30'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:45:56.235502 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-7748dd22-1283-4fad-8fd7-499bdbe76d30 admin admin] The token cache is being invalidate because project 4e9e88cb8da84eceb0ff5ba693f33809 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80352) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 15:45:56.236027 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-7748dd22-1283-4fad-8fd7-499bdbe76d30 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:45:56.237616 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-7748dd22-1283-4fad-8fd7-499bdbe76d30 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:45:56.239983 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 983/1952] 10.222.0.102 () {58 vars in 1238 bytes} [Mon Aug 1 15:45:55 2022] DELETE /identity/v3/projects/4e9e88cb8da84eceb0ff5ba693f33809 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:45:56.246104 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f420e2a8-d323-46e5-b922-380804b0f709 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:56.246463 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f420e2a8-d323-46e5-b922-380804b0f709 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:56.246808 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f420e2a8-d323-46e5-b922-380804b0f709 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:56.268989 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-f420e2a8-d323-46e5-b922-380804b0f709 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:45:56.270373 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-f420e2a8-d323-46e5-b922-380804b0f709 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:45:56.352594 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 970/1953] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:45:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:45:56.362169 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4b4109-4aeb-4567-b367-84ecfd98a5c7 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:56.362618 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4b4109-4aeb-4567-b367-84ecfd98a5c7 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:56.365438 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4b4109-4aeb-4567-b367-84ecfd98a5c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:56.387135 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-bf4b4109-4aeb-4567-b367-84ecfd98a5c7 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:45:56.388510 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-bf4b4109-4aeb-4567-b367-84ecfd98a5c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:45:56.397044 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 984/1954] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:45:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 15:45:56.401145 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f420e2a8-d323-46e5-b922-380804b0f709 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:45:56.411248 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f420e2a8-d323-46e5-b922-380804b0f709 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:45:56.416231 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76200d3-8bae-4f64-8be5-93380232c1ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:45:56.419820 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76200d3-8bae-4f64-8be5-93380232c1ae admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:56.419820 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76200d3-8bae-4f64-8be5-93380232c1ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:56.419820 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76200d3-8bae-4f64-8be5-93380232c1ae admin admin] PATH_INFO: `/v3/domains` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:56.419820 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76200d3-8bae-4f64-8be5-93380232c1ae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:45:56.419820 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76200d3-8bae-4f64-8be5-93380232c1ae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:45:56.420217 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76200d3-8bae-4f64-8be5-93380232c1ae admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:45:56.432819 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 971/1955] 10.222.0.102 () {58 vars in 1158 bytes} [Mon Aug 1 15:45:56 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:45:56.437874 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4b4109-4aeb-4567-b367-84ecfd98a5c7 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:45:56.449286 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4b4109-4aeb-4567-b367-84ecfd98a5c7 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:45:56.454828 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e76b92-7f2a-496e-90e7-52ab2390bbb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:45:56.455679 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e76b92-7f2a-496e-90e7-52ab2390bbb4 admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:56.456123 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e76b92-7f2a-496e-90e7-52ab2390bbb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:56.456548 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e76b92-7f2a-496e-90e7-52ab2390bbb4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:56.457567 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e76b92-7f2a-496e-90e7-52ab2390bbb4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:45:56.459925 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e76b92-7f2a-496e-90e7-52ab2390bbb4 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:45:56.470467 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76200d3-8bae-4f64-8be5-93380232c1ae admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:45:56.473754 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-a76200d3-8bae-4f64-8be5-93380232c1ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:45:56.499982 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76200d3-8bae-4f64-8be5-93380232c1ae admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:45:56.506364 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9e57de-4d14-4f85-bf4d-3c75b636b99e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:45:56.507871 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9e57de-4d14-4f85-bf4d-3c75b636b99e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:56.508260 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9e57de-4d14-4f85-bf4d-3c75b636b99e admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:56.508546 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9e57de-4d14-4f85-bf4d-3c75b636b99e admin admin] PATH_INFO: `/v3/projects/3f29cd18f0f24afc95bc2c6f775836a5` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:56.512978 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9e57de-4d14-4f85-bf4d-3c75b636b99e admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f29cd18f0f24afc95bc2c6f775836a5)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:45:56.512978 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9e57de-4d14-4f85-bf4d-3c75b636b99e admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:45:56.573488 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 985/1956] 10.222.0.102 () {60 vars in 1158 bytes} [Mon Aug 1 15:45:56 2022] POST /identity/v3/projects => generated 364 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:45:56.577963 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e76b92-7f2a-496e-90e7-52ab2390bbb4 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:45:56.650685 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-7f9e57de-4d14-4f85-bf4d-3c75b636b99e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f29cd18f0f24afc95bc2c6f775836a5', 'request_id': 'req-7f9e57de-4d14-4f85-bf4d-3c75b636b99e'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:45:56.652444 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e76b92-7f2a-496e-90e7-52ab2390bbb4 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:45:56.709592 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bf673a-efa7-4fb8-94d7-de02f8169419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:45:56.710205 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bf673a-efa7-4fb8-94d7-de02f8169419 admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:56.710480 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bf673a-efa7-4fb8-94d7-de02f8169419 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:56.710751 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bf673a-efa7-4fb8-94d7-de02f8169419 admin admin] PATH_INFO: `/v3/users` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:56.711434 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bf673a-efa7-4fb8-94d7-de02f8169419 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:45:56.713396 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bf673a-efa7-4fb8-94d7-de02f8169419 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:45:56.781356 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-7f9e57de-4d14-4f85-bf4d-3c75b636b99e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f29cd18f0f24afc95bc2c6f775836a5', 'request_id': 'req-7f9e57de-4d14-4f85-bf4d-3c75b636b99e'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:45:56.789826 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-7f9e57de-4d14-4f85-bf4d-3c75b636b99e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f29cd18f0f24afc95bc2c6f775836a5', 'request_id': 'req-7f9e57de-4d14-4f85-bf4d-3c75b636b99e'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:45:56.802434 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-7f9e57de-4d14-4f85-bf4d-3c75b636b99e admin admin] The token cache is being invalidate because project 3f29cd18f0f24afc95bc2c6f775836a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80353) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 15:45:56.802606 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-7f9e57de-4d14-4f85-bf4d-3c75b636b99e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:45:56.803448 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-7f9e57de-4d14-4f85-bf4d-3c75b636b99e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:45:56.805135 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 972/1957] 10.222.0.102 () {58 vars in 1238 bytes} [Mon Aug 1 15:45:56 2022] DELETE /identity/v3/projects/3f29cd18f0f24afc95bc2c6f775836a5 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:45:56.813699 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9e57de-4d14-4f85-bf4d-3c75b636b99e admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:45:56.815253 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-7f9e57de-4d14-4f85-bf4d-3c75b636b99e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:45:56.830988 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9e57de-4d14-4f85-bf4d-3c75b636b99e admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:45:56.837128 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea793e95-5e0a-4b95-8cff-9c48bb051a11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:45:56.837959 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea793e95-5e0a-4b95-8cff-9c48bb051a11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:56.838181 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea793e95-5e0a-4b95-8cff-9c48bb051a11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:56.838555 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea793e95-5e0a-4b95-8cff-9c48bb051a11 admin admin] PATH_INFO: `/v3/projects/861a00d7b4344ac4bb8181c60af8ecd1` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:56.839755 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea793e95-5e0a-4b95-8cff-9c48bb051a11 admin admin] RBAC: Authorizing `identity:delete_project(project_id=861a00d7b4344ac4bb8181c60af8ecd1)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:45:56.841898 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea793e95-5e0a-4b95-8cff-9c48bb051a11 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:45:56.899435 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 986/1958] 10.222.0.102 () {60 vars in 1149 bytes} [Mon Aug 1 15:45:56 2022] POST /identity/v3/users => generated 283 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:45:56.907069 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abf9f4a-4bc7-4bb0-8651-357c1d731ed1 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:56.907069 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abf9f4a-4bc7-4bb0-8651-357c1d731ed1 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:56.907069 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abf9f4a-4bc7-4bb0-8651-357c1d731ed1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:56.923287 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-1abf9f4a-4bc7-4bb0-8651-357c1d731ed1 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:45:56.924623 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-1abf9f4a-4bc7-4bb0-8651-357c1d731ed1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:45:56.932817 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 987/1959] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:45:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:45:56.933685 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abf9f4a-4bc7-4bb0-8651-357c1d731ed1 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:45:56.934917 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-1abf9f4a-4bc7-4bb0-8651-357c1d731ed1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:45:56.949169 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abf9f4a-4bc7-4bb0-8651-357c1d731ed1 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:45:56.971706 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-ea793e95-5e0a-4b95-8cff-9c48bb051a11 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '861a00d7b4344ac4bb8181c60af8ecd1', 'request_id': 'req-ea793e95-5e0a-4b95-8cff-9c48bb051a11'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:45:57.017375 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae4fafb-33c0-4679-9c3a-154de0bcf5b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:45:57.018049 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae4fafb-33c0-4679-9c3a-154de0bcf5b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:57.018329 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae4fafb-33c0-4679-9c3a-154de0bcf5b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:57.018602 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae4fafb-33c0-4679-9c3a-154de0bcf5b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:57.019371 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae4fafb-33c0-4679-9c3a-154de0bcf5b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:45:57.021024 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae4fafb-33c0-4679-9c3a-154de0bcf5b8 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:45:57.031456 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 988/1960] 10.222.0.102 () {58 vars in 1127 bytes} [Mon Aug 1 15:45:56 2022] GET /identity/v3/roles => generated 1427 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:45:57.032300 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bb17ee-41c8-4a01-8e8d-b7944362c9c1 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:57.032590 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bb17ee-41c8-4a01-8e8d-b7944362c9c1 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:57.032887 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bb17ee-41c8-4a01-8e8d-b7944362c9c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:57.052781 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-34bb17ee-41c8-4a01-8e8d-b7944362c9c1 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:45:57.054309 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-34bb17ee-41c8-4a01-8e8d-b7944362c9c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:45:57.054752 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-ea793e95-5e0a-4b95-8cff-9c48bb051a11 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '861a00d7b4344ac4bb8181c60af8ecd1', 'request_id': 'req-ea793e95-5e0a-4b95-8cff-9c48bb051a11'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:45:57.062150 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-ea793e95-5e0a-4b95-8cff-9c48bb051a11 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '861a00d7b4344ac4bb8181c60af8ecd1', 'request_id': 'req-ea793e95-5e0a-4b95-8cff-9c48bb051a11'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:45:57.068031 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 989/1961] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:45:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:45:57.068779 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bb17ee-41c8-4a01-8e8d-b7944362c9c1 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:45:57.078109 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-ea793e95-5e0a-4b95-8cff-9c48bb051a11 admin admin] The token cache is being invalidate because project 861a00d7b4344ac4bb8181c60af8ecd1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80353) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 15:45:57.078635 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bb17ee-41c8-4a01-8e8d-b7944362c9c1 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:45:57.078907 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-ea793e95-5e0a-4b95-8cff-9c48bb051a11 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:45:57.079652 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-ea793e95-5e0a-4b95-8cff-9c48bb051a11 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:45:57.081358 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 973/1962] 10.222.0.102 () {58 vars in 1238 bytes} [Mon Aug 1 15:45:56 2022] DELETE /identity/v3/projects/861a00d7b4344ac4bb8181c60af8ecd1 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:45:57.083417 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea793e95-5e0a-4b95-8cff-9c48bb051a11 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:45:57.083551 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8386cde5-c7f1-441e-af4e-eace90cc5232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:45:57.084082 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8386cde5-c7f1-441e-af4e-eace90cc5232 admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:57.084495 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8386cde5-c7f1-441e-af4e-eace90cc5232 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:57.084772 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8386cde5-c7f1-441e-af4e-eace90cc5232 admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:57.085497 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8386cde5-c7f1-441e-af4e-eace90cc5232 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:45:57.087109 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8386cde5-c7f1-441e-af4e-eace90cc5232 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:45:57.087226 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-ea793e95-5e0a-4b95-8cff-9c48bb051a11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:45:57.098415 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 990/1963] 10.222.0.102 () {58 vars in 1127 bytes} [Mon Aug 1 15:45:57 2022] GET /identity/v3/roles => generated 1427 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:45:57.101012 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea793e95-5e0a-4b95-8cff-9c48bb051a11 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:45:57.102644 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258a6305-9d2c-46cc-a8ca-04abb0ea2eb7 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:57.102941 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258a6305-9d2c-46cc-a8ca-04abb0ea2eb7 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:57.103223 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258a6305-9d2c-46cc-a8ca-04abb0ea2eb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:57.106335 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf12698-2f98-432b-9127-0c813d48a8fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:45:57.107001 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf12698-2f98-432b-9127-0c813d48a8fd admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:57.107360 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf12698-2f98-432b-9127-0c813d48a8fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:57.108121 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf12698-2f98-432b-9127-0c813d48a8fd admin admin] PATH_INFO: `/v3/domains` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:57.108486 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf12698-2f98-432b-9127-0c813d48a8fd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:45:57.108875 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf12698-2f98-432b-9127-0c813d48a8fd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:45:57.110613 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf12698-2f98-432b-9127-0c813d48a8fd admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:45:57.125298 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-258a6305-9d2c-46cc-a8ca-04abb0ea2eb7 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:45:57.126742 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-258a6305-9d2c-46cc-a8ca-04abb0ea2eb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:45:57.128258 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 974/1964] 10.222.0.102 () {58 vars in 1158 bytes} [Mon Aug 1 15:45:57 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:45:57.129157 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf12698-2f98-432b-9127-0c813d48a8fd admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:45:57.131294 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-dbf12698-2f98-432b-9127-0c813d48a8fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:45:57.142242 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 991/1965] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:45:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:45:57.142242 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258a6305-9d2c-46cc-a8ca-04abb0ea2eb7 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:45:57.149027 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf12698-2f98-432b-9127-0c813d48a8fd admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:45:57.152153 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258a6305-9d2c-46cc-a8ca-04abb0ea2eb7 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:45:57.153985 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979f0258-2e2d-4d0a-83f0-511042af8098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:45:57.154903 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979f0258-2e2d-4d0a-83f0-511042af8098 admin admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:57.155315 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979f0258-2e2d-4d0a-83f0-511042af8098 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:57.155651 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979f0258-2e2d-4d0a-83f0-511042af8098 admin admin] PATH_INFO: `/v3/projects/b58d7b464982457987736776430757aa/users/283a3f935ffa4f3d8d5dcd0d13b74b33/roles/27f5093ac0674d799cdbd17c68482e32` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:57.156819 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b8f4ee-5ff5-4c39-b52f-89af0e490ddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:45:57.157443 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b8f4ee-5ff5-4c39-b52f-89af0e490ddd admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:57.157724 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b8f4ee-5ff5-4c39-b52f-89af0e490ddd admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:57.158550 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b8f4ee-5ff5-4c39-b52f-89af0e490ddd admin admin] PATH_INFO: `/v3/projects` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:57.159209 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b8f4ee-5ff5-4c39-b52f-89af0e490ddd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:45:57.161156 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b8f4ee-5ff5-4c39-b52f-89af0e490ddd admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:45:57.171294 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:45:57.176976 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979f0258-2e2d-4d0a-83f0-511042af8098 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b58d7b464982457987736776430757aa, user_id=283a3f935ffa4f3d8d5dcd0d13b74b33, role_id=27f5093ac0674d799cdbd17c68482e32)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:45:57.180012 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979f0258-2e2d-4d0a-83f0-511042af8098 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:45:57.276669 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 975/1966] 10.222.0.102 () {60 vars in 1488 bytes} [Mon Aug 1 15:45:57 2022] PUT /identity/v3/projects/b58d7b464982457987736776430757aa/users/283a3f935ffa4f3d8d5dcd0d13b74b33/roles/27f5093ac0674d799cdbd17c68482e32 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:45:57.276669 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc056950-94d4-48f0-a5e4-9a29ddc873bb None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:57.276669 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc056950-94d4-48f0-a5e4-9a29ddc873bb None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:57.276669 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc056950-94d4-48f0-a5e4-9a29ddc873bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:57.280954 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 992/1967] 10.222.0.102 () {60 vars in 1158 bytes} [Mon Aug 1 15:45:57 2022] POST /identity/v3/projects => generated 358 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:45:57.282503 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d23bff1-7701-4377-9488-b10f799d3d56 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:57.282863 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d23bff1-7701-4377-9488-b10f799d3d56 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:57.283221 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d23bff1-7701-4377-9488-b10f799d3d56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:57.289355 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-cc056950-94d4-48f0-a5e4-9a29ddc873bb None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:45:57.290571 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-cc056950-94d4-48f0-a5e4-9a29ddc873bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:45:57.298344 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:45:57.313331 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-7d23bff1-7701-4377-9488-b10f799d3d56 None None] MFA Rules not processed for user `283a3f935ffa4f3d8d5dcd0d13b74b33`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:45:57.315011 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-7d23bff1-7701-4377-9488-b10f799d3d56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:45:57.349597 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 976/1968] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:45:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:45:57.350655 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc056950-94d4-48f0-a5e4-9a29ddc873bb None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:45:57.363875 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc056950-94d4-48f0-a5e4-9a29ddc873bb None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:45:57.369558 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a23b4f-0fd6-4cb7-b094-e0cacc7f3e70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:45:57.370587 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a23b4f-0fd6-4cb7-b094-e0cacc7f3e70 admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:57.370587 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a23b4f-0fd6-4cb7-b094-e0cacc7f3e70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:57.370976 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a23b4f-0fd6-4cb7-b094-e0cacc7f3e70 admin admin] PATH_INFO: `/v3/users` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:57.371860 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a23b4f-0fd6-4cb7-b094-e0cacc7f3e70 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:45:57.374638 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a23b4f-0fd6-4cb7-b094-e0cacc7f3e70 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:45:57.389818 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 993/1969] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:45:57 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:45:57.393904 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d23bff1-7701-4377-9488-b10f799d3d56 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:45:57.405815 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d23bff1-7701-4377-9488-b10f799d3d56 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:45:57.411002 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa05284-bc99-4d91-ac57-16e59467e91c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:45:57.411624 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa05284-bc99-4d91-ac57-16e59467e91c admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:57.411903 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa05284-bc99-4d91-ac57-16e59467e91c admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:57.412174 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa05284-bc99-4d91-ac57-16e59467e91c admin admin] PATH_INFO: `/v3/domains` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:57.412896 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa05284-bc99-4d91-ac57-16e59467e91c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:45:57.413204 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa05284-bc99-4d91-ac57-16e59467e91c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:45:57.414959 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa05284-bc99-4d91-ac57-16e59467e91c admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:45:57.429460 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 994/1970] 10.222.0.102 () {58 vars in 1158 bytes} [Mon Aug 1 15:45:57 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:45:57.430447 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa05284-bc99-4d91-ac57-16e59467e91c admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:45:57.441297 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa05284-bc99-4d91-ac57-16e59467e91c admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:45:57.446171 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0af4206-cd72-4d25-8dfc-6d78812e8903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:45:57.447650 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0af4206-cd72-4d25-8dfc-6d78812e8903 admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:57.447928 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0af4206-cd72-4d25-8dfc-6d78812e8903 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:57.448371 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0af4206-cd72-4d25-8dfc-6d78812e8903 admin admin] PATH_INFO: `/v3/projects` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:57.449387 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0af4206-cd72-4d25-8dfc-6d78812e8903 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:45:57.451845 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0af4206-cd72-4d25-8dfc-6d78812e8903 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:45:57.473437 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 977/1971] 10.222.0.102 () {60 vars in 1149 bytes} [Mon Aug 1 15:45:57 2022] POST /identity/v3/users => generated 280 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:45:57.473437 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a23b4f-0fd6-4cb7-b094-e0cacc7f3e70 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:45:57.483229 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a23b4f-0fd6-4cb7-b094-e0cacc7f3e70 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:45:57.488195 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66353833-32f0-45a0-90fa-2432f4d8d84c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:45:57.488822 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66353833-32f0-45a0-90fa-2432f4d8d84c admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:57.489132 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66353833-32f0-45a0-90fa-2432f4d8d84c admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:57.489418 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66353833-32f0-45a0-90fa-2432f4d8d84c admin admin] PATH_INFO: `/v3/projects` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:57.490075 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66353833-32f0-45a0-90fa-2432f4d8d84c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:45:57.491979 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66353833-32f0-45a0-90fa-2432f4d8d84c admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:45:57.610870 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 978/1972] 10.222.0.102 () {60 vars in 1158 bytes} [Mon Aug 1 15:45:57 2022] POST /identity/v3/projects => generated 388 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:45:57.612261 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66353833-32f0-45a0-90fa-2432f4d8d84c admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:45:57.614803 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 995/1973] 10.222.0.102 () {60 vars in 1158 bytes} [Mon Aug 1 15:45:57 2022] POST /identity/v3/projects => generated 366 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:45:57.617265 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0af4206-cd72-4d25-8dfc-6d78812e8903 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:45:57.706538 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66353833-32f0-45a0-90fa-2432f4d8d84c admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:45:57.758509 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0af4206-cd72-4d25-8dfc-6d78812e8903 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:45:57.764223 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9b1b33-c4ad-4869-ae81-8d5dc2072e0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:45:57.765057 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9b1b33-c4ad-4869-ae81-8d5dc2072e0f admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:57.765794 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9b1b33-c4ad-4869-ae81-8d5dc2072e0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:57.766172 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9b1b33-c4ad-4869-ae81-8d5dc2072e0f admin admin] PATH_INFO: `/v3/users` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:57.766952 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9b1b33-c4ad-4869-ae81-8d5dc2072e0f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:45:57.770758 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9b1b33-c4ad-4869-ae81-8d5dc2072e0f admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:45:57.815270 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e267b943-7b6d-4ecd-9bf6-b2e479a4ef3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:45:57.815909 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e267b943-7b6d-4ecd-9bf6-b2e479a4ef3a admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:57.816192 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e267b943-7b6d-4ecd-9bf6-b2e479a4ef3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:57.816467 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e267b943-7b6d-4ecd-9bf6-b2e479a4ef3a admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:57.819730 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e267b943-7b6d-4ecd-9bf6-b2e479a4ef3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:45:57.819730 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e267b943-7b6d-4ecd-9bf6-b2e479a4ef3a admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:45:57.835645 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 979/1974] 10.222.0.102 () {58 vars in 1127 bytes} [Mon Aug 1 15:45:57 2022] GET /identity/v3/roles => generated 1427 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:45:57.835645 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e267b943-7b6d-4ecd-9bf6-b2e479a4ef3a admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:45:57.848249 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e267b943-7b6d-4ecd-9bf6-b2e479a4ef3a admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:45:57.853520 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547e08a3-4656-4cd1-b629-f7422c48d28f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:45:57.854152 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547e08a3-4656-4cd1-b629-f7422c48d28f admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:57.854439 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547e08a3-4656-4cd1-b629-f7422c48d28f admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:57.854701 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547e08a3-4656-4cd1-b629-f7422c48d28f admin admin] PATH_INFO: `/v3/users` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:57.855366 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547e08a3-4656-4cd1-b629-f7422c48d28f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:45:57.857815 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547e08a3-4656-4cd1-b629-f7422c48d28f admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:45:58.013590 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 980/1975] 10.222.0.102 () {60 vars in 1149 bytes} [Mon Aug 1 15:45:57 2022] POST /identity/v3/users => generated 290 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:45:58.013590 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547e08a3-4656-4cd1-b629-f7422c48d28f admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:45:58.014471 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 996/1976] 10.222.0.102 () {60 vars in 1149 bytes} [Mon Aug 1 15:45:57 2022] POST /identity/v3/users => generated 295 bytes in 397 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:45:58.014812 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9b1b33-c4ad-4869-ae81-8d5dc2072e0f admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:45:58.027196 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547e08a3-4656-4cd1-b629-f7422c48d28f admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:45:58.028614 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9b1b33-c4ad-4869-ae81-8d5dc2072e0f admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:45:58.032756 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85691e45-deca-47c4-86ef-2be87861eaaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:45:58.034217 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85691e45-deca-47c4-86ef-2be87861eaaf admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:58.034656 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85691e45-deca-47c4-86ef-2be87861eaaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:58.035000 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85691e45-deca-47c4-86ef-2be87861eaaf admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:58.036143 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85691e45-deca-47c4-86ef-2be87861eaaf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:45:58.038081 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85691e45-deca-47c4-86ef-2be87861eaaf admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:45:58.039315 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff94fe84-8280-45e3-b50f-1b9e8b68b7ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:45:58.040260 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff94fe84-8280-45e3-b50f-1b9e8b68b7ec admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:58.040618 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff94fe84-8280-45e3-b50f-1b9e8b68b7ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:58.041023 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff94fe84-8280-45e3-b50f-1b9e8b68b7ec admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:58.041900 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff94fe84-8280-45e3-b50f-1b9e8b68b7ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:45:58.044006 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff94fe84-8280-45e3-b50f-1b9e8b68b7ec admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:45:58.062071 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 997/1977] 10.222.0.102 () {58 vars in 1127 bytes} [Mon Aug 1 15:45:58 2022] GET /identity/v3/roles => generated 1427 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:45:58.063239 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff94fe84-8280-45e3-b50f-1b9e8b68b7ec admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:45:58.066716 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 981/1978] 10.222.0.102 () {58 vars in 1127 bytes} [Mon Aug 1 15:45:58 2022] GET /identity/v3/roles => generated 1427 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:45:58.067799 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85691e45-deca-47c4-86ef-2be87861eaaf admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:45:58.075451 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff94fe84-8280-45e3-b50f-1b9e8b68b7ec admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:45:58.079523 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85691e45-deca-47c4-86ef-2be87861eaaf admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:45:58.080353 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2647186-1c20-425c-ab7f-7d94a174fb4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:45:58.081544 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2647186-1c20-425c-ab7f-7d94a174fb4d admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:58.081941 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2647186-1c20-425c-ab7f-7d94a174fb4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:58.082286 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2647186-1c20-425c-ab7f-7d94a174fb4d admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:58.083110 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2647186-1c20-425c-ab7f-7d94a174fb4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:45:58.084916 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2647186-1c20-425c-ab7f-7d94a174fb4d admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:45:58.085376 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3f4087-fcc6-4f96-90b1-0254a64fd496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:45:58.086068 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3f4087-fcc6-4f96-90b1-0254a64fd496 admin admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:58.086398 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3f4087-fcc6-4f96-90b1-0254a64fd496 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:58.086686 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3f4087-fcc6-4f96-90b1-0254a64fd496 admin admin] PATH_INFO: `/v3/projects/bc04b21e02b248bfab4e590fc093b0fd/users/2f7a0036595b481caa538bc9e725b4bd/roles/de1374f966c04c27b579515b54334fd2` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:58.098636 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 998/1979] 10.222.0.102 () {58 vars in 1127 bytes} [Mon Aug 1 15:45:58 2022] GET /identity/v3/roles => generated 1427 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:45:58.099948 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2647186-1c20-425c-ab7f-7d94a174fb4d admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:45:58.109017 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3f4087-fcc6-4f96-90b1-0254a64fd496 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc04b21e02b248bfab4e590fc093b0fd, user_id=2f7a0036595b481caa538bc9e725b4bd, role_id=de1374f966c04c27b579515b54334fd2)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:45:58.109017 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3f4087-fcc6-4f96-90b1-0254a64fd496 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:45:58.120254 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2647186-1c20-425c-ab7f-7d94a174fb4d admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:45:58.125312 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd1aebd-71b5-425e-89cb-39dd3a072060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:45:58.126833 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd1aebd-71b5-425e-89cb-39dd3a072060 admin admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:58.126833 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd1aebd-71b5-425e-89cb-39dd3a072060 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:58.126833 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd1aebd-71b5-425e-89cb-39dd3a072060 admin admin] PATH_INFO: `/v3/projects/daff4931d0a043c189c4d51d4b816e61/users/071b6cebb87d43a0b48ae492f18e97f2/roles/27f5093ac0674d799cdbd17c68482e32` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:58.141049 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd1aebd-71b5-425e-89cb-39dd3a072060 admin admin] RBAC: Authorizing `identity:create_grant(project_id=daff4931d0a043c189c4d51d4b816e61, user_id=071b6cebb87d43a0b48ae492f18e97f2, role_id=27f5093ac0674d799cdbd17c68482e32)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:45:58.143756 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd1aebd-71b5-425e-89cb-39dd3a072060 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:45:58.181389 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 982/1980] 10.222.0.102 () {60 vars in 1488 bytes} [Mon Aug 1 15:45:58 2022] PUT /identity/v3/projects/bc04b21e02b248bfab4e590fc093b0fd/users/2f7a0036595b481caa538bc9e725b4bd/roles/de1374f966c04c27b579515b54334fd2 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:45:58.182225 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3f4087-fcc6-4f96-90b1-0254a64fd496 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:45:58.216067 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 999/1981] 10.222.0.102 () {60 vars in 1488 bytes} [Mon Aug 1 15:45:58 2022] PUT /identity/v3/projects/daff4931d0a043c189c4d51d4b816e61/users/071b6cebb87d43a0b48ae492f18e97f2/roles/27f5093ac0674d799cdbd17c68482e32 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:45:58.218936 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd1aebd-71b5-425e-89cb-39dd3a072060 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:45:58.247900 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3f4087-fcc6-4f96-90b1-0254a64fd496 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:45:58.297565 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd1aebd-71b5-425e-89cb-39dd3a072060 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:45:58.304834 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822d658d-9386-40c3-9273-f65b63ad309e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:45:58.305550 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822d658d-9386-40c3-9273-f65b63ad309e admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:58.305826 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822d658d-9386-40c3-9273-f65b63ad309e admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:58.306109 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822d658d-9386-40c3-9273-f65b63ad309e admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:58.306798 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822d658d-9386-40c3-9273-f65b63ad309e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:45:58.308426 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822d658d-9386-40c3-9273-f65b63ad309e admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:45:58.324222 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1000/1982] 10.222.0.102 () {58 vars in 1127 bytes} [Mon Aug 1 15:45:58 2022] GET /identity/v3/roles => generated 1427 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:45:58.325942 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529808a4-214e-4e55-9001-aab8d269b4f6 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:58.326308 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529808a4-214e-4e55-9001-aab8d269b4f6 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:58.327675 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529808a4-214e-4e55-9001-aab8d269b4f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:58.333528 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7fbdcb-6f55-432b-a59b-78cb3d236b3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:45:58.334161 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7fbdcb-6f55-432b-a59b-78cb3d236b3b admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:58.334441 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7fbdcb-6f55-432b-a59b-78cb3d236b3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:58.334712 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7fbdcb-6f55-432b-a59b-78cb3d236b3b admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:58.335405 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7fbdcb-6f55-432b-a59b-78cb3d236b3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:45:58.337039 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7fbdcb-6f55-432b-a59b-78cb3d236b3b admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:45:58.348396 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 983/1983] 10.222.0.102 () {58 vars in 1127 bytes} [Mon Aug 1 15:45:58 2022] GET /identity/v3/roles => generated 1427 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:45:58.349459 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7fbdcb-6f55-432b-a59b-78cb3d236b3b admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:45:58.362543 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7fbdcb-6f55-432b-a59b-78cb3d236b3b admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:45:58.362867 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-529808a4-214e-4e55-9001-aab8d269b4f6 None None] MFA Rules not processed for user `071b6cebb87d43a0b48ae492f18e97f2`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:45:58.364277 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-529808a4-214e-4e55-9001-aab8d269b4f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:45:58.367913 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6ae632-2f34-4799-b0ef-a44aadf37adb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:45:58.368899 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6ae632-2f34-4799-b0ef-a44aadf37adb admin admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:58.369402 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6ae632-2f34-4799-b0ef-a44aadf37adb admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:58.369783 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6ae632-2f34-4799-b0ef-a44aadf37adb admin admin] PATH_INFO: `/v3/projects/bc04b21e02b248bfab4e590fc093b0fd/users/2f7a0036595b481caa538bc9e725b4bd/roles/de1374f966c04c27b579515b54334fd2` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:58.371911 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6ae632-2f34-4799-b0ef-a44aadf37adb admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc04b21e02b248bfab4e590fc093b0fd, user_id=2f7a0036595b481caa538bc9e725b4bd, role_id=de1374f966c04c27b579515b54334fd2)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:45:58.374726 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6ae632-2f34-4799-b0ef-a44aadf37adb admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:45:58.385296 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 984/1984] 10.222.0.102 () {60 vars in 1488 bytes} [Mon Aug 1 15:45:58 2022] PUT /identity/v3/projects/bc04b21e02b248bfab4e590fc093b0fd/users/2f7a0036595b481caa538bc9e725b4bd/roles/de1374f966c04c27b579515b54334fd2 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:45:58.386083 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6ae632-2f34-4799-b0ef-a44aadf37adb admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:45:58.432889 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1001/1985] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:45:58 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:45:58.434316 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87214fd9-3ace-4e07-8775-a9102ec103cd None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:58.434607 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87214fd9-3ace-4e07-8775-a9102ec103cd None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:58.434883 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87214fd9-3ace-4e07-8775-a9102ec103cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:58.453552 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6ae632-2f34-4799-b0ef-a44aadf37adb admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:45:58.458154 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f58be9-d0b2-4d00-943d-fbc97cecd1a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:45:58.459173 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f58be9-d0b2-4d00-943d-fbc97cecd1a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:58.465545 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f58be9-d0b2-4d00-943d-fbc97cecd1a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:58.465545 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f58be9-d0b2-4d00-943d-fbc97cecd1a7 admin admin] PATH_INFO: `/v3/projects/4777369646614c738cd2ad9cbfa8da8b/users/9514ce5cc69246afb379822d7122c7c6/roles/27f5093ac0674d799cdbd17c68482e32` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:58.468942 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-87214fd9-3ace-4e07-8775-a9102ec103cd None None] MFA Rules not processed for user `2f7a0036595b481caa538bc9e725b4bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:45:58.470171 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-87214fd9-3ace-4e07-8775-a9102ec103cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:45:58.476123 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f58be9-d0b2-4d00-943d-fbc97cecd1a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4777369646614c738cd2ad9cbfa8da8b, user_id=9514ce5cc69246afb379822d7122c7c6, role_id=27f5093ac0674d799cdbd17c68482e32)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:45:58.479060 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f58be9-d0b2-4d00-943d-fbc97cecd1a7 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:45:58.529296 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:45:58.539273 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1002/1986] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:45:58 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:45:58.540982 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87214fd9-3ace-4e07-8775-a9102ec103cd None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:45:58.542404 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-87214fd9-3ace-4e07-8775-a9102ec103cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:45:58.558189 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 985/1987] 10.222.0.102 () {60 vars in 1488 bytes} [Mon Aug 1 15:45:58 2022] PUT /identity/v3/projects/4777369646614c738cd2ad9cbfa8da8b/users/9514ce5cc69246afb379822d7122c7c6/roles/27f5093ac0674d799cdbd17c68482e32 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:45:58.559135 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f58be9-d0b2-4d00-943d-fbc97cecd1a7 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:45:58.560904 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-53f58be9-d0b2-4d00-943d-fbc97cecd1a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:45:58.608979 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87214fd9-3ace-4e07-8775-a9102ec103cd None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:45:58.620122 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f58be9-d0b2-4d00-943d-fbc97cecd1a7 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:45:58.623882 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ad07df-4c4c-4085-99a4-f62182071545 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff810b37183c4729859c1b05edff1703', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:45:58.628773 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ad07df-4c4c-4085-99a4-f62182071545 service cinder] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:58.628773 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ad07df-4c4c-4085-99a4-f62182071545 service cinder] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:58.628773 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ad07df-4c4c-4085-99a4-f62182071545 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:58.660391 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933328b6-f25f-4b96-9ef1-39eeaaa487a1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff810b37183c4729859c1b05edff1703', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:45:58.661036 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933328b6-f25f-4b96-9ef1-39eeaaa487a1 service cinder] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:58.661320 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933328b6-f25f-4b96-9ef1-39eeaaa487a1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:58.661597 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933328b6-f25f-4b96-9ef1-39eeaaa487a1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:58.682773 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:45:58.684981 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ad07df-4c4c-4085-99a4-f62182071545 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:45:58.691789 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ad07df-4c4c-4085-99a4-f62182071545 service cinder] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:45:58.695996 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 986/1988] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:45:58 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:45:58.697276 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba119a7-76b4-48a2-b432-55b92ccd6c51 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:58.697538 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba119a7-76b4-48a2-b432-55b92ccd6c51 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:58.697808 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba119a7-76b4-48a2-b432-55b92ccd6c51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:58.724763 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933328b6-f25f-4b96-9ef1-39eeaaa487a1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:45:58.726263 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933328b6-f25f-4b96-9ef1-39eeaaa487a1 service cinder] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:45:58.726671 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-4ba119a7-76b4-48a2-b432-55b92ccd6c51 None None] MFA Rules not processed for user `9514ce5cc69246afb379822d7122c7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:45:58.727885 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-4ba119a7-76b4-48a2-b432-55b92ccd6c51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:45:58.736970 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1003/1989] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:45:58 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:45:58.751701 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933328b6-f25f-4b96-9ef1-39eeaaa487a1 service cinder] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:45:58.797762 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 987/1990] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:45:58 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:45:58.803134 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba119a7-76b4-48a2-b432-55b92ccd6c51 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:45:58.825272 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933328b6-f25f-4b96-9ef1-39eeaaa487a1 service cinder] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:45:58.831358 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93549291-4b92-464f-bf73-81ffb5aa7ba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:45:58.836533 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93549291-4b92-464f-bf73-81ffb5aa7ba2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:58.836533 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93549291-4b92-464f-bf73-81ffb5aa7ba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:58.836533 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93549291-4b92-464f-bf73-81ffb5aa7ba2 admin admin] PATH_INFO: `/v3/users/071b6cebb87d43a0b48ae492f18e97f2` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:58.836533 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93549291-4b92-464f-bf73-81ffb5aa7ba2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=071b6cebb87d43a0b48ae492f18e97f2)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:45:58.836533 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93549291-4b92-464f-bf73-81ffb5aa7ba2 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:45:58.882749 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba119a7-76b4-48a2-b432-55b92ccd6c51 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:45:58.889195 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce2b051-3bab-4f54-866b-2be8c032ff69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:45:58.889831 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce2b051-3bab-4f54-866b-2be8c032ff69 admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:58.890121 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce2b051-3bab-4f54-866b-2be8c032ff69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:58.890390 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce2b051-3bab-4f54-866b-2be8c032ff69 admin admin] PATH_INFO: `/v3/projects` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:58.891058 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce2b051-3bab-4f54-866b-2be8c032ff69 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:45:58.893101 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce2b051-3bab-4f54-866b-2be8c032ff69 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:45:59.047901 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 988/1991] 10.222.0.102 () {60 vars in 1158 bytes} [Mon Aug 1 15:45:58 2022] POST /identity/v3/projects => generated 388 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 15:45:59.047901 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce2b051-3bab-4f54-866b-2be8c032ff69 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:45:59.061535 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-93549291-4b92-464f-bf73-81ffb5aa7ba2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '071b6cebb87d43a0b48ae492f18e97f2'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:45:59.073771 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-93549291-4b92-464f-bf73-81ffb5aa7ba2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '071b6cebb87d43a0b48ae492f18e97f2'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:45:59.081587 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-93549291-4b92-464f-bf73-81ffb5aa7ba2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '071b6cebb87d43a0b48ae492f18e97f2'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:45:59.082302 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-93549291-4b92-464f-bf73-81ffb5aa7ba2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '071b6cebb87d43a0b48ae492f18e97f2'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:45:59.083018 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-93549291-4b92-464f-bf73-81ffb5aa7ba2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '071b6cebb87d43a0b48ae492f18e97f2'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:45:59.108657 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce2b051-3bab-4f54-866b-2be8c032ff69 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:45:59.112433 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c310b0e-937d-4826-a6f9-165b5ef4f08b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff810b37183c4729859c1b05edff1703', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:45:59.113011 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c310b0e-937d-4826-a6f9-165b5ef4f08b service cinder] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:59.115784 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c310b0e-937d-4826-a6f9-165b5ef4f08b service cinder] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:59.115784 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c310b0e-937d-4826-a6f9-165b5ef4f08b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:59.115784 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-6c310b0e-937d-4826-a6f9-165b5ef4f08b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:45:59.174618 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c310b0e-937d-4826-a6f9-165b5ef4f08b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:45:59.176092 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c310b0e-937d-4826-a6f9-165b5ef4f08b service cinder] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:45:59.186206 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 989/1992] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:45:59 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:45:59.187125 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c310b0e-937d-4826-a6f9-165b5ef4f08b service cinder] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:45:59.188781 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-6c310b0e-937d-4826-a6f9-165b5ef4f08b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:45:59.190355 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1004/1993] 10.222.0.102 () {58 vars in 1229 bytes} [Mon Aug 1 15:45:58 2022] DELETE /identity/v3/users/071b6cebb87d43a0b48ae492f18e97f2 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:45:59.191700 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc23635b-4a4d-4ba7-987f-7f889a1de07c None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:59.191983 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc23635b-4a4d-4ba7-987f-7f889a1de07c None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:59.192261 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc23635b-4a4d-4ba7-987f-7f889a1de07c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:59.218489 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-fc23635b-4a4d-4ba7-987f-7f889a1de07c None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:45:59.220516 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-fc23635b-4a4d-4ba7-987f-7f889a1de07c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:45:59.284456 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c310b0e-937d-4826-a6f9-165b5ef4f08b service cinder] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:45:59.304364 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1005/1994] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:45:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:45:59.313950 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc23635b-4a4d-4ba7-987f-7f889a1de07c None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:45:59.315823 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-fc23635b-4a4d-4ba7-987f-7f889a1de07c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:45:59.342659 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8beb37-cb06-4f5b-8246-c8a62c149712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:45:59.343487 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8beb37-cb06-4f5b-8246-c8a62c149712 admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:59.343761 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8beb37-cb06-4f5b-8246-c8a62c149712 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:59.344061 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8beb37-cb06-4f5b-8246-c8a62c149712 admin admin] PATH_INFO: `/v3/users` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:59.344735 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8beb37-cb06-4f5b-8246-c8a62c149712 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:45:59.346802 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8beb37-cb06-4f5b-8246-c8a62c149712 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:45:59.377877 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc23635b-4a4d-4ba7-987f-7f889a1de07c None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:45:59.381528 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8585f8c-f98e-4477-9b2d-1fb8b48c6920 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a856a413100443939fe9b10daa868518', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:45:59.382152 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8585f8c-f98e-4477-9b2d-1fb8b48c6920 service neutron] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:59.382433 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8585f8c-f98e-4477-9b2d-1fb8b48c6920 service neutron] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:59.382727 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8585f8c-f98e-4477-9b2d-1fb8b48c6920 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:59.391750 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8585f8c-f98e-4477-9b2d-1fb8b48c6920 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:45:59.393779 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8585f8c-f98e-4477-9b2d-1fb8b48c6920 service neutron] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:45:59.403387 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1006/1995] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:45:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 15:45:59.428363 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 990/1996] 10.222.0.102 () {60 vars in 1149 bytes} [Mon Aug 1 15:45:59 2022] POST /identity/v3/users => generated 301 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:45:59.432315 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8585f8c-f98e-4477-9b2d-1fb8b48c6920 service neutron] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:45:59.442752 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8585f8c-f98e-4477-9b2d-1fb8b48c6920 service neutron] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:45:59.447432 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39725995-e651-4682-8f8d-2f2f71f91ca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:45:59.448041 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39725995-e651-4682-8f8d-2f2f71f91ca5 admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:59.448320 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39725995-e651-4682-8f8d-2f2f71f91ca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:59.448592 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39725995-e651-4682-8f8d-2f2f71f91ca5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:59.449366 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39725995-e651-4682-8f8d-2f2f71f91ca5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:45:59.450972 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39725995-e651-4682-8f8d-2f2f71f91ca5 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:45:59.462310 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1007/1997] 10.222.0.102 () {58 vars in 1127 bytes} [Mon Aug 1 15:45:59 2022] GET /identity/v3/roles => generated 1427 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 15:45:59.466507 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8beb37-cb06-4f5b-8246-c8a62c149712 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:45:59.477071 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8beb37-cb06-4f5b-8246-c8a62c149712 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:45:59.482050 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9a12ee-e034-4aaa-9c7d-2ef031396767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:45:59.482756 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9a12ee-e034-4aaa-9c7d-2ef031396767 admin admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:59.483041 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9a12ee-e034-4aaa-9c7d-2ef031396767 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:59.483315 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9a12ee-e034-4aaa-9c7d-2ef031396767 admin admin] PATH_INFO: `/v3/projects/9230dd76cdd44884a1fa49ffe992b15e/users/24d74d1645e043df872472be38bb6e40/roles/de1374f966c04c27b579515b54334fd2` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:59.498567 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9a12ee-e034-4aaa-9c7d-2ef031396767 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9230dd76cdd44884a1fa49ffe992b15e, user_id=24d74d1645e043df872472be38bb6e40, role_id=de1374f966c04c27b579515b54334fd2)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:45:59.504247 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9a12ee-e034-4aaa-9c7d-2ef031396767 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:45:59.645806 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 991/1998] 10.222.0.102 () {60 vars in 1488 bytes} [Mon Aug 1 15:45:59 2022] PUT /identity/v3/projects/9230dd76cdd44884a1fa49ffe992b15e/users/24d74d1645e043df872472be38bb6e40/roles/de1374f966c04c27b579515b54334fd2 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:45:59.650047 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39725995-e651-4682-8f8d-2f2f71f91ca5 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:45:59.668070 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39725995-e651-4682-8f8d-2f2f71f91ca5 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:45:59.738442 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6b9369-427e-44a3-acea-623fbb658922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:45:59.739060 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6b9369-427e-44a3-acea-623fbb658922 admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:59.739337 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6b9369-427e-44a3-acea-623fbb658922 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:59.743327 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6b9369-427e-44a3-acea-623fbb658922 admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:59.743327 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6b9369-427e-44a3-acea-623fbb658922 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:45:59.743327 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6b9369-427e-44a3-acea-623fbb658922 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:45:59.752472 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1008/1999] 10.222.0.102 () {58 vars in 1127 bytes} [Mon Aug 1 15:45:59 2022] GET /identity/v3/roles => generated 1427 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:45:59.756590 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9a12ee-e034-4aaa-9c7d-2ef031396767 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:45:59.767776 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9a12ee-e034-4aaa-9c7d-2ef031396767 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:45:59.773095 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522a2990-ed24-46c5-80d4-c1ca45cb853b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:45:59.773838 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522a2990-ed24-46c5-80d4-c1ca45cb853b admin admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:59.774160 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522a2990-ed24-46c5-80d4-c1ca45cb853b admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:59.774437 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522a2990-ed24-46c5-80d4-c1ca45cb853b admin admin] PATH_INFO: `/v3/projects/9230dd76cdd44884a1fa49ffe992b15e/users/24d74d1645e043df872472be38bb6e40/roles/de1374f966c04c27b579515b54334fd2` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:59.776431 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522a2990-ed24-46c5-80d4-c1ca45cb853b admin admin] RBAC: Authorizing `identity:create_grant(project_id=9230dd76cdd44884a1fa49ffe992b15e, user_id=24d74d1645e043df872472be38bb6e40, role_id=de1374f966c04c27b579515b54334fd2)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:45:59.778961 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:45:59.779185 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522a2990-ed24-46c5-80d4-c1ca45cb853b admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:45:59.789915 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 992/2000] 10.222.0.102 () {60 vars in 1488 bytes} [Mon Aug 1 15:45:59 2022] PUT /identity/v3/projects/9230dd76cdd44884a1fa49ffe992b15e/users/24d74d1645e043df872472be38bb6e40/roles/de1374f966c04c27b579515b54334fd2 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:45:59.801646 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44be1f53-3548-479e-b9ac-6c5c6c612613 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:59.801931 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44be1f53-3548-479e-b9ac-6c5c6c612613 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:59.802208 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44be1f53-3548-479e-b9ac-6c5c6c612613 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:59.830995 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-44be1f53-3548-479e-b9ac-6c5c6c612613 None None] MFA Rules not processed for user `24d74d1645e043df872472be38bb6e40`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:45:59.832209 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-44be1f53-3548-479e-b9ac-6c5c6c612613 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:45:59.888361 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522a2990-ed24-46c5-80d4-c1ca45cb853b admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:45:59.890474 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-522a2990-ed24-46c5-80d4-c1ca45cb853b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:45:59.927188 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1009/2001] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:45:59 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:45:59.938905 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44be1f53-3548-479e-b9ac-6c5c6c612613 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:45:59.940991 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-44be1f53-3548-479e-b9ac-6c5c6c612613 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:45:59.979602 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522a2990-ed24-46c5-80d4-c1ca45cb853b admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:45:59.985851 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deca82dc-05cd-4b89-8492-e5c2d8fcc1a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:45:59.986886 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deca82dc-05cd-4b89-8492-e5c2d8fcc1a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:45:59.987352 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deca82dc-05cd-4b89-8492-e5c2d8fcc1a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:45:59.987630 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deca82dc-05cd-4b89-8492-e5c2d8fcc1a0 admin admin] PATH_INFO: `/v3/projects/daff4931d0a043c189c4d51d4b816e61` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:45:59.988867 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deca82dc-05cd-4b89-8492-e5c2d8fcc1a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=daff4931d0a043c189c4d51d4b816e61)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:45:59.990980 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deca82dc-05cd-4b89-8492-e5c2d8fcc1a0 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:46:00.004778 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44be1f53-3548-479e-b9ac-6c5c6c612613 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:46:00.009132 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fa155f-0925-4853-9fa5-3ec34c1cf9f2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff810b37183c4729859c1b05edff1703', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:46:00.009788 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fa155f-0925-4853-9fa5-3ec34c1cf9f2 service cinder] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:46:00.010067 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fa155f-0925-4853-9fa5-3ec34c1cf9f2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:46:00.010449 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fa155f-0925-4853-9fa5-3ec34c1cf9f2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:46:00.020573 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fa155f-0925-4853-9fa5-3ec34c1cf9f2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:46:00.022039 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fa155f-0925-4853-9fa5-3ec34c1cf9f2 service cinder] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:46:00.031923 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1010/2002] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:45:59 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 15:46:00.043781 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:46:00.154744 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-deca82dc-05cd-4b89-8492-e5c2d8fcc1a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'daff4931d0a043c189c4d51d4b816e61', 'request_id': 'req-deca82dc-05cd-4b89-8492-e5c2d8fcc1a0'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:46:00.260472 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-deca82dc-05cd-4b89-8492-e5c2d8fcc1a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'daff4931d0a043c189c4d51d4b816e61', 'request_id': 'req-deca82dc-05cd-4b89-8492-e5c2d8fcc1a0'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:46:00.268020 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-deca82dc-05cd-4b89-8492-e5c2d8fcc1a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'daff4931d0a043c189c4d51d4b816e61', 'request_id': 'req-deca82dc-05cd-4b89-8492-e5c2d8fcc1a0'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:46:00.278351 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-deca82dc-05cd-4b89-8492-e5c2d8fcc1a0 admin admin] The token cache is being invalidate because project daff4931d0a043c189c4d51d4b816e61 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80353) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 15:46:00.278637 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-deca82dc-05cd-4b89-8492-e5c2d8fcc1a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:46:00.279301 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-deca82dc-05cd-4b89-8492-e5c2d8fcc1a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:46:00.280854 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 993/2003] 10.222.0.102 () {58 vars in 1238 bytes} [Mon Aug 1 15:45:59 2022] DELETE /identity/v3/projects/daff4931d0a043c189c4d51d4b816e61 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:46:00.286769 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a7405e-848c-49c4-9eed-eb029b0f4965 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:46:00.287253 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a7405e-848c-49c4-9eed-eb029b0f4965 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:46:00.287343 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a7405e-848c-49c4-9eed-eb029b0f4965 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:46:00.306796 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-09a7405e-848c-49c4-9eed-eb029b0f4965 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:46:00.308046 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-09a7405e-848c-49c4-9eed-eb029b0f4965 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:46:00.373370 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1011/2004] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:46:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:46:00.381906 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce89c2c-d1f1-4ec3-bbd2-0a27a17715fa None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:46:00.382195 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce89c2c-d1f1-4ec3-bbd2-0a27a17715fa None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:46:00.382468 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce89c2c-d1f1-4ec3-bbd2-0a27a17715fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:46:00.418464 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-1ce89c2c-d1f1-4ec3-bbd2-0a27a17715fa None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:46:00.418464 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-1ce89c2c-d1f1-4ec3-bbd2-0a27a17715fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:46:00.418464 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 994/2005] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:46:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:46:00.421576 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a7405e-848c-49c4-9eed-eb029b0f4965 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:46:00.432549 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a7405e-848c-49c4-9eed-eb029b0f4965 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:46:00.437445 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d19c8e-1245-4c99-8120-e0557cd0b793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:46:00.438067 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d19c8e-1245-4c99-8120-e0557cd0b793 admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:46:00.438349 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d19c8e-1245-4c99-8120-e0557cd0b793 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:46:00.438675 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d19c8e-1245-4c99-8120-e0557cd0b793 admin admin] PATH_INFO: `/v3/domains` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:46:00.440030 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d19c8e-1245-4c99-8120-e0557cd0b793 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:46:00.440343 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d19c8e-1245-4c99-8120-e0557cd0b793 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:46:00.442191 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d19c8e-1245-4c99-8120-e0557cd0b793 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:46:00.459893 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1012/2006] 10.222.0.102 () {58 vars in 1158 bytes} [Mon Aug 1 15:46:00 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:46:00.464507 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce89c2c-d1f1-4ec3-bbd2-0a27a17715fa None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:46:00.474472 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce89c2c-d1f1-4ec3-bbd2-0a27a17715fa None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:46:00.479660 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368ba9b9-50a3-4821-8f45-6b7d7d171779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:46:00.480678 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368ba9b9-50a3-4821-8f45-6b7d7d171779 admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:46:00.480678 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368ba9b9-50a3-4821-8f45-6b7d7d171779 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:46:00.480808 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368ba9b9-50a3-4821-8f45-6b7d7d171779 admin admin] PATH_INFO: `/v3/projects` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:46:00.481476 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368ba9b9-50a3-4821-8f45-6b7d7d171779 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:46:00.483416 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368ba9b9-50a3-4821-8f45-6b7d7d171779 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:46:00.588086 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 995/2007] 10.222.0.102 () {60 vars in 1158 bytes} [Mon Aug 1 15:46:00 2022] POST /identity/v3/projects => generated 378 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:46:00.592421 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d19c8e-1245-4c99-8120-e0557cd0b793 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:46:00.602960 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d19c8e-1245-4c99-8120-e0557cd0b793 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:46:00.663714 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593aaad0-ca29-4f11-ad5d-0745474b2a0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:46:00.664340 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593aaad0-ca29-4f11-ad5d-0745474b2a0a admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:46:00.664672 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593aaad0-ca29-4f11-ad5d-0745474b2a0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:46:00.664964 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593aaad0-ca29-4f11-ad5d-0745474b2a0a admin admin] PATH_INFO: `/v3/users` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:46:00.665643 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593aaad0-ca29-4f11-ad5d-0745474b2a0a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:46:00.667580 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593aaad0-ca29-4f11-ad5d-0745474b2a0a admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:46:00.768096 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1013/2008] 10.222.0.102 () {60 vars in 1149 bytes} [Mon Aug 1 15:46:00 2022] POST /identity/v3/users => generated 290 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:46:00.770949 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368ba9b9-50a3-4821-8f45-6b7d7d171779 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:46:00.782943 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368ba9b9-50a3-4821-8f45-6b7d7d171779 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:46:00.789233 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57408114-8367-4fce-ac64-ccc01f437818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:46:00.789847 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57408114-8367-4fce-ac64-ccc01f437818 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:46:00.790178 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57408114-8367-4fce-ac64-ccc01f437818 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:46:00.790451 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57408114-8367-4fce-ac64-ccc01f437818 admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:46:00.791237 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57408114-8367-4fce-ac64-ccc01f437818 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:46:00.793435 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57408114-8367-4fce-ac64-ccc01f437818 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:46:00.804037 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 996/2009] 10.222.0.102 () {58 vars in 1127 bytes} [Mon Aug 1 15:46:00 2022] GET /identity/v3/roles => generated 1427 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 15:46:00.807839 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593aaad0-ca29-4f11-ad5d-0745474b2a0a admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:46:00.821298 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593aaad0-ca29-4f11-ad5d-0745474b2a0a admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:46:00.829458 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105a3ee2-7297-49fd-a5f9-a9e90a56cee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:46:00.830958 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105a3ee2-7297-49fd-a5f9-a9e90a56cee2 admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:46:00.831592 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105a3ee2-7297-49fd-a5f9-a9e90a56cee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:46:00.832404 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105a3ee2-7297-49fd-a5f9-a9e90a56cee2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:46:00.833333 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105a3ee2-7297-49fd-a5f9-a9e90a56cee2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:46:00.835919 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105a3ee2-7297-49fd-a5f9-a9e90a56cee2 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:46:00.851649 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1014/2010] 10.222.0.102 () {58 vars in 1127 bytes} [Mon Aug 1 15:46:00 2022] GET /identity/v3/roles => generated 1427 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:46:00.856548 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57408114-8367-4fce-ac64-ccc01f437818 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:46:00.867141 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57408114-8367-4fce-ac64-ccc01f437818 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:46:00.871938 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31bc7db-6293-4ecd-9d18-752ba6b7b6ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:46:00.872639 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31bc7db-6293-4ecd-9d18-752ba6b7b6ad admin admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:46:00.873017 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31bc7db-6293-4ecd-9d18-752ba6b7b6ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:46:00.873298 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31bc7db-6293-4ecd-9d18-752ba6b7b6ad admin admin] PATH_INFO: `/v3/projects/c8fd9fd2a82b40deb6ba0cf82a88fc95/users/d9d38ef9c284451991588e483bc1439e/roles/27f5093ac0674d799cdbd17c68482e32` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:46:00.895490 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31bc7db-6293-4ecd-9d18-752ba6b7b6ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8fd9fd2a82b40deb6ba0cf82a88fc95, user_id=d9d38ef9c284451991588e483bc1439e, role_id=27f5093ac0674d799cdbd17c68482e32)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:46:00.898410 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31bc7db-6293-4ecd-9d18-752ba6b7b6ad admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:46:01.168518 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 997/2011] 10.222.0.102 () {60 vars in 1488 bytes} [Mon Aug 1 15:46:00 2022] PUT /identity/v3/projects/c8fd9fd2a82b40deb6ba0cf82a88fc95/users/d9d38ef9c284451991588e483bc1439e/roles/27f5093ac0674d799cdbd17c68482e32 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 15:46:01.179866 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0aca31-ad32-4165-ade1-bbf6deeaca54 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:46:01.180231 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0aca31-ad32-4165-ade1-bbf6deeaca54 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:46:01.180540 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0aca31-ad32-4165-ade1-bbf6deeaca54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:46:01.208621 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-6d0aca31-ad32-4165-ade1-bbf6deeaca54 None None] MFA Rules not processed for user `d9d38ef9c284451991588e483bc1439e`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:46:01.209867 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-6d0aca31-ad32-4165-ade1-bbf6deeaca54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:46:01.277007 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1015/2012] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:46:01 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 15:46:01.370864 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:46:01.401656 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31bc7db-6293-4ecd-9d18-752ba6b7b6ad admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:46:01.405330 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-b31bc7db-6293-4ecd-9d18-752ba6b7b6ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:46:01.469680 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31bc7db-6293-4ecd-9d18-752ba6b7b6ad admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:46:01.473437 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595a4fff-f532-4299-9cb1-d951ae440424 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff810b37183c4729859c1b05edff1703', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:46:01.474044 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595a4fff-f532-4299-9cb1-d951ae440424 service cinder] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:46:01.474318 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595a4fff-f532-4299-9cb1-d951ae440424 service cinder] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:46:01.474588 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595a4fff-f532-4299-9cb1-d951ae440424 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:46:01.482954 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595a4fff-f532-4299-9cb1-d951ae440424 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:46:01.484372 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595a4fff-f532-4299-9cb1-d951ae440424 service cinder] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:46:01.495586 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 998/2013] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:46:01 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 15:46:02.180920 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:46:02.816929 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0aca31-ad32-4165-ade1-bbf6deeaca54 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:46:02.819333 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-6d0aca31-ad32-4165-ade1-bbf6deeaca54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:46:02.890309 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0aca31-ad32-4165-ade1-bbf6deeaca54 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:46:02.895561 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04855ebb-446e-4fbd-a5c8-134b29a9a2d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:46:02.896209 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04855ebb-446e-4fbd-a5c8-134b29a9a2d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:46:02.896487 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04855ebb-446e-4fbd-a5c8-134b29a9a2d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:46:02.896760 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04855ebb-446e-4fbd-a5c8-134b29a9a2d2 admin admin] PATH_INFO: `/v3/users/9514ce5cc69246afb379822d7122c7c6` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:46:02.897975 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04855ebb-446e-4fbd-a5c8-134b29a9a2d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9514ce5cc69246afb379822d7122c7c6)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:46:02.900181 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04855ebb-446e-4fbd-a5c8-134b29a9a2d2 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:46:03.155014 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-04855ebb-446e-4fbd-a5c8-134b29a9a2d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9514ce5cc69246afb379822d7122c7c6'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:46:03.167091 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-04855ebb-446e-4fbd-a5c8-134b29a9a2d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9514ce5cc69246afb379822d7122c7c6'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:46:03.174221 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-04855ebb-446e-4fbd-a5c8-134b29a9a2d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9514ce5cc69246afb379822d7122c7c6'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:46:03.179286 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-04855ebb-446e-4fbd-a5c8-134b29a9a2d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9514ce5cc69246afb379822d7122c7c6'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:46:03.179286 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-04855ebb-446e-4fbd-a5c8-134b29a9a2d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9514ce5cc69246afb379822d7122c7c6'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:46:03.220921 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:46:03.288903 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1016/2014] 10.222.0.102 () {58 vars in 1229 bytes} [Mon Aug 1 15:46:02 2022] DELETE /identity/v3/users/9514ce5cc69246afb379822d7122c7c6 => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:46:03.293636 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728614ea-65da-41d0-90c8-5be3cb16ff39 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:46:03.294163 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728614ea-65da-41d0-90c8-5be3cb16ff39 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:46:03.294519 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728614ea-65da-41d0-90c8-5be3cb16ff39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:46:03.316165 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-728614ea-65da-41d0-90c8-5be3cb16ff39 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:46:03.317413 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-728614ea-65da-41d0-90c8-5be3cb16ff39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:46:03.352333 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:46:03.381120 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 999/2015] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:46:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:46:03.391359 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04855ebb-446e-4fbd-a5c8-134b29a9a2d2 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:46:03.393350 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-04855ebb-446e-4fbd-a5c8-134b29a9a2d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:46:03.453727 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04855ebb-446e-4fbd-a5c8-134b29a9a2d2 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:46:03.457633 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4202887-f97a-408f-a948-bfe099c0dab4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a856a413100443939fe9b10daa868518', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:46:03.458267 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4202887-f97a-408f-a948-bfe099c0dab4 service neutron] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:46:03.458539 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4202887-f97a-408f-a948-bfe099c0dab4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:46:03.458802 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4202887-f97a-408f-a948-bfe099c0dab4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:46:03.469367 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4202887-f97a-408f-a948-bfe099c0dab4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:46:03.471267 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4202887-f97a-408f-a948-bfe099c0dab4 service neutron] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:46:03.481659 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1017/2016] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:46:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 15:46:04.005239 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:46:04.011674 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728614ea-65da-41d0-90c8-5be3cb16ff39 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:46:04.013380 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-728614ea-65da-41d0-90c8-5be3cb16ff39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:46:04.030105 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728614ea-65da-41d0-90c8-5be3cb16ff39 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:46:04.035378 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe4d8c1-3fdd-4978-a5a1-241641de0140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:46:04.036034 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe4d8c1-3fdd-4978-a5a1-241641de0140 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:46:04.036341 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe4d8c1-3fdd-4978-a5a1-241641de0140 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:46:04.036615 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe4d8c1-3fdd-4978-a5a1-241641de0140 admin admin] PATH_INFO: `/v3/projects/4777369646614c738cd2ad9cbfa8da8b` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:46:04.037876 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe4d8c1-3fdd-4978-a5a1-241641de0140 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4777369646614c738cd2ad9cbfa8da8b)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:46:04.039801 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe4d8c1-3fdd-4978-a5a1-241641de0140 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:46:04.215597 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-0fe4d8c1-3fdd-4978-a5a1-241641de0140 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4777369646614c738cd2ad9cbfa8da8b', 'request_id': 'req-0fe4d8c1-3fdd-4978-a5a1-241641de0140'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:46:04.384453 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-0fe4d8c1-3fdd-4978-a5a1-241641de0140 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4777369646614c738cd2ad9cbfa8da8b', 'request_id': 'req-0fe4d8c1-3fdd-4978-a5a1-241641de0140'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:46:04.391166 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-0fe4d8c1-3fdd-4978-a5a1-241641de0140 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4777369646614c738cd2ad9cbfa8da8b', 'request_id': 'req-0fe4d8c1-3fdd-4978-a5a1-241641de0140'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:46:04.401871 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-0fe4d8c1-3fdd-4978-a5a1-241641de0140 admin admin] The token cache is being invalidate because project 4777369646614c738cd2ad9cbfa8da8b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80353) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 15:46:04.402165 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-0fe4d8c1-3fdd-4978-a5a1-241641de0140 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:46:04.402806 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-0fe4d8c1-3fdd-4978-a5a1-241641de0140 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:46:04.404375 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1000/2017] 10.222.0.102 () {58 vars in 1238 bytes} [Mon Aug 1 15:46:04 2022] DELETE /identity/v3/projects/4777369646614c738cd2ad9cbfa8da8b => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:46:04.408557 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4202887-f97a-408f-a948-bfe099c0dab4 service neutron] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:46:04.418889 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4202887-f97a-408f-a948-bfe099c0dab4 service neutron] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:46:04.425308 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:46:04.478084 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec12a65-9466-4fb5-8436-f2aa348ce4d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:46:04.478720 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec12a65-9466-4fb5-8436-f2aa348ce4d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:46:04.478996 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec12a65-9466-4fb5-8436-f2aa348ce4d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:46:04.479267 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec12a65-9466-4fb5-8436-f2aa348ce4d8 admin admin] PATH_INFO: `/v3/users/24d74d1645e043df872472be38bb6e40` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:46:04.480543 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec12a65-9466-4fb5-8436-f2aa348ce4d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=24d74d1645e043df872472be38bb6e40)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:46:04.482666 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec12a65-9466-4fb5-8436-f2aa348ce4d8 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:46:04.696753 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-cec12a65-9466-4fb5-8436-f2aa348ce4d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '24d74d1645e043df872472be38bb6e40'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:46:04.718571 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-cec12a65-9466-4fb5-8436-f2aa348ce4d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '24d74d1645e043df872472be38bb6e40'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:46:04.727732 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-cec12a65-9466-4fb5-8436-f2aa348ce4d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '24d74d1645e043df872472be38bb6e40'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:46:04.728509 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-cec12a65-9466-4fb5-8436-f2aa348ce4d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '24d74d1645e043df872472be38bb6e40'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:46:04.729199 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-cec12a65-9466-4fb5-8436-f2aa348ce4d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '24d74d1645e043df872472be38bb6e40'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:46:04.886519 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1018/2018] 10.222.0.102 () {58 vars in 1229 bytes} [Mon Aug 1 15:46:04 2022] DELETE /identity/v3/users/24d74d1645e043df872472be38bb6e40 => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:46:05.358699 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:46:05.366473 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe4d8c1-3fdd-4978-a5a1-241641de0140 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:46:05.373059 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-0fe4d8c1-3fdd-4978-a5a1-241641de0140 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:46:05.389098 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe4d8c1-3fdd-4978-a5a1-241641de0140 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:46:05.464263 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a42feaf-0043-45ca-b14d-216ee2c26cdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:46:05.465158 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a42feaf-0043-45ca-b14d-216ee2c26cdd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:46:05.465443 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a42feaf-0043-45ca-b14d-216ee2c26cdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:46:05.465716 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a42feaf-0043-45ca-b14d-216ee2c26cdd admin admin] PATH_INFO: `/v3/projects/9230dd76cdd44884a1fa49ffe992b15e` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:46:05.466986 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a42feaf-0043-45ca-b14d-216ee2c26cdd admin admin] RBAC: Authorizing `identity:delete_project(project_id=9230dd76cdd44884a1fa49ffe992b15e)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:46:05.470942 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a42feaf-0043-45ca-b14d-216ee2c26cdd admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:46:05.535856 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:DELETE=19,keystone:SELECT=79,keystone:INSERT=2 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:46:05.582413 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-7a42feaf-0043-45ca-b14d-216ee2c26cdd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9230dd76cdd44884a1fa49ffe992b15e', 'request_id': 'req-7a42feaf-0043-45ca-b14d-216ee2c26cdd'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:46:05.672506 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-7a42feaf-0043-45ca-b14d-216ee2c26cdd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9230dd76cdd44884a1fa49ffe992b15e', 'request_id': 'req-7a42feaf-0043-45ca-b14d-216ee2c26cdd'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:46:05.680505 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-7a42feaf-0043-45ca-b14d-216ee2c26cdd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9230dd76cdd44884a1fa49ffe992b15e', 'request_id': 'req-7a42feaf-0043-45ca-b14d-216ee2c26cdd'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:46:05.691844 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-7a42feaf-0043-45ca-b14d-216ee2c26cdd admin admin] The token cache is being invalidate because project 9230dd76cdd44884a1fa49ffe992b15e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80353) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 15:46:05.692130 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-7a42feaf-0043-45ca-b14d-216ee2c26cdd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:46:05.692783 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-7a42feaf-0043-45ca-b14d-216ee2c26cdd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:46:05.694345 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1001/2019] 10.222.0.102 () {58 vars in 1238 bytes} [Mon Aug 1 15:46:05 2022] DELETE /identity/v3/projects/9230dd76cdd44884a1fa49ffe992b15e => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:46:05.699114 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dddc1d-e79b-4bab-ae12-c873efa4447e None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:46:05.699387 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dddc1d-e79b-4bab-ae12-c873efa4447e None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:46:05.699658 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dddc1d-e79b-4bab-ae12-c873efa4447e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:46:05.720368 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-95dddc1d-e79b-4bab-ae12-c873efa4447e None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:46:05.722484 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-95dddc1d-e79b-4bab-ae12-c873efa4447e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:46:05.815667 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1019/2020] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:46:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:46:05.828240 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4cfefe-cfd4-4bff-8b62-e5411d9f8258 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:46:05.828679 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4cfefe-cfd4-4bff-8b62-e5411d9f8258 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:46:05.829092 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4cfefe-cfd4-4bff-8b62-e5411d9f8258 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:46:05.854123 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-be4cfefe-cfd4-4bff-8b62-e5411d9f8258 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:46:05.855341 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-be4cfefe-cfd4-4bff-8b62-e5411d9f8258 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:46:05.866314 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1002/2021] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:46:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:46:05.888977 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dddc1d-e79b-4bab-ae12-c873efa4447e None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:46:05.889222 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4cfefe-cfd4-4bff-8b62-e5411d9f8258 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:46:05.889222 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-be4cfefe-cfd4-4bff-8b62-e5411d9f8258 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:46:05.895763 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dddc1d-e79b-4bab-ae12-c873efa4447e None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:46:05.902089 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45992d98-3f9a-46a6-b94c-6a10ee8d5178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:46:05.903124 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45992d98-3f9a-46a6-b94c-6a10ee8d5178 admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:46:05.903600 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45992d98-3f9a-46a6-b94c-6a10ee8d5178 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:46:05.904210 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45992d98-3f9a-46a6-b94c-6a10ee8d5178 admin admin] PATH_INFO: `/v3/domains` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:46:05.905246 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45992d98-3f9a-46a6-b94c-6a10ee8d5178 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:46:05.905750 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45992d98-3f9a-46a6-b94c-6a10ee8d5178 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:46:05.907949 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45992d98-3f9a-46a6-b94c-6a10ee8d5178 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:46:05.921313 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1020/2022] 10.222.0.102 () {58 vars in 1158 bytes} [Mon Aug 1 15:46:05 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:46:05.926518 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45992d98-3f9a-46a6-b94c-6a10ee8d5178 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:46:05.937450 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45992d98-3f9a-46a6-b94c-6a10ee8d5178 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:46:05.943716 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c193d6-af7b-46c1-989d-2ca3cf973d8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:46:05.944599 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c193d6-af7b-46c1-989d-2ca3cf973d8c admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:46:05.945119 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c193d6-af7b-46c1-989d-2ca3cf973d8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:46:05.945624 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c193d6-af7b-46c1-989d-2ca3cf973d8c admin admin] PATH_INFO: `/v3/projects` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:46:05.946653 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c193d6-af7b-46c1-989d-2ca3cf973d8c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:46:05.949371 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c193d6-af7b-46c1-989d-2ca3cf973d8c admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:46:05.957354 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4cfefe-cfd4-4bff-8b62-e5411d9f8258 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:46:05.961152 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f90a87-be70-4700-a210-37eaf0975eb1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff810b37183c4729859c1b05edff1703', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:46:05.961852 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f90a87-be70-4700-a210-37eaf0975eb1 service cinder] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:46:05.962173 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f90a87-be70-4700-a210-37eaf0975eb1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:46:05.962628 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f90a87-be70-4700-a210-37eaf0975eb1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:46:05.964514 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-a5f90a87-be70-4700-a210-37eaf0975eb1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:46:05.996875 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:46:06.061873 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f90a87-be70-4700-a210-37eaf0975eb1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:46:06.063327 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f90a87-be70-4700-a210-37eaf0975eb1 service cinder] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:46:06.074693 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1003/2023] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:46:05 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:46:06.146449 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1021/2024] 10.222.0.102 () {60 vars in 1158 bytes} [Mon Aug 1 15:46:05 2022] POST /identity/v3/projects => generated 382 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:46:06.150531 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f90a87-be70-4700-a210-37eaf0975eb1 service cinder] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:46:06.163229 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f90a87-be70-4700-a210-37eaf0975eb1 service cinder] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:46:06.225900 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f298e50-bd89-4dd8-bbe1-13fe50435c6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:46:06.226816 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f298e50-bd89-4dd8-bbe1-13fe50435c6e admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:46:06.227230 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f298e50-bd89-4dd8-bbe1-13fe50435c6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:46:06.228997 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f298e50-bd89-4dd8-bbe1-13fe50435c6e admin admin] PATH_INFO: `/v3/users` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:46:06.228997 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f298e50-bd89-4dd8-bbe1-13fe50435c6e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:46:06.230609 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f298e50-bd89-4dd8-bbe1-13fe50435c6e admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:46:06.395813 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:46:06.404122 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1004/2025] 10.222.0.102 () {60 vars in 1149 bytes} [Mon Aug 1 15:46:06 2022] POST /identity/v3/users => generated 292 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:46:06.404830 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c193d6-af7b-46c1-989d-2ca3cf973d8c admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:46:06.416329 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c193d6-af7b-46c1-989d-2ca3cf973d8c admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:46:06.436153 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c15567f-9ae2-4487-a24f-81d26555199e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:46:06.437832 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c15567f-9ae2-4487-a24f-81d26555199e admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:46:06.438349 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c15567f-9ae2-4487-a24f-81d26555199e admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:46:06.439404 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c15567f-9ae2-4487-a24f-81d26555199e admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:46:06.440112 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c15567f-9ae2-4487-a24f-81d26555199e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:46:06.442296 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c15567f-9ae2-4487-a24f-81d26555199e admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:46:06.469357 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1022/2026] 10.222.0.102 () {58 vars in 1127 bytes} [Mon Aug 1 15:46:06 2022] GET /identity/v3/roles => generated 1427 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 15:46:06.474827 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f298e50-bd89-4dd8-bbe1-13fe50435c6e admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:46:06.487017 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f298e50-bd89-4dd8-bbe1-13fe50435c6e admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:46:06.491798 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a760f466-ac4d-4a4b-b53f-4463139174ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:46:06.492820 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a760f466-ac4d-4a4b-b53f-4463139174ca admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:46:06.492820 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a760f466-ac4d-4a4b-b53f-4463139174ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:46:06.493795 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a760f466-ac4d-4a4b-b53f-4463139174ca admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:46:06.494599 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a760f466-ac4d-4a4b-b53f-4463139174ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:46:06.496269 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a760f466-ac4d-4a4b-b53f-4463139174ca admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:46:06.512892 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1005/2027] 10.222.0.102 () {58 vars in 1127 bytes} [Mon Aug 1 15:46:06 2022] GET /identity/v3/roles => generated 1427 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:46:06.514556 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c15567f-9ae2-4487-a24f-81d26555199e admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:46:06.526939 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c15567f-9ae2-4487-a24f-81d26555199e admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:46:06.531463 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2aaef05-a12c-4eb9-9f77-67bbb2f2da4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:46:06.532123 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aaef05-a12c-4eb9-9f77-67bbb2f2da4b admin admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:46:06.532393 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aaef05-a12c-4eb9-9f77-67bbb2f2da4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:46:06.532663 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aaef05-a12c-4eb9-9f77-67bbb2f2da4b admin admin] PATH_INFO: `/v3/projects/4aca015def35479da36e6519b561b823/users/b2bc167cb0f440b7ae510c9c2e537f52/roles/27f5093ac0674d799cdbd17c68482e32` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:46:06.549014 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2aaef05-a12c-4eb9-9f77-67bbb2f2da4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=4aca015def35479da36e6519b561b823, user_id=b2bc167cb0f440b7ae510c9c2e537f52, role_id=27f5093ac0674d799cdbd17c68482e32)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:46:06.551874 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2aaef05-a12c-4eb9-9f77-67bbb2f2da4b admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:46:06.670852 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1023/2028] 10.222.0.102 () {60 vars in 1488 bytes} [Mon Aug 1 15:46:06 2022] PUT /identity/v3/projects/4aca015def35479da36e6519b561b823/users/b2bc167cb0f440b7ae510c9c2e537f52/roles/27f5093ac0674d799cdbd17c68482e32 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:46:06.681551 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244e780e-82fb-4795-9e5b-db618d568ef8 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:46:06.681980 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244e780e-82fb-4795-9e5b-db618d568ef8 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:46:06.682467 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244e780e-82fb-4795-9e5b-db618d568ef8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:46:06.710943 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-244e780e-82fb-4795-9e5b-db618d568ef8 None None] MFA Rules not processed for user `b2bc167cb0f440b7ae510c9c2e537f52`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:46:06.712077 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-244e780e-82fb-4795-9e5b-db618d568ef8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:46:06.753496 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:46:06.779851 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1006/2029] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:46:06 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:46:06.785499 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2aaef05-a12c-4eb9-9f77-67bbb2f2da4b admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:46:06.851699 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2aaef05-a12c-4eb9-9f77-67bbb2f2da4b admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:46:06.859482 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51840178-323c-4a08-8cf3-451c7bd1a542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:46:06.860467 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51840178-323c-4a08-8cf3-451c7bd1a542 admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:46:06.861001 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51840178-323c-4a08-8cf3-451c7bd1a542 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:46:06.861455 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51840178-323c-4a08-8cf3-451c7bd1a542 admin admin] PATH_INFO: `/v3/projects` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:46:06.862589 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51840178-323c-4a08-8cf3-451c7bd1a542 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:46:06.864815 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51840178-323c-4a08-8cf3-451c7bd1a542 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:46:06.983194 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1024/2030] 10.222.0.102 () {60 vars in 1158 bytes} [Mon Aug 1 15:46:06 2022] POST /identity/v3/projects => generated 380 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:46:06.988194 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244e780e-82fb-4795-9e5b-db618d568ef8 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:46:07.000896 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244e780e-82fb-4795-9e5b-db618d568ef8 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:46:07.085604 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b8f296-c5a3-4dc2-b9b9-31beb61df633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:46:07.086253 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b8f296-c5a3-4dc2-b9b9-31beb61df633 admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:46:07.086531 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b8f296-c5a3-4dc2-b9b9-31beb61df633 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:46:07.086804 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b8f296-c5a3-4dc2-b9b9-31beb61df633 admin admin] PATH_INFO: `/v3/users` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:46:07.087538 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b8f296-c5a3-4dc2-b9b9-31beb61df633 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:46:07.089818 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b8f296-c5a3-4dc2-b9b9-31beb61df633 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:46:07.100766 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:46:07.201194 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1007/2031] 10.222.0.102 () {60 vars in 1149 bytes} [Mon Aug 1 15:46:06 2022] POST /identity/v3/users => generated 297 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:46:07.202606 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51840178-323c-4a08-8cf3-451c7bd1a542 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:46:07.213399 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51840178-323c-4a08-8cf3-451c7bd1a542 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:46:07.217958 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776b1d21-9dc9-4b7c-bdf5-058052a71000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:46:07.218565 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776b1d21-9dc9-4b7c-bdf5-058052a71000 admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:46:07.218844 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776b1d21-9dc9-4b7c-bdf5-058052a71000 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:46:07.219123 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776b1d21-9dc9-4b7c-bdf5-058052a71000 admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:46:07.219816 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776b1d21-9dc9-4b7c-bdf5-058052a71000 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:46:07.222143 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776b1d21-9dc9-4b7c-bdf5-058052a71000 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:46:07.237470 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1025/2032] 10.222.0.102 () {58 vars in 1127 bytes} [Mon Aug 1 15:46:07 2022] GET /identity/v3/roles => generated 1427 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:46:07.239553 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b8f296-c5a3-4dc2-b9b9-31beb61df633 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:46:07.250510 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b8f296-c5a3-4dc2-b9b9-31beb61df633 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:46:07.256389 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ba6c8e-fb1a-4cb3-9f43-4a70997eeb79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:46:07.257408 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ba6c8e-fb1a-4cb3-9f43-4a70997eeb79 admin admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:46:07.257694 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ba6c8e-fb1a-4cb3-9f43-4a70997eeb79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:46:07.257975 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ba6c8e-fb1a-4cb3-9f43-4a70997eeb79 admin admin] PATH_INFO: `/v3/projects/08642e391b2b451ba66d6a1e4c4e1337/users/826d0279a04e488f937064ed0362f184/roles/de1374f966c04c27b579515b54334fd2` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:46:07.275484 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ba6c8e-fb1a-4cb3-9f43-4a70997eeb79 admin admin] RBAC: Authorizing `identity:create_grant(project_id=08642e391b2b451ba66d6a1e4c4e1337, user_id=826d0279a04e488f937064ed0362f184, role_id=de1374f966c04c27b579515b54334fd2)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:46:07.278212 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ba6c8e-fb1a-4cb3-9f43-4a70997eeb79 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:46:07.434798 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1008/2033] 10.222.0.102 () {60 vars in 1488 bytes} [Mon Aug 1 15:46:07 2022] PUT /identity/v3/projects/08642e391b2b451ba66d6a1e4c4e1337/users/826d0279a04e488f937064ed0362f184/roles/de1374f966c04c27b579515b54334fd2 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:46:07.438343 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776b1d21-9dc9-4b7c-bdf5-058052a71000 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:46:07.448663 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776b1d21-9dc9-4b7c-bdf5-058052a71000 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:46:07.541399 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11bd5e8-0055-4fce-8277-578498f0ad31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:46:07.542923 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11bd5e8-0055-4fce-8277-578498f0ad31 admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:46:07.545499 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11bd5e8-0055-4fce-8277-578498f0ad31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:46:07.546593 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11bd5e8-0055-4fce-8277-578498f0ad31 admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:46:07.548466 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11bd5e8-0055-4fce-8277-578498f0ad31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:46:07.551883 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11bd5e8-0055-4fce-8277-578498f0ad31 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:46:07.582109 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1026/2034] 10.222.0.102 () {58 vars in 1127 bytes} [Mon Aug 1 15:46:07 2022] GET /identity/v3/roles => generated 1427 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:46:07.586180 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ba6c8e-fb1a-4cb3-9f43-4a70997eeb79 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:46:07.598027 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ba6c8e-fb1a-4cb3-9f43-4a70997eeb79 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:46:07.603869 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834467b4-3578-4c2d-9752-030334057ec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:46:07.606007 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834467b4-3578-4c2d-9752-030334057ec8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:46:07.606007 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834467b4-3578-4c2d-9752-030334057ec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:46:07.606007 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834467b4-3578-4c2d-9752-030334057ec8 admin admin] PATH_INFO: `/v3/projects/08642e391b2b451ba66d6a1e4c4e1337/users/826d0279a04e488f937064ed0362f184/roles/de1374f966c04c27b579515b54334fd2` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:46:07.608462 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834467b4-3578-4c2d-9752-030334057ec8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=08642e391b2b451ba66d6a1e4c4e1337, user_id=826d0279a04e488f937064ed0362f184, role_id=de1374f966c04c27b579515b54334fd2)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:46:07.611720 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834467b4-3578-4c2d-9752-030334057ec8 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:46:07.623081 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1009/2035] 10.222.0.102 () {60 vars in 1488 bytes} [Mon Aug 1 15:46:07 2022] PUT /identity/v3/projects/08642e391b2b451ba66d6a1e4c4e1337/users/826d0279a04e488f937064ed0362f184/roles/de1374f966c04c27b579515b54334fd2 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 15:46:07.635207 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7d5bc5-f888-4041-9a5c-9468ea00f0db None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:46:07.635591 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7d5bc5-f888-4041-9a5c-9468ea00f0db None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:46:07.635939 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7d5bc5-f888-4041-9a5c-9468ea00f0db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:46:07.668459 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-0e7d5bc5-f888-4041-9a5c-9468ea00f0db None None] MFA Rules not processed for user `826d0279a04e488f937064ed0362f184`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:46:07.669723 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-0e7d5bc5-f888-4041-9a5c-9468ea00f0db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:46:07.752048 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1027/2036] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:46:07 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:46:07.763648 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834467b4-3578-4c2d-9752-030334057ec8 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:46:07.765790 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-834467b4-3578-4c2d-9752-030334057ec8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:46:07.835681 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834467b4-3578-4c2d-9752-030334057ec8 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:46:07.839436 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f82321e-e326-4b07-b4f8-b5bbd5a7b3ee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff810b37183c4729859c1b05edff1703', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:46:07.840134 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f82321e-e326-4b07-b4f8-b5bbd5a7b3ee service cinder] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:46:07.840410 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f82321e-e326-4b07-b4f8-b5bbd5a7b3ee service cinder] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:46:07.840686 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f82321e-e326-4b07-b4f8-b5bbd5a7b3ee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:46:07.857763 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f82321e-e326-4b07-b4f8-b5bbd5a7b3ee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:46:07.859438 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f82321e-e326-4b07-b4f8-b5bbd5a7b3ee service cinder] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:46:07.891742 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1010/2037] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:46:07 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:46:08.127530 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:46:08.375755 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:46:08.517143 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7d5bc5-f888-4041-9a5c-9468ea00f0db None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:46:08.594791 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7d5bc5-f888-4041-9a5c-9468ea00f0db None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:46:08.600506 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f983259-18f9-4111-a5c7-c1125e85e5bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:46:08.601202 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f983259-18f9-4111-a5c7-c1125e85e5bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:46:08.601484 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f983259-18f9-4111-a5c7-c1125e85e5bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:46:08.601761 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f983259-18f9-4111-a5c7-c1125e85e5bc admin admin] PATH_INFO: `/v3/users/b2bc167cb0f440b7ae510c9c2e537f52` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:46:08.603047 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f983259-18f9-4111-a5c7-c1125e85e5bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2bc167cb0f440b7ae510c9c2e537f52)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:46:08.605046 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f983259-18f9-4111-a5c7-c1125e85e5bc admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:46:08.798031 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-6f983259-18f9-4111-a5c7-c1125e85e5bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2bc167cb0f440b7ae510c9c2e537f52'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:46:08.811503 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-6f983259-18f9-4111-a5c7-c1125e85e5bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2bc167cb0f440b7ae510c9c2e537f52'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:46:08.819206 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-6f983259-18f9-4111-a5c7-c1125e85e5bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2bc167cb0f440b7ae510c9c2e537f52'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:46:08.820350 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-6f983259-18f9-4111-a5c7-c1125e85e5bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2bc167cb0f440b7ae510c9c2e537f52'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:46:08.825351 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-6f983259-18f9-4111-a5c7-c1125e85e5bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2bc167cb0f440b7ae510c9c2e537f52'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:46:08.941858 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1028/2038] 10.222.0.102 () {58 vars in 1229 bytes} [Mon Aug 1 15:46:08 2022] DELETE /identity/v3/users/b2bc167cb0f440b7ae510c9c2e537f52 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:46:08.947349 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bf3c4d-691b-4551-a336-56d193d04f21 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:46:08.947883 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bf3c4d-691b-4551-a336-56d193d04f21 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:46:08.947883 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bf3c4d-691b-4551-a336-56d193d04f21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:46:08.976345 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-12bf3c4d-691b-4551-a336-56d193d04f21 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:46:08.977602 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-12bf3c4d-691b-4551-a336-56d193d04f21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:46:09.058318 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1011/2039] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:46:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:46:09.068951 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f983259-18f9-4111-a5c7-c1125e85e5bc admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:46:09.070394 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-6f983259-18f9-4111-a5c7-c1125e85e5bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:46:09.135221 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f983259-18f9-4111-a5c7-c1125e85e5bc admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:46:09.139737 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d89aa43-b888-479b-b71f-c1906f6824c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a856a413100443939fe9b10daa868518', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:46:09.143152 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d89aa43-b888-479b-b71f-c1906f6824c7 service neutron] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:46:09.143152 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d89aa43-b888-479b-b71f-c1906f6824c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:46:09.143152 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d89aa43-b888-479b-b71f-c1906f6824c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:46:09.151114 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d89aa43-b888-479b-b71f-c1906f6824c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:46:09.152825 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d89aa43-b888-479b-b71f-c1906f6824c7 service neutron] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:46:09.164944 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1029/2040] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:46:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:46:09.433518 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:46:09.666994 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:46:09.675411 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bf3c4d-691b-4551-a336-56d193d04f21 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:46:09.677389 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-12bf3c4d-691b-4551-a336-56d193d04f21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:46:09.694253 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bf3c4d-691b-4551-a336-56d193d04f21 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:46:09.699916 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b368de-ef4a-4beb-a39a-4b350cef4d8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:46:09.700823 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b368de-ef4a-4beb-a39a-4b350cef4d8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:46:09.701143 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b368de-ef4a-4beb-a39a-4b350cef4d8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:46:09.701670 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b368de-ef4a-4beb-a39a-4b350cef4d8b admin admin] PATH_INFO: `/v3/projects/4aca015def35479da36e6519b561b823` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:46:09.703021 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b368de-ef4a-4beb-a39a-4b350cef4d8b admin admin] RBAC: Authorizing `identity:delete_project(project_id=4aca015def35479da36e6519b561b823)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:46:09.705560 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b368de-ef4a-4beb-a39a-4b350cef4d8b admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:46:10.053382 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-a1b368de-ef4a-4beb-a39a-4b350cef4d8b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4aca015def35479da36e6519b561b823', 'request_id': 'req-a1b368de-ef4a-4beb-a39a-4b350cef4d8b'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:46:10.163836 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-a1b368de-ef4a-4beb-a39a-4b350cef4d8b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4aca015def35479da36e6519b561b823', 'request_id': 'req-a1b368de-ef4a-4beb-a39a-4b350cef4d8b'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:46:10.174862 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-a1b368de-ef4a-4beb-a39a-4b350cef4d8b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4aca015def35479da36e6519b561b823', 'request_id': 'req-a1b368de-ef4a-4beb-a39a-4b350cef4d8b'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:46:10.192694 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-a1b368de-ef4a-4beb-a39a-4b350cef4d8b admin admin] The token cache is being invalidate because project 4aca015def35479da36e6519b561b823 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80353) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 15:46:10.193692 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-a1b368de-ef4a-4beb-a39a-4b350cef4d8b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:46:10.194553 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-a1b368de-ef4a-4beb-a39a-4b350cef4d8b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:46:10.197165 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1012/2041] 10.222.0.102 () {58 vars in 1238 bytes} [Mon Aug 1 15:46:09 2022] DELETE /identity/v3/projects/4aca015def35479da36e6519b561b823 => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:46:10.201097 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d89aa43-b888-479b-b71f-c1906f6824c7 service neutron] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:46:10.214239 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d89aa43-b888-479b-b71f-c1906f6824c7 service neutron] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:46:10.299289 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cc6fd7-6988-4d38-a5e5-43821c905234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:46:10.299289 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cc6fd7-6988-4d38-a5e5-43821c905234 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:46:10.299289 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cc6fd7-6988-4d38-a5e5-43821c905234 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:46:10.299289 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cc6fd7-6988-4d38-a5e5-43821c905234 admin admin] PATH_INFO: `/v3/users/826d0279a04e488f937064ed0362f184` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:46:10.299896 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cc6fd7-6988-4d38-a5e5-43821c905234 admin admin] RBAC: Authorizing `identity:delete_user(user_id=826d0279a04e488f937064ed0362f184)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:46:10.301874 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cc6fd7-6988-4d38-a5e5-43821c905234 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:46:10.561203 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a69f2a-faab-4e54-8372-6a68c015b732 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:46:10.561391 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a69f2a-faab-4e54-8372-6a68c015b732 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:46:10.561674 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a69f2a-faab-4e54-8372-6a68c015b732 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:46:10.563698 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1013/2042] 10.222.0.102 () {54 vars in 926 bytes} [Mon Aug 1 15:46:10 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 01 15:46:10.596543 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da15ec9e-7222-4669-95f2-43a8df18b9cc None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:46:10.596925 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da15ec9e-7222-4669-95f2-43a8df18b9cc None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:46:10.597126 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da15ec9e-7222-4669-95f2-43a8df18b9cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:46:10.601233 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-01cc6fd7-6988-4d38-a5e5-43821c905234 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '826d0279a04e488f937064ed0362f184'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:46:10.616942 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-01cc6fd7-6988-4d38-a5e5-43821c905234 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '826d0279a04e488f937064ed0362f184'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:46:10.622814 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-da15ec9e-7222-4669-95f2-43a8df18b9cc None None] MFA Rules not processed for user `b78f5749fe9c46a389c88bb9c222cc73`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:46:10.624067 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-da15ec9e-7222-4669-95f2-43a8df18b9cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:46:10.624202 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-01cc6fd7-6988-4d38-a5e5-43821c905234 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '826d0279a04e488f937064ed0362f184'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:46:10.624908 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-01cc6fd7-6988-4d38-a5e5-43821c905234 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '826d0279a04e488f937064ed0362f184'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:46:10.625519 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-01cc6fd7-6988-4d38-a5e5-43821c905234 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '826d0279a04e488f937064ed0362f184'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:46:10.716352 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1014/2043] 10.222.0.102 () {58 vars in 1023 bytes} [Mon Aug 1 15:46:10 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 15:46:10.717536 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da15ec9e-7222-4669-95f2-43a8df18b9cc None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:46:10.719803 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-da15ec9e-7222-4669-95f2-43a8df18b9cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:46:10.736122 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da15ec9e-7222-4669-95f2-43a8df18b9cc None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:46:10.741029 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e05c244-1e7a-4a95-9a17-2fefc22042e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:46:10.741761 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e05c244-1e7a-4a95-9a17-2fefc22042e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:46:10.742043 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e05c244-1e7a-4a95-9a17-2fefc22042e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:46:10.742313 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e05c244-1e7a-4a95-9a17-2fefc22042e1 admin admin] PATH_INFO: `/v3/users/283a3f935ffa4f3d8d5dcd0d13b74b33` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:46:10.743533 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e05c244-1e7a-4a95-9a17-2fefc22042e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=283a3f935ffa4f3d8d5dcd0d13b74b33)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:46:10.745498 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e05c244-1e7a-4a95-9a17-2fefc22042e1 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:46:10.756291 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1030/2044] 10.222.0.102 () {58 vars in 1229 bytes} [Mon Aug 1 15:46:10 2022] DELETE /identity/v3/users/826d0279a04e488f937064ed0362f184 => generated 0 bytes in 553 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:46:10.756291 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cc6fd7-6988-4d38-a5e5-43821c905234 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:46:10.756291 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-01cc6fd7-6988-4d38-a5e5-43821c905234 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:46:10.777544 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:46:10.853581 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cc6fd7-6988-4d38-a5e5-43821c905234 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:46:10.858968 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29aca855-b2bd-4f11-ba77-44f6fc6a589f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b78f5749fe9c46a389c88bb9c222cc73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:46:10.859622 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aca855-b2bd-4f11-ba77-44f6fc6a589f service placement] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:46:10.862832 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aca855-b2bd-4f11-ba77-44f6fc6a589f service placement] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:46:10.862832 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aca855-b2bd-4f11-ba77-44f6fc6a589f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:46:10.870191 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29aca855-b2bd-4f11-ba77-44f6fc6a589f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:46:10.871972 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29aca855-b2bd-4f11-ba77-44f6fc6a589f service placement] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:46:10.882678 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1031/2045] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:46:10 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:46:10.883398 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29aca855-b2bd-4f11-ba77-44f6fc6a589f service placement] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:46:10.887627 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-29aca855-b2bd-4f11-ba77-44f6fc6a589f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:46:10.963795 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29aca855-b2bd-4f11-ba77-44f6fc6a589f service placement] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:46:10.968445 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81761920-fa67-478f-896b-dd5d1fbd8ef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:46:10.969106 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81761920-fa67-478f-896b-dd5d1fbd8ef5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:46:10.969382 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81761920-fa67-478f-896b-dd5d1fbd8ef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:46:10.969653 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81761920-fa67-478f-896b-dd5d1fbd8ef5 admin admin] PATH_INFO: `/v3/users/cffa7f8cddca4a359a3174f800fb1039` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:46:10.971461 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81761920-fa67-478f-896b-dd5d1fbd8ef5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cffa7f8cddca4a359a3174f800fb1039)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:46:10.973411 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81761920-fa67-478f-896b-dd5d1fbd8ef5 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:46:11.093894 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-1e05c244-1e7a-4a95-9a17-2fefc22042e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '283a3f935ffa4f3d8d5dcd0d13b74b33'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:46:11.194451 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-81761920-fa67-478f-896b-dd5d1fbd8ef5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cffa7f8cddca4a359a3174f800fb1039'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:46:11.207057 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-81761920-fa67-478f-896b-dd5d1fbd8ef5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cffa7f8cddca4a359a3174f800fb1039'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:46:11.208967 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-1e05c244-1e7a-4a95-9a17-2fefc22042e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '283a3f935ffa4f3d8d5dcd0d13b74b33'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:46:11.214821 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-81761920-fa67-478f-896b-dd5d1fbd8ef5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cffa7f8cddca4a359a3174f800fb1039'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:46:11.215812 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-81761920-fa67-478f-896b-dd5d1fbd8ef5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cffa7f8cddca4a359a3174f800fb1039'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:46:11.216767 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-81761920-fa67-478f-896b-dd5d1fbd8ef5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cffa7f8cddca4a359a3174f800fb1039'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:46:11.222272 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-1e05c244-1e7a-4a95-9a17-2fefc22042e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '283a3f935ffa4f3d8d5dcd0d13b74b33'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:46:11.222958 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-1e05c244-1e7a-4a95-9a17-2fefc22042e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '283a3f935ffa4f3d8d5dcd0d13b74b33'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:46:11.223580 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-1e05c244-1e7a-4a95-9a17-2fefc22042e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '283a3f935ffa4f3d8d5dcd0d13b74b33'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:46:11.235492 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1015/2046] 10.222.0.102 () {58 vars in 1229 bytes} [Mon Aug 1 15:46:10 2022] DELETE /identity/v3/users/283a3f935ffa4f3d8d5dcd0d13b74b33 => generated 0 bytes in 518 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:46:11.239859 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5133defe-5a4a-4797-ab2f-5990d88b11fa None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:46:11.240150 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5133defe-5a4a-4797-ab2f-5990d88b11fa None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:46:11.240433 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5133defe-5a4a-4797-ab2f-5990d88b11fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:46:11.258971 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-5133defe-5a4a-4797-ab2f-5990d88b11fa None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:46:11.260175 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-5133defe-5a4a-4797-ab2f-5990d88b11fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:46:11.306626 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1032/2047] 10.222.0.102 () {58 vars in 1229 bytes} [Mon Aug 1 15:46:10 2022] DELETE /identity/v3/users/cffa7f8cddca4a359a3174f800fb1039 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:46:11.306626 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81761920-fa67-478f-896b-dd5d1fbd8ef5 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:46:11.306626 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-81761920-fa67-478f-896b-dd5d1fbd8ef5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:46:11.331061 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1016/2048] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:46:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 15:46:11.341539 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5133defe-5a4a-4797-ab2f-5990d88b11fa None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:46:11.343181 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-5133defe-5a4a-4797-ab2f-5990d88b11fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:46:11.374933 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=91,keystone:INSERT=6,keystone:DELETE=3 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:46:11.376216 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81761920-fa67-478f-896b-dd5d1fbd8ef5 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:46:11.382432 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795bfbdb-9d4c-47f4-8a15-70b57d86f0fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:46:11.385356 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795bfbdb-9d4c-47f4-8a15-70b57d86f0fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:46:11.385356 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795bfbdb-9d4c-47f4-8a15-70b57d86f0fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:46:11.385356 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795bfbdb-9d4c-47f4-8a15-70b57d86f0fa admin admin] PATH_INFO: `/v3/projects/08642e391b2b451ba66d6a1e4c4e1337` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:46:11.385356 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795bfbdb-9d4c-47f4-8a15-70b57d86f0fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=08642e391b2b451ba66d6a1e4c4e1337)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:46:11.386899 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795bfbdb-9d4c-47f4-8a15-70b57d86f0fa admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:46:11.420167 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5133defe-5a4a-4797-ab2f-5990d88b11fa None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:46:11.472976 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dfeb18-7a83-4621-8cf2-c72fed61b70e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a856a413100443939fe9b10daa868518', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:46:11.473601 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dfeb18-7a83-4621-8cf2-c72fed61b70e service neutron] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:46:11.473876 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dfeb18-7a83-4621-8cf2-c72fed61b70e service neutron] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:46:11.474144 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dfeb18-7a83-4621-8cf2-c72fed61b70e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:46:11.483489 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97dfeb18-7a83-4621-8cf2-c72fed61b70e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:46:11.484979 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97dfeb18-7a83-4621-8cf2-c72fed61b70e service neutron] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:46:11.495183 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1017/2049] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:46:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 15:46:11.553968 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-795bfbdb-9d4c-47f4-8a15-70b57d86f0fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08642e391b2b451ba66d6a1e4c4e1337', 'request_id': 'req-795bfbdb-9d4c-47f4-8a15-70b57d86f0fa'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:46:11.560393 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-795bfbdb-9d4c-47f4-8a15-70b57d86f0fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08642e391b2b451ba66d6a1e4c4e1337', 'request_id': 'req-795bfbdb-9d4c-47f4-8a15-70b57d86f0fa'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:46:11.621610 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dfeb18-7a83-4621-8cf2-c72fed61b70e service neutron] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:46:11.621610 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-97dfeb18-7a83-4621-8cf2-c72fed61b70e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:46:11.626497 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dfeb18-7a83-4621-8cf2-c72fed61b70e service neutron] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:46:11.683549 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2b1afe-6639-4636-9449-c9ccfecdbca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:46:11.684206 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2b1afe-6639-4636-9449-c9ccfecdbca5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:46:11.684796 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2b1afe-6639-4636-9449-c9ccfecdbca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:46:11.684796 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2b1afe-6639-4636-9449-c9ccfecdbca5 admin admin] PATH_INFO: `/v3/projects/17a0bbb820b649e7a226f90e64c9133a` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:46:11.685953 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2b1afe-6639-4636-9449-c9ccfecdbca5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=17a0bbb820b649e7a226f90e64c9133a)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:46:11.688048 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2b1afe-6639-4636-9449-c9ccfecdbca5 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:46:11.701220 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-795bfbdb-9d4c-47f4-8a15-70b57d86f0fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08642e391b2b451ba66d6a1e4c4e1337', 'request_id': 'req-795bfbdb-9d4c-47f4-8a15-70b57d86f0fa'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:46:11.715437 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-795bfbdb-9d4c-47f4-8a15-70b57d86f0fa admin admin] The token cache is being invalidate because project 08642e391b2b451ba66d6a1e4c4e1337 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80352) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 15:46:11.715934 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-795bfbdb-9d4c-47f4-8a15-70b57d86f0fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:46:11.717248 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-795bfbdb-9d4c-47f4-8a15-70b57d86f0fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:46:11.719349 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1033/2050] 10.222.0.102 () {58 vars in 1238 bytes} [Mon Aug 1 15:46:11 2022] DELETE /identity/v3/projects/08642e391b2b451ba66d6a1e4c4e1337 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:46:11.726267 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91589ee-c47a-4812-a536-0e91286f6cb6 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:46:11.726609 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91589ee-c47a-4812-a536-0e91286f6cb6 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:46:11.727309 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91589ee-c47a-4812-a536-0e91286f6cb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:46:11.750067 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-c91589ee-c47a-4812-a536-0e91286f6cb6 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:46:11.751339 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-c91589ee-c47a-4812-a536-0e91286f6cb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:46:11.761093 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1034/2051] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:46:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 15:46:11.768723 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83a5038-eb07-4597-b317-6acc5da81cc8 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:46:11.769065 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83a5038-eb07-4597-b317-6acc5da81cc8 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:46:11.773796 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83a5038-eb07-4597-b317-6acc5da81cc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:46:11.790064 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-f83a5038-eb07-4597-b317-6acc5da81cc8 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:46:11.791347 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-f83a5038-eb07-4597-b317-6acc5da81cc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:46:11.805189 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1035/2052] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:46:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 15:46:11.810767 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83a5038-eb07-4597-b317-6acc5da81cc8 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:46:11.829469 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83a5038-eb07-4597-b317-6acc5da81cc8 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:46:11.845684 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b104cc-d998-4ef6-b1a2-cbee512b3394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:46:11.846326 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b104cc-d998-4ef6-b1a2-cbee512b3394 admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:46:11.846601 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b104cc-d998-4ef6-b1a2-cbee512b3394 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:46:11.846867 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b104cc-d998-4ef6-b1a2-cbee512b3394 admin admin] PATH_INFO: `/v3/domains` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:46:11.847816 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b104cc-d998-4ef6-b1a2-cbee512b3394 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:46:11.847927 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b104cc-d998-4ef6-b1a2-cbee512b3394 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:46:11.853902 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b104cc-d998-4ef6-b1a2-cbee512b3394 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:46:11.870193 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1036/2053] 10.222.0.102 () {58 vars in 1158 bytes} [Mon Aug 1 15:46:11 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:46:11.874815 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b104cc-d998-4ef6-b1a2-cbee512b3394 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:46:11.889104 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b104cc-d998-4ef6-b1a2-cbee512b3394 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:46:11.897999 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-3a2b1afe-6639-4636-9449-c9ccfecdbca5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17a0bbb820b649e7a226f90e64c9133a', 'request_id': 'req-3a2b1afe-6639-4636-9449-c9ccfecdbca5'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:46:11.966240 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2539c4-c540-4342-a80d-d49c92d405ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:46:11.967103 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2539c4-c540-4342-a80d-d49c92d405ce admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:46:11.967485 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2539c4-c540-4342-a80d-d49c92d405ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:46:11.967834 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2539c4-c540-4342-a80d-d49c92d405ce admin admin] PATH_INFO: `/v3/projects` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:46:11.968619 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2539c4-c540-4342-a80d-d49c92d405ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:46:11.971445 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2539c4-c540-4342-a80d-d49c92d405ce admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:46:12.041554 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-3a2b1afe-6639-4636-9449-c9ccfecdbca5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17a0bbb820b649e7a226f90e64c9133a', 'request_id': 'req-3a2b1afe-6639-4636-9449-c9ccfecdbca5'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:46:12.048629 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-3a2b1afe-6639-4636-9449-c9ccfecdbca5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17a0bbb820b649e7a226f90e64c9133a', 'request_id': 'req-3a2b1afe-6639-4636-9449-c9ccfecdbca5'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:46:12.060219 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-3a2b1afe-6639-4636-9449-c9ccfecdbca5 admin admin] The token cache is being invalidate because project 17a0bbb820b649e7a226f90e64c9133a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80353) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 15:46:12.060508 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-3a2b1afe-6639-4636-9449-c9ccfecdbca5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:46:12.061200 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-3a2b1afe-6639-4636-9449-c9ccfecdbca5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:46:12.062964 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1018/2054] 10.222.0.102 () {58 vars in 1238 bytes} [Mon Aug 1 15:46:11 2022] DELETE /identity/v3/projects/17a0bbb820b649e7a226f90e64c9133a => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:46:12.068590 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebfec06-6cf7-4a0f-a55d-12a706a66f25 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:46:12.068981 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebfec06-6cf7-4a0f-a55d-12a706a66f25 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:46:12.069258 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebfec06-6cf7-4a0f-a55d-12a706a66f25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:46:12.089329 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-6ebfec06-6cf7-4a0f-a55d-12a706a66f25 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:46:12.090533 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-6ebfec06-6cf7-4a0f-a55d-12a706a66f25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:46:12.098463 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1019/2055] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:46:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 15:46:12.105919 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a822eee-5922-4037-a523-51dd134a06ed None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:46:12.106205 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a822eee-5922-4037-a523-51dd134a06ed None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:46:12.106475 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a822eee-5922-4037-a523-51dd134a06ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:46:12.119382 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1037/2056] 10.222.0.102 () {60 vars in 1158 bytes} [Mon Aug 1 15:46:11 2022] POST /identity/v3/projects => generated 374 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 15:46:12.123441 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2539c4-c540-4342-a80d-d49c92d405ce admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:46:12.125090 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-4a2539c4-c540-4342-a80d-d49c92d405ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:46:12.125527 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-7a822eee-5922-4037-a523-51dd134a06ed None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:46:12.127205 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-7a822eee-5922-4037-a523-51dd134a06ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:46:12.193342 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1020/2057] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:46:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 15:46:12.194304 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a822eee-5922-4037-a523-51dd134a06ed None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:46:12.195634 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-7a822eee-5922-4037-a523-51dd134a06ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:46:12.199918 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2539c4-c540-4342-a80d-d49c92d405ce admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:46:12.206423 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f86a81-6317-4ff9-8903-b88c1015bbcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:46:12.207148 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f86a81-6317-4ff9-8903-b88c1015bbcd admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:46:12.207435 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f86a81-6317-4ff9-8903-b88c1015bbcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:46:12.207717 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f86a81-6317-4ff9-8903-b88c1015bbcd admin admin] PATH_INFO: `/v3/users` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:46:12.208113 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a822eee-5922-4037-a523-51dd134a06ed None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:46:12.208402 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f86a81-6317-4ff9-8903-b88c1015bbcd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:46:12.210398 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f86a81-6317-4ff9-8903-b88c1015bbcd admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:46:12.212892 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e2d36d-8013-492c-85e8-778aad7e4607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:46:12.220136 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e2d36d-8013-492c-85e8-778aad7e4607 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:46:12.220136 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e2d36d-8013-492c-85e8-778aad7e4607 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:46:12.220136 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e2d36d-8013-492c-85e8-778aad7e4607 admin admin] PATH_INFO: `/v3/projects/b58d7b464982457987736776430757aa` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:46:12.220136 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e2d36d-8013-492c-85e8-778aad7e4607 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b58d7b464982457987736776430757aa)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:46:12.220136 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e2d36d-8013-492c-85e8-778aad7e4607 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:46:12.326772 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1038/2058] 10.222.0.102 () {60 vars in 1149 bytes} [Mon Aug 1 15:46:12 2022] POST /identity/v3/users => generated 288 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 15:46:12.326772 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f86a81-6317-4ff9-8903-b88c1015bbcd admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:46:12.334979 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f86a81-6317-4ff9-8903-b88c1015bbcd admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:46:12.339704 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661ddabd-6785-4532-a013-7c0b59a564cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:46:12.340290 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661ddabd-6785-4532-a013-7c0b59a564cf admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:46:12.340571 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661ddabd-6785-4532-a013-7c0b59a564cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:46:12.340867 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661ddabd-6785-4532-a013-7c0b59a564cf admin admin] PATH_INFO: `/v3/domains` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:46:12.341571 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661ddabd-6785-4532-a013-7c0b59a564cf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:46:12.341875 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661ddabd-6785-4532-a013-7c0b59a564cf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:46:12.343482 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661ddabd-6785-4532-a013-7c0b59a564cf admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:46:12.347308 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:46:12.357603 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1039/2059] 10.222.0.102 () {58 vars in 1158 bytes} [Mon Aug 1 15:46:12 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:46:12.358630 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661ddabd-6785-4532-a013-7c0b59a564cf admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:46:12.363959 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-d2e2d36d-8013-492c-85e8-778aad7e4607 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b58d7b464982457987736776430757aa', 'request_id': 'req-d2e2d36d-8013-492c-85e8-778aad7e4607'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:46:12.370477 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661ddabd-6785-4532-a013-7c0b59a564cf admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:46:12.429875 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a8f27b-6fd8-4501-95ac-414df574ce12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:46:12.430487 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a8f27b-6fd8-4501-95ac-414df574ce12 admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:46:12.430760 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a8f27b-6fd8-4501-95ac-414df574ce12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:46:12.431028 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a8f27b-6fd8-4501-95ac-414df574ce12 admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:46:12.431774 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a8f27b-6fd8-4501-95ac-414df574ce12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:46:12.433456 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a8f27b-6fd8-4501-95ac-414df574ce12 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:46:12.443297 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-d2e2d36d-8013-492c-85e8-778aad7e4607 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b58d7b464982457987736776430757aa', 'request_id': 'req-d2e2d36d-8013-492c-85e8-778aad7e4607'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:46:12.443748 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1040/2060] 10.222.0.102 () {58 vars in 1127 bytes} [Mon Aug 1 15:46:12 2022] GET /identity/v3/roles => generated 1427 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:46:12.444523 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a8f27b-6fd8-4501-95ac-414df574ce12 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:46:12.451716 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-d2e2d36d-8013-492c-85e8-778aad7e4607 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b58d7b464982457987736776430757aa', 'request_id': 'req-d2e2d36d-8013-492c-85e8-778aad7e4607'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:46:12.454455 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a8f27b-6fd8-4501-95ac-414df574ce12 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:46:12.459186 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcef7148-3685-47e4-a681-77d6893451f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:46:12.459787 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcef7148-3685-47e4-a681-77d6893451f0 admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:46:12.460080 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcef7148-3685-47e4-a681-77d6893451f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:46:12.460334 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcef7148-3685-47e4-a681-77d6893451f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:46:12.461038 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcef7148-3685-47e4-a681-77d6893451f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:46:12.462916 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcef7148-3685-47e4-a681-77d6893451f0 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:46:12.463340 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-d2e2d36d-8013-492c-85e8-778aad7e4607 admin admin] The token cache is being invalidate because project b58d7b464982457987736776430757aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80353) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 15:46:12.463642 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-d2e2d36d-8013-492c-85e8-778aad7e4607 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:46:12.464437 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-d2e2d36d-8013-492c-85e8-778aad7e4607 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:46:12.466045 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1021/2061] 10.222.0.102 () {58 vars in 1238 bytes} [Mon Aug 1 15:46:12 2022] DELETE /identity/v3/projects/b58d7b464982457987736776430757aa => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:46:12.467441 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e2d36d-8013-492c-85e8-778aad7e4607 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:46:12.471979 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-d2e2d36d-8013-492c-85e8-778aad7e4607 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:46:12.483643 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e2d36d-8013-492c-85e8-778aad7e4607 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:46:12.488943 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c310d7-5aac-4845-931c-db72f32a9adf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:46:12.489561 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c310d7-5aac-4845-931c-db72f32a9adf admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:46:12.489847 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c310d7-5aac-4845-931c-db72f32a9adf admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:46:12.490125 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c310d7-5aac-4845-931c-db72f32a9adf admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:46:12.490810 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c310d7-5aac-4845-931c-db72f32a9adf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:46:12.492426 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c310d7-5aac-4845-931c-db72f32a9adf admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:46:12.503673 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1022/2062] 10.222.0.102 () {58 vars in 1127 bytes} [Mon Aug 1 15:46:12 2022] GET /identity/v3/roles => generated 1427 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:46:12.504517 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c310d7-5aac-4845-931c-db72f32a9adf admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:46:12.507020 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-33c310d7-5aac-4845-931c-db72f32a9adf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:46:12.520928 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c310d7-5aac-4845-931c-db72f32a9adf admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:46:12.525720 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce288a3a-7f4b-4eb4-87d5-4c19a258628d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:46:12.526413 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce288a3a-7f4b-4eb4-87d5-4c19a258628d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:46:12.526700 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce288a3a-7f4b-4eb4-87d5-4c19a258628d admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:46:12.526980 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce288a3a-7f4b-4eb4-87d5-4c19a258628d admin admin] PATH_INFO: `/v3/users/2f7a0036595b481caa538bc9e725b4bd` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:46:12.528232 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce288a3a-7f4b-4eb4-87d5-4c19a258628d admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f7a0036595b481caa538bc9e725b4bd)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:46:12.530290 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce288a3a-7f4b-4eb4-87d5-4c19a258628d admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:46:12.588290 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1041/2063] 10.222.0.102 () {60 vars in 1158 bytes} [Mon Aug 1 15:46:12 2022] POST /identity/v3/projects => generated 390 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:46:12.589137 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcef7148-3685-47e4-a681-77d6893451f0 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:46:12.661316 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcef7148-3685-47e4-a681-77d6893451f0 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:46:12.666059 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d953e708-6253-45e0-9dc1-0309670e0ea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:46:12.666725 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d953e708-6253-45e0-9dc1-0309670e0ea3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:46:12.667001 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d953e708-6253-45e0-9dc1-0309670e0ea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:46:12.667277 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d953e708-6253-45e0-9dc1-0309670e0ea3 admin admin] PATH_INFO: `/v3/projects/bc7c9ab0d0124169a85856b9bfdf6f31/users/b0b4b3ac851a40a09522345b3e61c75b/roles/27f5093ac0674d799cdbd17c68482e32` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:46:12.681465 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d953e708-6253-45e0-9dc1-0309670e0ea3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc7c9ab0d0124169a85856b9bfdf6f31, user_id=b0b4b3ac851a40a09522345b3e61c75b, role_id=27f5093ac0674d799cdbd17c68482e32)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:46:12.684125 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d953e708-6253-45e0-9dc1-0309670e0ea3 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:46:12.767289 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1042/2064] 10.222.0.102 () {60 vars in 1488 bytes} [Mon Aug 1 15:46:12 2022] PUT /identity/v3/projects/bc7c9ab0d0124169a85856b9bfdf6f31/users/b0b4b3ac851a40a09522345b3e61c75b/roles/27f5093ac0674d799cdbd17c68482e32 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:46:12.768389 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d953e708-6253-45e0-9dc1-0309670e0ea3 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:46:12.770265 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-d953e708-6253-45e0-9dc1-0309670e0ea3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:46:12.833532 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d953e708-6253-45e0-9dc1-0309670e0ea3 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:46:12.838382 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9382dc45-3c74-4ea1-a851-ba67a705f332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:46:12.839044 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9382dc45-3c74-4ea1-a851-ba67a705f332 admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:46:12.839311 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9382dc45-3c74-4ea1-a851-ba67a705f332 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:46:12.839582 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9382dc45-3c74-4ea1-a851-ba67a705f332 admin admin] PATH_INFO: `/v3/users` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:46:12.840196 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-ce288a3a-7f4b-4eb4-87d5-4c19a258628d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f7a0036595b481caa538bc9e725b4bd'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:46:12.840309 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9382dc45-3c74-4ea1-a851-ba67a705f332 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:46:12.842261 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9382dc45-3c74-4ea1-a851-ba67a705f332 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:46:12.853909 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:46:12.944432 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-ce288a3a-7f4b-4eb4-87d5-4c19a258628d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f7a0036595b481caa538bc9e725b4bd'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:46:12.959228 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-ce288a3a-7f4b-4eb4-87d5-4c19a258628d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f7a0036595b481caa538bc9e725b4bd'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:46:12.959952 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-ce288a3a-7f4b-4eb4-87d5-4c19a258628d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f7a0036595b481caa538bc9e725b4bd'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:46:12.960674 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-ce288a3a-7f4b-4eb4-87d5-4c19a258628d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f7a0036595b481caa538bc9e725b4bd'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:46:12.974408 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1023/2065] 10.222.0.102 () {58 vars in 1229 bytes} [Mon Aug 1 15:46:12 2022] DELETE /identity/v3/users/2f7a0036595b481caa538bc9e725b4bd => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:46:12.976004 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56477d06-ccaf-454b-aa68-b42af8b165b7 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:46:12.976657 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56477d06-ccaf-454b-aa68-b42af8b165b7 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:46:12.976657 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56477d06-ccaf-454b-aa68-b42af8b165b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:46:12.991007 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1043/2066] 10.222.0.102 () {60 vars in 1149 bytes} [Mon Aug 1 15:46:12 2022] POST /identity/v3/users => generated 296 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:46:12.992064 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9382dc45-3c74-4ea1-a851-ba67a705f332 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:46:12.994335 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-9382dc45-3c74-4ea1-a851-ba67a705f332 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:46:13.009827 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9382dc45-3c74-4ea1-a851-ba67a705f332 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:46:13.020545 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-56477d06-ccaf-454b-aa68-b42af8b165b7 None None] MFA Rules not processed for user `b0b4b3ac851a40a09522345b3e61c75b`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:46:13.021928 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-56477d06-ccaf-454b-aa68-b42af8b165b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:46:13.060154 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:46:13.096284 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787cdc8f-eada-4e23-bfb3-e86d5c646951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:46:13.096946 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787cdc8f-eada-4e23-bfb3-e86d5c646951 admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:46:13.097294 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787cdc8f-eada-4e23-bfb3-e86d5c646951 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:46:13.097496 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787cdc8f-eada-4e23-bfb3-e86d5c646951 admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:46:13.098196 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787cdc8f-eada-4e23-bfb3-e86d5c646951 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:46:13.099792 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1024/2067] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:46:12 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:46:13.103672 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787cdc8f-eada-4e23-bfb3-e86d5c646951 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:46:13.104023 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56477d06-ccaf-454b-aa68-b42af8b165b7 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:46:13.105569 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-56477d06-ccaf-454b-aa68-b42af8b165b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:46:13.115956 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1044/2068] 10.222.0.102 () {58 vars in 1127 bytes} [Mon Aug 1 15:46:12 2022] GET /identity/v3/roles => generated 1427 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:46:13.122170 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787cdc8f-eada-4e23-bfb3-e86d5c646951 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:46:13.123558 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56477d06-ccaf-454b-aa68-b42af8b165b7 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:46:13.129058 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93199007-c2d0-48ff-9e32-c7301ee0f93d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:46:13.130067 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93199007-c2d0-48ff-9e32-c7301ee0f93d admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:46:13.130357 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93199007-c2d0-48ff-9e32-c7301ee0f93d admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:46:13.130725 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93199007-c2d0-48ff-9e32-c7301ee0f93d admin admin] PATH_INFO: `/v3/projects` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:46:13.131402 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93199007-c2d0-48ff-9e32-c7301ee0f93d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:46:13.133006 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787cdc8f-eada-4e23-bfb3-e86d5c646951 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:46:13.133360 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93199007-c2d0-48ff-9e32-c7301ee0f93d admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:46:13.140095 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb63ac4-d791-4268-94a9-c9204303ff8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:46:13.140806 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb63ac4-d791-4268-94a9-c9204303ff8f admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:46:13.141119 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb63ac4-d791-4268-94a9-c9204303ff8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:46:13.141390 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb63ac4-d791-4268-94a9-c9204303ff8f admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:46:13.142083 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb63ac4-d791-4268-94a9-c9204303ff8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:46:13.144303 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb63ac4-d791-4268-94a9-c9204303ff8f admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:46:13.159585 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1045/2069] 10.222.0.102 () {58 vars in 1127 bytes} [Mon Aug 1 15:46:13 2022] GET /identity/v3/roles => generated 1427 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 15:46:13.166048 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb63ac4-d791-4268-94a9-c9204303ff8f admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:46:13.176443 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb63ac4-d791-4268-94a9-c9204303ff8f admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:46:13.181857 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378af1b1-b0bf-43fe-82d6-dcceb9135516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:46:13.182510 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378af1b1-b0bf-43fe-82d6-dcceb9135516 admin admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:46:13.182743 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378af1b1-b0bf-43fe-82d6-dcceb9135516 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:46:13.183016 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378af1b1-b0bf-43fe-82d6-dcceb9135516 admin admin] PATH_INFO: `/v3/projects/5fc13acbed3d4c56bd14a9d7044ce89b/users/5a0bf81bcf784878acabeb03ccddcd1b/roles/27f5093ac0674d799cdbd17c68482e32` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:46:13.198216 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378af1b1-b0bf-43fe-82d6-dcceb9135516 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5fc13acbed3d4c56bd14a9d7044ce89b, user_id=5a0bf81bcf784878acabeb03ccddcd1b, role_id=27f5093ac0674d799cdbd17c68482e32)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:46:13.201078 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378af1b1-b0bf-43fe-82d6-dcceb9135516 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:46:13.212358 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1025/2070] 10.222.0.102 () {60 vars in 1158 bytes} [Mon Aug 1 15:46:13 2022] POST /identity/v3/projects => generated 374 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 15:46:13.216297 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93199007-c2d0-48ff-9e32-c7301ee0f93d admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:46:13.279253 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93199007-c2d0-48ff-9e32-c7301ee0f93d admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:46:13.284333 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336e2c7f-64c0-468c-97d9-77a472f28c5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:46:13.285022 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336e2c7f-64c0-468c-97d9-77a472f28c5a admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:46:13.285588 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336e2c7f-64c0-468c-97d9-77a472f28c5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:46:13.285859 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336e2c7f-64c0-468c-97d9-77a472f28c5a admin admin] PATH_INFO: `/v3/users` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:46:13.286520 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336e2c7f-64c0-468c-97d9-77a472f28c5a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:46:13.288986 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336e2c7f-64c0-468c-97d9-77a472f28c5a admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:46:13.291931 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1046/2071] 10.222.0.102 () {60 vars in 1488 bytes} [Mon Aug 1 15:46:13 2022] PUT /identity/v3/projects/5fc13acbed3d4c56bd14a9d7044ce89b/users/5a0bf81bcf784878acabeb03ccddcd1b/roles/27f5093ac0674d799cdbd17c68482e32 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:46:13.297107 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dffe9e8-422d-49a9-a440-78d2f85dc130 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:46:13.297727 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dffe9e8-422d-49a9-a440-78d2f85dc130 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:46:13.299425 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dffe9e8-422d-49a9-a440-78d2f85dc130 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:46:13.319078 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-2dffe9e8-422d-49a9-a440-78d2f85dc130 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:46:13.320291 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-2dffe9e8-422d-49a9-a440-78d2f85dc130 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:46:13.387175 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1026/2072] 10.222.0.102 () {60 vars in 1149 bytes} [Mon Aug 1 15:46:13 2022] POST /identity/v3/users => generated 294 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 15:46:13.391258 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336e2c7f-64c0-468c-97d9-77a472f28c5a admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:46:13.396101 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1047/2073] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:46:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:46:13.403171 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dffe9e8-422d-49a9-a440-78d2f85dc130 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:46:13.403973 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336e2c7f-64c0-468c-97d9-77a472f28c5a admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:46:13.404613 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-2dffe9e8-422d-49a9-a440-78d2f85dc130 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:46:13.411576 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63faccb-2ad5-4043-ae6e-bbd793205216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:46:13.412382 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63faccb-2ad5-4043-ae6e-bbd793205216 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:46:13.413052 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63faccb-2ad5-4043-ae6e-bbd793205216 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:46:13.416815 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63faccb-2ad5-4043-ae6e-bbd793205216 admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:46:13.416815 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63faccb-2ad5-4043-ae6e-bbd793205216 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:46:13.416815 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63faccb-2ad5-4043-ae6e-bbd793205216 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:46:13.428578 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1027/2074] 10.222.0.102 () {58 vars in 1127 bytes} [Mon Aug 1 15:46:13 2022] GET /identity/v3/roles => generated 1427 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 15:46:13.432738 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63faccb-2ad5-4043-ae6e-bbd793205216 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:46:13.444708 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63faccb-2ad5-4043-ae6e-bbd793205216 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:46:13.449831 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57414ab3-384a-4455-b1d3-9fbbce75ac2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:46:13.450504 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57414ab3-384a-4455-b1d3-9fbbce75ac2f admin admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:46:13.450770 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57414ab3-384a-4455-b1d3-9fbbce75ac2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:46:13.451041 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57414ab3-384a-4455-b1d3-9fbbce75ac2f admin admin] PATH_INFO: `/v3/projects/9ea8ea8bdeee4f049854ddc60a32d41a/users/7aaac7a379f842d6825901623d7607df/roles/de1374f966c04c27b579515b54334fd2` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:46:13.472183 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57414ab3-384a-4455-b1d3-9fbbce75ac2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ea8ea8bdeee4f049854ddc60a32d41a, user_id=7aaac7a379f842d6825901623d7607df, role_id=de1374f966c04c27b579515b54334fd2)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:46:13.475002 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57414ab3-384a-4455-b1d3-9fbbce75ac2f admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:46:13.475405 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dffe9e8-422d-49a9-a440-78d2f85dc130 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:46:13.479370 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f95e85a-5a5a-4bfd-981f-8324a5e127c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a856a413100443939fe9b10daa868518', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:46:13.479990 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f95e85a-5a5a-4bfd-981f-8324a5e127c3 service neutron] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:46:13.480266 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f95e85a-5a5a-4bfd-981f-8324a5e127c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:46:13.480534 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f95e85a-5a5a-4bfd-981f-8324a5e127c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:46:13.490959 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f95e85a-5a5a-4bfd-981f-8324a5e127c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:46:13.492389 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f95e85a-5a5a-4bfd-981f-8324a5e127c3 service neutron] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:46:13.505505 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1048/2075] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:46:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 15:46:13.557854 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f95e85a-5a5a-4bfd-981f-8324a5e127c3 service neutron] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:46:13.559353 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-8f95e85a-5a5a-4bfd-981f-8324a5e127c3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:46:13.573463 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f95e85a-5a5a-4bfd-981f-8324a5e127c3 service neutron] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:46:13.580459 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6f2dc9-314c-4242-aa52-cffeb4f31fb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:46:13.580459 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6f2dc9-314c-4242-aa52-cffeb4f31fb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:46:13.580459 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6f2dc9-314c-4242-aa52-cffeb4f31fb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:46:13.580758 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6f2dc9-314c-4242-aa52-cffeb4f31fb3 admin admin] PATH_INFO: `/v3/projects/bc04b21e02b248bfab4e590fc093b0fd` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:46:13.581960 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6f2dc9-314c-4242-aa52-cffeb4f31fb3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc04b21e02b248bfab4e590fc093b0fd)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:46:13.584092 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6f2dc9-314c-4242-aa52-cffeb4f31fb3 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:46:13.610578 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1028/2076] 10.222.0.102 () {60 vars in 1488 bytes} [Mon Aug 1 15:46:13 2022] PUT /identity/v3/projects/9ea8ea8bdeee4f049854ddc60a32d41a/users/7aaac7a379f842d6825901623d7607df/roles/de1374f966c04c27b579515b54334fd2 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 15:46:13.614963 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57414ab3-384a-4455-b1d3-9fbbce75ac2f admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:46:13.682174 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57414ab3-384a-4455-b1d3-9fbbce75ac2f admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:46:13.687124 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b899e02d-0079-409f-b97c-7e5986dce844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:46:13.687660 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b899e02d-0079-409f-b97c-7e5986dce844 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:46:13.687940 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b899e02d-0079-409f-b97c-7e5986dce844 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:46:13.688213 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b899e02d-0079-409f-b97c-7e5986dce844 admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:46:13.688944 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b899e02d-0079-409f-b97c-7e5986dce844 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:46:13.690589 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b899e02d-0079-409f-b97c-7e5986dce844 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:46:13.701016 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1029/2077] 10.222.0.102 () {58 vars in 1127 bytes} [Mon Aug 1 15:46:13 2022] GET /identity/v3/roles => generated 1427 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 15:46:13.705514 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b899e02d-0079-409f-b97c-7e5986dce844 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:46:13.718523 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b899e02d-0079-409f-b97c-7e5986dce844 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:46:13.735629 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-9a6f2dc9-314c-4242-aa52-cffeb4f31fb3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc04b21e02b248bfab4e590fc093b0fd', 'request_id': 'req-9a6f2dc9-314c-4242-aa52-cffeb4f31fb3'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:46:13.743156 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-9a6f2dc9-314c-4242-aa52-cffeb4f31fb3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc04b21e02b248bfab4e590fc093b0fd', 'request_id': 'req-9a6f2dc9-314c-4242-aa52-cffeb4f31fb3'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:46:13.770737 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:46:13.780276 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001c18dd-d007-4029-be64-a961077aa275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:46:13.780982 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001c18dd-d007-4029-be64-a961077aa275 admin admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:46:13.781261 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001c18dd-d007-4029-be64-a961077aa275 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:46:13.781530 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001c18dd-d007-4029-be64-a961077aa275 admin admin] PATH_INFO: `/v3/projects/9ea8ea8bdeee4f049854ddc60a32d41a/users/7aaac7a379f842d6825901623d7607df/roles/de1374f966c04c27b579515b54334fd2` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:46:13.784040 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001c18dd-d007-4029-be64-a961077aa275 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ea8ea8bdeee4f049854ddc60a32d41a, user_id=7aaac7a379f842d6825901623d7607df, role_id=de1374f966c04c27b579515b54334fd2)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:46:13.786852 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001c18dd-d007-4029-be64-a961077aa275 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:46:13.797397 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1030/2078] 10.222.0.102 () {60 vars in 1488 bytes} [Mon Aug 1 15:46:13 2022] PUT /identity/v3/projects/9ea8ea8bdeee4f049854ddc60a32d41a/users/7aaac7a379f842d6825901623d7607df/roles/de1374f966c04c27b579515b54334fd2 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 15:46:13.808336 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ee0dec-ff85-4dda-aa63-6c4b5759c61e None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:46:13.808622 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ee0dec-ff85-4dda-aa63-6c4b5759c61e None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:46:13.808925 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ee0dec-ff85-4dda-aa63-6c4b5759c61e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:46:13.836838 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-67ee0dec-ff85-4dda-aa63-6c4b5759c61e None None] MFA Rules not processed for user `7aaac7a379f842d6825901623d7607df`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:46:13.838199 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-67ee0dec-ff85-4dda-aa63-6c4b5759c61e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:46:13.866284 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-9a6f2dc9-314c-4242-aa52-cffeb4f31fb3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc04b21e02b248bfab4e590fc093b0fd', 'request_id': 'req-9a6f2dc9-314c-4242-aa52-cffeb4f31fb3'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:46:13.897622 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-9a6f2dc9-314c-4242-aa52-cffeb4f31fb3 admin admin] The token cache is being invalidate because project bc04b21e02b248bfab4e590fc093b0fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80352) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 15:46:13.903549 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-9a6f2dc9-314c-4242-aa52-cffeb4f31fb3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:46:13.903549 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-9a6f2dc9-314c-4242-aa52-cffeb4f31fb3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:46:13.903549 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1049/2079] 10.222.0.102 () {58 vars in 1238 bytes} [Mon Aug 1 15:46:13 2022] DELETE /identity/v3/projects/bc04b21e02b248bfab4e590fc093b0fd => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:46:13.905074 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf059b9d-f03e-4624-aac8-91962a97492b None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:46:13.905364 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf059b9d-f03e-4624-aac8-91962a97492b None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:46:13.905643 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf059b9d-f03e-4624-aac8-91962a97492b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:46:13.918550 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1031/2080] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:46:13 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 15:46:13.931661 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-bf059b9d-f03e-4624-aac8-91962a97492b None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:46:13.932483 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ee0dec-ff85-4dda-aa63-6c4b5759c61e None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:46:13.932931 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-bf059b9d-f03e-4624-aac8-91962a97492b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:46:13.934488 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-67ee0dec-ff85-4dda-aa63-6c4b5759c61e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:46:13.993708 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:46:13.995277 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ee0dec-ff85-4dda-aa63-6c4b5759c61e None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:46:13.999032 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed49b04-dfe0-4def-b911-8a221f3587d3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff810b37183c4729859c1b05edff1703', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:46:14.001078 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed49b04-dfe0-4def-b911-8a221f3587d3 service cinder] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:46:14.001078 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed49b04-dfe0-4def-b911-8a221f3587d3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:46:14.001078 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed49b04-dfe0-4def-b911-8a221f3587d3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:46:14.007348 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-7ed49b04-dfe0-4def-b911-8a221f3587d3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:46:14.016795 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1050/2081] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:46:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:46:14.018732 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c5f335-ab64-4289-ba5b-1e16b30f1082 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:46:14.019396 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c5f335-ab64-4289-ba5b-1e16b30f1082 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:46:14.019396 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c5f335-ab64-4289-ba5b-1e16b30f1082 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:46:14.045131 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-92c5f335-ab64-4289-ba5b-1e16b30f1082 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:46:14.046511 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-92c5f335-ab64-4289-ba5b-1e16b30f1082 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:46:14.056243 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1051/2082] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:46:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:46:14.061936 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c5f335-ab64-4289-ba5b-1e16b30f1082 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:46:14.072833 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c5f335-ab64-4289-ba5b-1e16b30f1082 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:46:14.079038 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3610db3-03d9-4c50-8679-a344a3940ac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:46:14.080715 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3610db3-03d9-4c50-8679-a344a3940ac0 admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:46:14.081304 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3610db3-03d9-4c50-8679-a344a3940ac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:46:14.081415 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed49b04-dfe0-4def-b911-8a221f3587d3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:46:14.081897 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3610db3-03d9-4c50-8679-a344a3940ac0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:46:14.083150 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3610db3-03d9-4c50-8679-a344a3940ac0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:46:14.083271 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed49b04-dfe0-4def-b911-8a221f3587d3 service cinder] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:46:14.083829 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3610db3-03d9-4c50-8679-a344a3940ac0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:46:14.085824 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3610db3-03d9-4c50-8679-a344a3940ac0 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:46:14.094835 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1032/2083] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:46:13 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:46:14.104561 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1052/2084] 10.222.0.102 () {58 vars in 1158 bytes} [Mon Aug 1 15:46:14 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:46:14.108939 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed49b04-dfe0-4def-b911-8a221f3587d3 service cinder] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:46:14.124245 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed49b04-dfe0-4def-b911-8a221f3587d3 service cinder] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:46:14.136403 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d81f1e-fd46-49b0-8dab-2a8e85112dd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:46:14.137329 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d81f1e-fd46-49b0-8dab-2a8e85112dd5 admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:46:14.138140 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d81f1e-fd46-49b0-8dab-2a8e85112dd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:46:14.138591 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d81f1e-fd46-49b0-8dab-2a8e85112dd5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:46:14.139648 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d81f1e-fd46-49b0-8dab-2a8e85112dd5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:46:14.142082 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d81f1e-fd46-49b0-8dab-2a8e85112dd5 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:46:14.277635 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3610db3-03d9-4c50-8679-a344a3940ac0 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:46:14.284879 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1033/2085] 10.222.0.102 () {60 vars in 1158 bytes} [Mon Aug 1 15:46:14 2022] POST /identity/v3/projects => generated 378 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:46:14.289315 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3610db3-03d9-4c50-8679-a344a3940ac0 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:46:14.314939 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:46:14.361000 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c14e7c9-d901-4d58-a0b9-e0374b5c54bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:46:14.362924 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c14e7c9-d901-4d58-a0b9-e0374b5c54bf admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:46:14.363337 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c14e7c9-d901-4d58-a0b9-e0374b5c54bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:46:14.363617 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c14e7c9-d901-4d58-a0b9-e0374b5c54bf admin admin] PATH_INFO: `/v3/users` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:46:14.364383 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c14e7c9-d901-4d58-a0b9-e0374b5c54bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:46:14.366988 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c14e7c9-d901-4d58-a0b9-e0374b5c54bf admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:46:14.395899 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:46:14.476302 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1053/2086] 10.222.0.102 () {60 vars in 1149 bytes} [Mon Aug 1 15:46:14 2022] POST /identity/v3/users => generated 290 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 15:46:14.478014 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d81f1e-fd46-49b0-8dab-2a8e85112dd5 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:46:14.496008 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d81f1e-fd46-49b0-8dab-2a8e85112dd5 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:46:14.501580 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d9e2a1-484e-413a-a746-01bf70d5c52d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:46:14.502217 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d9e2a1-484e-413a-a746-01bf70d5c52d admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:46:14.502553 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d9e2a1-484e-413a-a746-01bf70d5c52d admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:46:14.502833 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d9e2a1-484e-413a-a746-01bf70d5c52d admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:46:14.503577 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d9e2a1-484e-413a-a746-01bf70d5c52d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:46:14.505255 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d9e2a1-484e-413a-a746-01bf70d5c52d admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:46:14.516437 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1034/2087] 10.222.0.102 () {58 vars in 1127 bytes} [Mon Aug 1 15:46:14 2022] GET /identity/v3/roles => generated 1427 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:46:14.521464 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c14e7c9-d901-4d58-a0b9-e0374b5c54bf admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:46:14.532219 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c14e7c9-d901-4d58-a0b9-e0374b5c54bf admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:46:14.537356 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94308dc-32a4-4347-82c7-8b5c3d4e20af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:46:14.537970 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94308dc-32a4-4347-82c7-8b5c3d4e20af admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:46:14.538248 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94308dc-32a4-4347-82c7-8b5c3d4e20af admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:46:14.538517 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94308dc-32a4-4347-82c7-8b5c3d4e20af admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:46:14.539318 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94308dc-32a4-4347-82c7-8b5c3d4e20af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:46:14.540986 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94308dc-32a4-4347-82c7-8b5c3d4e20af admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:46:14.551827 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1054/2088] 10.222.0.102 () {58 vars in 1127 bytes} [Mon Aug 1 15:46:14 2022] GET /identity/v3/roles => generated 1427 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:46:14.556341 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d9e2a1-484e-413a-a746-01bf70d5c52d admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:46:14.566385 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d9e2a1-484e-413a-a746-01bf70d5c52d admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:46:14.571537 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23ce460-c0ba-4935-9dc8-78b3fe5d4bec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:46:14.572208 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23ce460-c0ba-4935-9dc8-78b3fe5d4bec admin admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:46:14.572486 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23ce460-c0ba-4935-9dc8-78b3fe5d4bec admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:46:14.575652 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23ce460-c0ba-4935-9dc8-78b3fe5d4bec admin admin] PATH_INFO: `/v3/projects/e163423954fb45928787468cec71b3a0/users/baf54f9e95694084aa66c38e48cdff49/roles/27f5093ac0674d799cdbd17c68482e32` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:46:14.588308 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23ce460-c0ba-4935-9dc8-78b3fe5d4bec admin admin] RBAC: Authorizing `identity:create_grant(project_id=e163423954fb45928787468cec71b3a0, user_id=baf54f9e95694084aa66c38e48cdff49, role_id=27f5093ac0674d799cdbd17c68482e32)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:46:14.591357 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23ce460-c0ba-4935-9dc8-78b3fe5d4bec admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:46:14.687776 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1035/2089] 10.222.0.102 () {60 vars in 1488 bytes} [Mon Aug 1 15:46:14 2022] PUT /identity/v3/projects/e163423954fb45928787468cec71b3a0/users/baf54f9e95694084aa66c38e48cdff49/roles/27f5093ac0674d799cdbd17c68482e32 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:46:14.698105 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9f0d98-ddbb-4c93-9302-bdad7076ef22 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:46:14.698462 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9f0d98-ddbb-4c93-9302-bdad7076ef22 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:46:14.698745 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9f0d98-ddbb-4c93-9302-bdad7076ef22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:46:14.739767 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-3f9f0d98-ddbb-4c93-9302-bdad7076ef22 None None] MFA Rules not processed for user `baf54f9e95694084aa66c38e48cdff49`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:46:14.741165 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-3f9f0d98-ddbb-4c93-9302-bdad7076ef22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:46:14.811901 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1055/2090] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:46:14 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:46:14.817107 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23ce460-c0ba-4935-9dc8-78b3fe5d4bec admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:46:14.893338 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23ce460-c0ba-4935-9dc8-78b3fe5d4bec admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:46:14.900321 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c046439-ac6c-4e4a-bc8d-a862ce1664f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:46:14.900965 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c046439-ac6c-4e4a-bc8d-a862ce1664f1 admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:46:14.901245 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c046439-ac6c-4e4a-bc8d-a862ce1664f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:46:14.902813 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c046439-ac6c-4e4a-bc8d-a862ce1664f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:46:14.902813 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c046439-ac6c-4e4a-bc8d-a862ce1664f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:46:14.904350 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c046439-ac6c-4e4a-bc8d-a862ce1664f1 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:46:15.049472 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1036/2091] 10.222.0.102 () {60 vars in 1158 bytes} [Mon Aug 1 15:46:14 2022] POST /identity/v3/projects => generated 376 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:46:15.053861 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9f0d98-ddbb-4c93-9302-bdad7076ef22 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:46:15.066695 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9f0d98-ddbb-4c93-9302-bdad7076ef22 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:46:15.171604 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24555df2-3dec-4189-8f52-d78c40997d22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:46:15.173271 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24555df2-3dec-4189-8f52-d78c40997d22 admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:46:15.181115 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24555df2-3dec-4189-8f52-d78c40997d22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:46:15.181115 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24555df2-3dec-4189-8f52-d78c40997d22 admin admin] PATH_INFO: `/v3/users` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:46:15.181115 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24555df2-3dec-4189-8f52-d78c40997d22 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:46:15.181115 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24555df2-3dec-4189-8f52-d78c40997d22 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:46:15.350376 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1056/2092] 10.222.0.102 () {60 vars in 1149 bytes} [Mon Aug 1 15:46:15 2022] POST /identity/v3/users => generated 295 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:46:15.354115 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c046439-ac6c-4e4a-bc8d-a862ce1664f1 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:46:15.365575 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c046439-ac6c-4e4a-bc8d-a862ce1664f1 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:46:15.370851 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e9f168-6076-436d-93a8-4a6ec75b61f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:46:15.371509 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e9f168-6076-436d-93a8-4a6ec75b61f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:46:15.372082 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e9f168-6076-436d-93a8-4a6ec75b61f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:46:15.372410 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e9f168-6076-436d-93a8-4a6ec75b61f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:46:15.373287 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e9f168-6076-436d-93a8-4a6ec75b61f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:46:15.375115 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e9f168-6076-436d-93a8-4a6ec75b61f0 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:46:15.388128 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1037/2093] 10.222.0.102 () {58 vars in 1127 bytes} [Mon Aug 1 15:46:15 2022] GET /identity/v3/roles => generated 1427 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:46:15.392758 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24555df2-3dec-4189-8f52-d78c40997d22 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:46:15.403788 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24555df2-3dec-4189-8f52-d78c40997d22 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:46:15.406418 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:46:15.412177 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d844ddbe-4f84-426f-bb8a-44f92ffff655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:46:15.412726 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d844ddbe-4f84-426f-bb8a-44f92ffff655 admin admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:46:15.413503 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d844ddbe-4f84-426f-bb8a-44f92ffff655 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:46:15.413503 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d844ddbe-4f84-426f-bb8a-44f92ffff655 admin admin] PATH_INFO: `/v3/projects/d69ba5f69c9a45be88725973b0ffbba5/users/a1b944f86649467fb60f7e0387617dac/roles/de1374f966c04c27b579515b54334fd2` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:46:15.430238 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d844ddbe-4f84-426f-bb8a-44f92ffff655 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d69ba5f69c9a45be88725973b0ffbba5, user_id=a1b944f86649467fb60f7e0387617dac, role_id=de1374f966c04c27b579515b54334fd2)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:46:15.432989 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d844ddbe-4f84-426f-bb8a-44f92ffff655 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:46:15.501525 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:46:15.564759 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1057/2094] 10.222.0.102 () {60 vars in 1488 bytes} [Mon Aug 1 15:46:15 2022] PUT /identity/v3/projects/d69ba5f69c9a45be88725973b0ffbba5/users/a1b944f86649467fb60f7e0387617dac/roles/de1374f966c04c27b579515b54334fd2 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:46:15.568423 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e9f168-6076-436d-93a8-4a6ec75b61f0 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:46:15.582012 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e9f168-6076-436d-93a8-4a6ec75b61f0 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:46:15.639982 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775ea39b-e384-4833-8d0f-dff774adf2ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:46:15.640724 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775ea39b-e384-4833-8d0f-dff774adf2ac admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:46:15.640930 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775ea39b-e384-4833-8d0f-dff774adf2ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:46:15.641173 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775ea39b-e384-4833-8d0f-dff774adf2ac admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:46:15.642734 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775ea39b-e384-4833-8d0f-dff774adf2ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:46:15.644042 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775ea39b-e384-4833-8d0f-dff774adf2ac admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:46:15.656051 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1038/2095] 10.222.0.102 () {58 vars in 1127 bytes} [Mon Aug 1 15:46:15 2022] GET /identity/v3/roles => generated 1427 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:46:15.660534 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d844ddbe-4f84-426f-bb8a-44f92ffff655 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:46:15.671598 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d844ddbe-4f84-426f-bb8a-44f92ffff655 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:46:15.677446 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e800be03-4cc3-4c55-a575-1ab16e4cd20b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:46:15.678394 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e800be03-4cc3-4c55-a575-1ab16e4cd20b admin admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:46:15.678677 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e800be03-4cc3-4c55-a575-1ab16e4cd20b admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:46:15.678950 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e800be03-4cc3-4c55-a575-1ab16e4cd20b admin admin] PATH_INFO: `/v3/projects/d69ba5f69c9a45be88725973b0ffbba5/users/a1b944f86649467fb60f7e0387617dac/roles/de1374f966c04c27b579515b54334fd2` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:46:15.680987 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e800be03-4cc3-4c55-a575-1ab16e4cd20b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d69ba5f69c9a45be88725973b0ffbba5, user_id=a1b944f86649467fb60f7e0387617dac, role_id=de1374f966c04c27b579515b54334fd2)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:46:15.684211 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e800be03-4cc3-4c55-a575-1ab16e4cd20b admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:46:15.707796 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1058/2096] 10.222.0.102 () {60 vars in 1488 bytes} [Mon Aug 1 15:46:15 2022] PUT /identity/v3/projects/d69ba5f69c9a45be88725973b0ffbba5/users/a1b944f86649467fb60f7e0387617dac/roles/de1374f966c04c27b579515b54334fd2 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:46:15.710131 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e01c78d-7bd3-4901-830e-41e610b8f269 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:46:15.710429 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e01c78d-7bd3-4901-830e-41e610b8f269 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:46:15.710798 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e01c78d-7bd3-4901-830e-41e610b8f269 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:46:15.741737 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-9e01c78d-7bd3-4901-830e-41e610b8f269 None None] MFA Rules not processed for user `a1b944f86649467fb60f7e0387617dac`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:46:15.743810 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-9e01c78d-7bd3-4901-830e-41e610b8f269 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:46:15.821759 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1039/2097] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:46:15 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:46:15.833591 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e800be03-4cc3-4c55-a575-1ab16e4cd20b admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:46:15.912162 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e800be03-4cc3-4c55-a575-1ab16e4cd20b admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:46:15.915847 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c758e6d-fc40-4071-9b89-944b2b2e1078 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff810b37183c4729859c1b05edff1703', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:46:15.916466 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c758e6d-fc40-4071-9b89-944b2b2e1078 service cinder] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:46:15.916751 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c758e6d-fc40-4071-9b89-944b2b2e1078 service cinder] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:46:15.917081 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c758e6d-fc40-4071-9b89-944b2b2e1078 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:46:15.974679 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c758e6d-fc40-4071-9b89-944b2b2e1078 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:46:15.976132 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c758e6d-fc40-4071-9b89-944b2b2e1078 service cinder] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:46:15.985343 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1059/2098] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:46:15 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:46:17.110341 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:46:17.718042 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:46:18.805605 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e01c78d-7bd3-4901-830e-41e610b8f269 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:46:18.807065 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-9e01c78d-7bd3-4901-830e-41e610b8f269 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:46:18.884994 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e01c78d-7bd3-4901-830e-41e610b8f269 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:46:18.905471 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9895141-a192-435e-8396-64f9bc853b3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:46:18.905471 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9895141-a192-435e-8396-64f9bc853b3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:46:18.905471 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9895141-a192-435e-8396-64f9bc853b3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:46:18.905471 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9895141-a192-435e-8396-64f9bc853b3c admin admin] PATH_INFO: `/v3/users/b0b4b3ac851a40a09522345b3e61c75b` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:46:18.905751 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9895141-a192-435e-8396-64f9bc853b3c admin admin] RBAC: Authorizing `identity:delete_user(user_id=b0b4b3ac851a40a09522345b3e61c75b)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:46:18.905751 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9895141-a192-435e-8396-64f9bc853b3c admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:46:19.205701 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-d9895141-a192-435e-8396-64f9bc853b3c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b0b4b3ac851a40a09522345b3e61c75b'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:46:19.282243 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-d9895141-a192-435e-8396-64f9bc853b3c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b0b4b3ac851a40a09522345b3e61c75b'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:46:19.299756 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-d9895141-a192-435e-8396-64f9bc853b3c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b0b4b3ac851a40a09522345b3e61c75b'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:46:19.300791 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-d9895141-a192-435e-8396-64f9bc853b3c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b0b4b3ac851a40a09522345b3e61c75b'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:46:19.301972 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-d9895141-a192-435e-8396-64f9bc853b3c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b0b4b3ac851a40a09522345b3e61c75b'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:46:19.322708 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1040/2099] 10.222.0.102 () {58 vars in 1229 bytes} [Mon Aug 1 15:46:18 2022] DELETE /identity/v3/users/b0b4b3ac851a40a09522345b3e61c75b => generated 0 bytes in 518 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:46:19.327542 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22502306-1487-40a5-854f-c808fc9e2031 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:46:19.328016 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22502306-1487-40a5-854f-c808fc9e2031 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:46:19.328123 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22502306-1487-40a5-854f-c808fc9e2031 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:46:19.348990 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-22502306-1487-40a5-854f-c808fc9e2031 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:46:19.350369 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-22502306-1487-40a5-854f-c808fc9e2031 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:46:19.420073 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1060/2100] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:46:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:46:19.429781 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9895141-a192-435e-8396-64f9bc853b3c admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:46:19.431365 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-d9895141-a192-435e-8396-64f9bc853b3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:46:19.499098 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9895141-a192-435e-8396-64f9bc853b3c admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:46:19.503770 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3208cb5-5f4c-409c-b395-546b8c135bf0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a856a413100443939fe9b10daa868518', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:46:19.504555 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3208cb5-5f4c-409c-b395-546b8c135bf0 service neutron] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:46:19.505009 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3208cb5-5f4c-409c-b395-546b8c135bf0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:46:19.511074 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3208cb5-5f4c-409c-b395-546b8c135bf0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:46:19.518814 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3208cb5-5f4c-409c-b395-546b8c135bf0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:46:19.520417 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3208cb5-5f4c-409c-b395-546b8c135bf0 service neutron] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:46:19.528369 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:46:19.538997 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1041/2101] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:46:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:46:19.842089 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:46:20.203302 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba0d0eb-2fb8-450b-b614-993283b549a2 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:46:20.203583 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba0d0eb-2fb8-450b-b614-993283b549a2 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:46:20.203844 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba0d0eb-2fb8-450b-b614-993283b549a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:46:20.239738 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-8ba0d0eb-2fb8-450b-b614-993283b549a2 None None] MFA Rules not processed for user `5a0bf81bcf784878acabeb03ccddcd1b`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:46:20.241514 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-8ba0d0eb-2fb8-450b-b614-993283b549a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:46:20.346750 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1061/2102] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:46:20 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:46:20.361640 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3208cb5-5f4c-409c-b395-546b8c135bf0 service neutron] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:46:20.363098 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-a3208cb5-5f4c-409c-b395-546b8c135bf0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:46:20.471977 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba0d0eb-2fb8-450b-b614-993283b549a2 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:46:20.473571 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-8ba0d0eb-2fb8-450b-b614-993283b549a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:46:20.475745 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3208cb5-5f4c-409c-b395-546b8c135bf0 service neutron] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:46:20.492657 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c2d9cb-41c2-439b-998e-b57a6661838d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77b43f1ee8cc4be3907a494abe90c1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:46:20.493471 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c2d9cb-41c2-439b-998e-b57a6661838d service nova] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:46:20.493870 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c2d9cb-41c2-439b-998e-b57a6661838d service nova] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:46:20.493870 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c2d9cb-41c2-439b-998e-b57a6661838d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:46:20.497524 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba0d0eb-2fb8-450b-b614-993283b549a2 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:46:20.505542 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c2d9cb-41c2-439b-998e-b57a6661838d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:46:20.507496 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c2d9cb-41c2-439b-998e-b57a6661838d service nova] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:46:20.507612 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab20c9b-29d6-4ea1-ac2b-947fcb5f4536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:46:20.508200 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab20c9b-29d6-4ea1-ac2b-947fcb5f4536 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:46:20.508484 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab20c9b-29d6-4ea1-ac2b-947fcb5f4536 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:46:20.508958 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab20c9b-29d6-4ea1-ac2b-947fcb5f4536 admin admin] PATH_INFO: `/v3/projects/bc7c9ab0d0124169a85856b9bfdf6f31` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:46:20.510416 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab20c9b-29d6-4ea1-ac2b-947fcb5f4536 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc7c9ab0d0124169a85856b9bfdf6f31)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:46:20.512517 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab20c9b-29d6-4ea1-ac2b-947fcb5f4536 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:46:20.520452 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1042/2103] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:46:20 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:46:20.721518 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-3ab20c9b-29d6-4ea1-ac2b-947fcb5f4536 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc7c9ab0d0124169a85856b9bfdf6f31', 'request_id': 'req-3ab20c9b-29d6-4ea1-ac2b-947fcb5f4536'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:46:20.731641 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-3ab20c9b-29d6-4ea1-ac2b-947fcb5f4536 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc7c9ab0d0124169a85856b9bfdf6f31', 'request_id': 'req-3ab20c9b-29d6-4ea1-ac2b-947fcb5f4536'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:46:20.795096 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c2d9cb-41c2-439b-998e-b57a6661838d service nova] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:46:20.796535 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-56c2d9cb-41c2-439b-998e-b57a6661838d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:46:20.840730 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-3ab20c9b-29d6-4ea1-ac2b-947fcb5f4536 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc7c9ab0d0124169a85856b9bfdf6f31', 'request_id': 'req-3ab20c9b-29d6-4ea1-ac2b-947fcb5f4536'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:46:20.856061 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-3ab20c9b-29d6-4ea1-ac2b-947fcb5f4536 admin admin] The token cache is being invalidate because project bc7c9ab0d0124169a85856b9bfdf6f31 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80352) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 15:46:20.856351 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-3ab20c9b-29d6-4ea1-ac2b-947fcb5f4536 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:46:20.859244 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-3ab20c9b-29d6-4ea1-ac2b-947fcb5f4536 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:46:20.862834 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1062/2104] 10.222.0.102 () {58 vars in 1238 bytes} [Mon Aug 1 15:46:20 2022] DELETE /identity/v3/projects/bc7c9ab0d0124169a85856b9bfdf6f31 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 15:46:20.867368 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab20c9b-29d6-4ea1-ac2b-947fcb5f4536 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:46:20.869436 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-3ab20c9b-29d6-4ea1-ac2b-947fcb5f4536 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:46:20.894623 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c2d9cb-41c2-439b-998e-b57a6661838d service nova] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:46:20.951968 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8fb460-6441-4b28-bac4-bb136e0f3041 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff810b37183c4729859c1b05edff1703', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:46:20.953100 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8fb460-6441-4b28-bac4-bb136e0f3041 service cinder] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:46:20.953605 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8fb460-6441-4b28-bac4-bb136e0f3041 service cinder] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:46:20.954079 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8fb460-6441-4b28-bac4-bb136e0f3041 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:46:20.956540 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-6e8fb460-6441-4b28-bac4-bb136e0f3041 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:46:20.968581 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab20c9b-29d6-4ea1-ac2b-947fcb5f4536 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:46:20.975644 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769ed525-80da-49ef-ab64-f59753f949da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:46:20.975941 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769ed525-80da-49ef-ab64-f59753f949da admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:46:20.976228 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769ed525-80da-49ef-ab64-f59753f949da admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:46:20.976505 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769ed525-80da-49ef-ab64-f59753f949da admin admin] PATH_INFO: `/v3/users/7aaac7a379f842d6825901623d7607df` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:46:20.977907 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769ed525-80da-49ef-ab64-f59753f949da admin admin] RBAC: Authorizing `identity:delete_user(user_id=7aaac7a379f842d6825901623d7607df)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:46:20.979862 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769ed525-80da-49ef-ab64-f59753f949da admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:46:21.037366 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8fb460-6441-4b28-bac4-bb136e0f3041 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:46:21.038818 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8fb460-6441-4b28-bac4-bb136e0f3041 service cinder] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:46:21.053817 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1043/2105] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:46:20 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 15:46:21.202003 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-769ed525-80da-49ef-ab64-f59753f949da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7aaac7a379f842d6825901623d7607df'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:46:21.217944 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-769ed525-80da-49ef-ab64-f59753f949da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7aaac7a379f842d6825901623d7607df'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:46:21.229816 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-769ed525-80da-49ef-ab64-f59753f949da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7aaac7a379f842d6825901623d7607df'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:46:21.230389 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-769ed525-80da-49ef-ab64-f59753f949da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7aaac7a379f842d6825901623d7607df'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:46:21.232986 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-769ed525-80da-49ef-ab64-f59753f949da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7aaac7a379f842d6825901623d7607df'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:46:21.289728 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:46:21.326816 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1063/2106] 10.222.0.102 () {58 vars in 1229 bytes} [Mon Aug 1 15:46:20 2022] DELETE /identity/v3/users/7aaac7a379f842d6825901623d7607df => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 15:46:21.528133 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:46:21.876208 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8fb460-6441-4b28-bac4-bb136e0f3041 service cinder] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:46:21.894736 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8fb460-6441-4b28-bac4-bb136e0f3041 service cinder] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:46:21.979512 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93a16e5-c2aa-4435-9696-6a033d1de57f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:46:21.980174 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93a16e5-c2aa-4435-9696-6a033d1de57f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:46:21.980459 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93a16e5-c2aa-4435-9696-6a033d1de57f admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:46:21.980736 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93a16e5-c2aa-4435-9696-6a033d1de57f admin admin] PATH_INFO: `/v3/projects/9ea8ea8bdeee4f049854ddc60a32d41a` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:46:21.982004 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93a16e5-c2aa-4435-9696-6a033d1de57f admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ea8ea8bdeee4f049854ddc60a32d41a)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:46:21.983941 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93a16e5-c2aa-4435-9696-6a033d1de57f admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:46:22.114778 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-a93a16e5-c2aa-4435-9696-6a033d1de57f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ea8ea8bdeee4f049854ddc60a32d41a', 'request_id': 'req-a93a16e5-c2aa-4435-9696-6a033d1de57f'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:46:22.209299 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-a93a16e5-c2aa-4435-9696-6a033d1de57f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ea8ea8bdeee4f049854ddc60a32d41a', 'request_id': 'req-a93a16e5-c2aa-4435-9696-6a033d1de57f'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:46:22.220108 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-a93a16e5-c2aa-4435-9696-6a033d1de57f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ea8ea8bdeee4f049854ddc60a32d41a', 'request_id': 'req-a93a16e5-c2aa-4435-9696-6a033d1de57f'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:46:22.278423 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-a93a16e5-c2aa-4435-9696-6a033d1de57f admin admin] The token cache is being invalidate because project 9ea8ea8bdeee4f049854ddc60a32d41a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80353) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 15:46:22.278423 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-a93a16e5-c2aa-4435-9696-6a033d1de57f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:46:22.278423 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-a93a16e5-c2aa-4435-9696-6a033d1de57f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:46:22.278423 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1044/2107] 10.222.0.102 () {58 vars in 1238 bytes} [Mon Aug 1 15:46:21 2022] DELETE /identity/v3/projects/9ea8ea8bdeee4f049854ddc60a32d41a => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:46:22.283677 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916e7838-ba1d-4ded-b225-a4f0e39bc874 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:46:22.284167 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916e7838-ba1d-4ded-b225-a4f0e39bc874 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:46:22.284385 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916e7838-ba1d-4ded-b225-a4f0e39bc874 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:46:22.313302 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-916e7838-ba1d-4ded-b225-a4f0e39bc874 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:46:22.313302 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-916e7838-ba1d-4ded-b225-a4f0e39bc874 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:46:22.406947 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1064/2108] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:46:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:46:22.407137 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc567448-1587-49b0-b80a-f5b879fbf13a None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:46:22.407137 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc567448-1587-49b0-b80a-f5b879fbf13a None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:46:22.407137 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc567448-1587-49b0-b80a-f5b879fbf13a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:46:22.427703 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-cc567448-1587-49b0-b80a-f5b879fbf13a None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:46:22.429055 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-cc567448-1587-49b0-b80a-f5b879fbf13a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:46:22.443131 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1045/2109] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:46:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:46:22.449005 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916e7838-ba1d-4ded-b225-a4f0e39bc874 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:46:22.462299 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916e7838-ba1d-4ded-b225-a4f0e39bc874 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:46:22.467771 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d1368a-d01b-4f42-9570-13148c73c73b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:46:22.468371 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d1368a-d01b-4f42-9570-13148c73c73b admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:46:22.468661 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d1368a-d01b-4f42-9570-13148c73c73b admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:46:22.468940 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d1368a-d01b-4f42-9570-13148c73c73b admin admin] PATH_INFO: `/v3/domains` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:46:22.469703 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d1368a-d01b-4f42-9570-13148c73c73b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:46:22.470019 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d1368a-d01b-4f42-9570-13148c73c73b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:46:22.472624 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d1368a-d01b-4f42-9570-13148c73c73b admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:46:22.485634 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1065/2110] 10.222.0.102 () {58 vars in 1158 bytes} [Mon Aug 1 15:46:22 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:46:22.490362 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc567448-1587-49b0-b80a-f5b879fbf13a None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:46:22.502354 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc567448-1587-49b0-b80a-f5b879fbf13a None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:46:22.507946 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a31dfe-dc64-4172-8952-d71d9d5f5008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:46:22.508600 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a31dfe-dc64-4172-8952-d71d9d5f5008 admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:46:22.508911 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a31dfe-dc64-4172-8952-d71d9d5f5008 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:46:22.509591 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a31dfe-dc64-4172-8952-d71d9d5f5008 admin admin] PATH_INFO: `/v3/projects` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:46:22.509842 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a31dfe-dc64-4172-8952-d71d9d5f5008 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:46:22.511990 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a31dfe-dc64-4172-8952-d71d9d5f5008 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:46:22.624705 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1046/2111] 10.222.0.102 () {60 vars in 1158 bytes} [Mon Aug 1 15:46:22 2022] POST /identity/v3/projects => generated 374 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:46:22.631079 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d1368a-d01b-4f42-9570-13148c73c73b admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:46:22.650483 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d1368a-d01b-4f42-9570-13148c73c73b admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:46:22.759856 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3459df96-04ac-4af6-a739-a8519d2885ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:46:22.761135 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3459df96-04ac-4af6-a739-a8519d2885ac admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:46:22.761751 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3459df96-04ac-4af6-a739-a8519d2885ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:46:22.762241 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3459df96-04ac-4af6-a739-a8519d2885ac admin admin] PATH_INFO: `/v3/users` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:46:22.763475 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3459df96-04ac-4af6-a739-a8519d2885ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:46:22.767328 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3459df96-04ac-4af6-a739-a8519d2885ac admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:46:22.979447 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1066/2112] 10.222.0.102 () {60 vars in 1149 bytes} [Mon Aug 1 15:46:22 2022] POST /identity/v3/users => generated 288 bytes in 346 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:46:22.980609 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a31dfe-dc64-4172-8952-d71d9d5f5008 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:46:22.991070 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a31dfe-dc64-4172-8952-d71d9d5f5008 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:46:22.995713 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a05a58-a45f-4179-b113-ba68596c086b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:46:22.996349 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a05a58-a45f-4179-b113-ba68596c086b admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:46:22.996612 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a05a58-a45f-4179-b113-ba68596c086b admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:46:22.996919 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a05a58-a45f-4179-b113-ba68596c086b admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:46:22.997627 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a05a58-a45f-4179-b113-ba68596c086b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:46:22.999224 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a05a58-a45f-4179-b113-ba68596c086b admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:46:23.011179 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1047/2113] 10.222.0.102 () {58 vars in 1127 bytes} [Mon Aug 1 15:46:22 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:46:23.019625 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3459df96-04ac-4af6-a739-a8519d2885ac admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:46:23.038688 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3459df96-04ac-4af6-a739-a8519d2885ac admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:46:23.046330 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744a4640-1c48-464e-92cb-c36412bcb53b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:46:23.047862 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744a4640-1c48-464e-92cb-c36412bcb53b admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:46:23.047862 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744a4640-1c48-464e-92cb-c36412bcb53b admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:46:23.048143 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744a4640-1c48-464e-92cb-c36412bcb53b admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:46:23.049018 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744a4640-1c48-464e-92cb-c36412bcb53b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:46:23.051132 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744a4640-1c48-464e-92cb-c36412bcb53b admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:46:23.068172 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1067/2114] 10.222.0.102 () {58 vars in 1127 bytes} [Mon Aug 1 15:46:23 2022] GET /identity/v3/roles => generated 1427 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:46:23.072881 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a05a58-a45f-4179-b113-ba68596c086b admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:46:23.085104 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a05a58-a45f-4179-b113-ba68596c086b admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:46:23.102968 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba18efbc-772a-4a25-a584-7db440312138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:46:23.103752 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba18efbc-772a-4a25-a584-7db440312138 admin admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:46:23.104905 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba18efbc-772a-4a25-a584-7db440312138 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:46:23.105513 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba18efbc-772a-4a25-a584-7db440312138 admin admin] PATH_INFO: `/v3/projects/980076d5f1e3404db6fff44c9261e007/users/861dc4a1a9ba4d2f8ca190bbcf81f188/roles/27f5093ac0674d799cdbd17c68482e32` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:46:23.127352 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba18efbc-772a-4a25-a584-7db440312138 admin admin] RBAC: Authorizing `identity:create_grant(project_id=980076d5f1e3404db6fff44c9261e007, user_id=861dc4a1a9ba4d2f8ca190bbcf81f188, role_id=27f5093ac0674d799cdbd17c68482e32)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:46:23.130234 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba18efbc-772a-4a25-a584-7db440312138 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:46:23.252410 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1048/2115] 10.222.0.102 () {60 vars in 1488 bytes} [Mon Aug 1 15:46:23 2022] PUT /identity/v3/projects/980076d5f1e3404db6fff44c9261e007/users/861dc4a1a9ba4d2f8ca190bbcf81f188/roles/27f5093ac0674d799cdbd17c68482e32 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:46:23.264465 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d1c1a9-b663-4a33-a791-3ede6dbfee84 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:46:23.264748 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d1c1a9-b663-4a33-a791-3ede6dbfee84 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:46:23.265053 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d1c1a9-b663-4a33-a791-3ede6dbfee84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:46:23.304047 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-88d1c1a9-b663-4a33-a791-3ede6dbfee84 None None] MFA Rules not processed for user `861dc4a1a9ba4d2f8ca190bbcf81f188`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:46:23.305991 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-88d1c1a9-b663-4a33-a791-3ede6dbfee84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:46:23.401090 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1068/2116] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:46:23 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:46:23.412722 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba18efbc-772a-4a25-a584-7db440312138 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:46:23.414459 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-ba18efbc-772a-4a25-a584-7db440312138 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:46:23.485803 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba18efbc-772a-4a25-a584-7db440312138 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:46:23.490218 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baa385a-4a21-48f8-a4ca-e7bcd05c349c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff810b37183c4729859c1b05edff1703', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:46:23.491048 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baa385a-4a21-48f8-a4ca-e7bcd05c349c service cinder] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:46:23.491809 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baa385a-4a21-48f8-a4ca-e7bcd05c349c service cinder] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:46:23.492185 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baa385a-4a21-48f8-a4ca-e7bcd05c349c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:46:23.507867 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6baa385a-4a21-48f8-a4ca-e7bcd05c349c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:46:23.509631 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6baa385a-4a21-48f8-a4ca-e7bcd05c349c service cinder] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:46:23.523559 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1049/2117] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:46:23 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:46:23.701746 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c63d334-c5ca-4a81-b6dd-a9abb69ba84f None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:46:23.702431 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c63d334-c5ca-4a81-b6dd-a9abb69ba84f None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:46:23.702948 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c63d334-c5ca-4a81-b6dd-a9abb69ba84f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:46:23.727829 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-8c63d334-c5ca-4a81-b6dd-a9abb69ba84f None None] MFA Rules not processed for user `5a0bf81bcf784878acabeb03ccddcd1b`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:46:23.729111 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-8c63d334-c5ca-4a81-b6dd-a9abb69ba84f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:46:23.791920 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1069/2118] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:46:23 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:46:24.089395 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:46:24.651179 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:46:26.398288 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:46:26.873168 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:46:27.525595 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baa385a-4a21-48f8-a4ca-e7bcd05c349c service cinder] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:46:27.527064 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-6baa385a-4a21-48f8-a4ca-e7bcd05c349c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:46:27.622668 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baa385a-4a21-48f8-a4ca-e7bcd05c349c service cinder] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:46:27.627959 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a61158-5582-4823-8982-cf7d3689e6d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:46:27.628748 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a61158-5582-4823-8982-cf7d3689e6d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:46:27.629336 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a61158-5582-4823-8982-cf7d3689e6d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:46:27.629336 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a61158-5582-4823-8982-cf7d3689e6d3 admin admin] PATH_INFO: `/v3/users/d9d38ef9c284451991588e483bc1439e` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:46:27.630503 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a61158-5582-4823-8982-cf7d3689e6d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9d38ef9c284451991588e483bc1439e)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:46:27.632451 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a61158-5582-4823-8982-cf7d3689e6d3 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:46:27.868002 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-b9a61158-5582-4823-8982-cf7d3689e6d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9d38ef9c284451991588e483bc1439e'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:46:27.990223 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-b9a61158-5582-4823-8982-cf7d3689e6d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9d38ef9c284451991588e483bc1439e'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:46:28.003081 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-b9a61158-5582-4823-8982-cf7d3689e6d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9d38ef9c284451991588e483bc1439e'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:46:28.004568 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-b9a61158-5582-4823-8982-cf7d3689e6d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9d38ef9c284451991588e483bc1439e'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:46:28.004568 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-b9a61158-5582-4823-8982-cf7d3689e6d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9d38ef9c284451991588e483bc1439e'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:46:28.016407 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1050/2119] 10.222.0.102 () {58 vars in 1229 bytes} [Mon Aug 1 15:46:27 2022] DELETE /identity/v3/users/d9d38ef9c284451991588e483bc1439e => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:46:28.021567 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d685911e-6007-48cc-a642-c865d6a5567a None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:46:28.022023 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d685911e-6007-48cc-a642-c865d6a5567a None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:46:28.022112 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d685911e-6007-48cc-a642-c865d6a5567a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:46:28.042360 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-d685911e-6007-48cc-a642-c865d6a5567a None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:46:28.043702 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-d685911e-6007-48cc-a642-c865d6a5567a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:46:28.113562 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1070/2120] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:46:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:46:28.127909 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a61158-5582-4823-8982-cf7d3689e6d3 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:46:28.129564 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-b9a61158-5582-4823-8982-cf7d3689e6d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:46:28.194775 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a61158-5582-4823-8982-cf7d3689e6d3 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:46:28.198710 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5167b329-f30c-42cf-b99c-ee3e8545c7dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a856a413100443939fe9b10daa868518', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:46:28.199337 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5167b329-f30c-42cf-b99c-ee3e8545c7dc service neutron] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:46:28.199796 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5167b329-f30c-42cf-b99c-ee3e8545c7dc service neutron] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:46:28.200078 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5167b329-f30c-42cf-b99c-ee3e8545c7dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:46:28.210290 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5167b329-f30c-42cf-b99c-ee3e8545c7dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:46:28.211925 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5167b329-f30c-42cf-b99c-ee3e8545c7dc service neutron] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:46:28.222611 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1051/2121] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:46:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:46:29.003822 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d685911e-6007-48cc-a642-c865d6a5567a None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:46:29.003822 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-d685911e-6007-48cc-a642-c865d6a5567a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:46:29.014132 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d685911e-6007-48cc-a642-c865d6a5567a None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:46:29.020244 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91860723-eeb8-4421-83ad-13fee19bfe0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:46:29.021019 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91860723-eeb8-4421-83ad-13fee19bfe0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:46:29.021370 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91860723-eeb8-4421-83ad-13fee19bfe0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:46:29.021775 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91860723-eeb8-4421-83ad-13fee19bfe0a admin admin] PATH_INFO: `/v3/projects/c8fd9fd2a82b40deb6ba0cf82a88fc95` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:46:29.022989 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91860723-eeb8-4421-83ad-13fee19bfe0a admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8fd9fd2a82b40deb6ba0cf82a88fc95)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:46:29.025501 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91860723-eeb8-4421-83ad-13fee19bfe0a admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:46:29.209145 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-91860723-eeb8-4421-83ad-13fee19bfe0a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8fd9fd2a82b40deb6ba0cf82a88fc95', 'request_id': 'req-91860723-eeb8-4421-83ad-13fee19bfe0a'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:46:29.217169 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-91860723-eeb8-4421-83ad-13fee19bfe0a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8fd9fd2a82b40deb6ba0cf82a88fc95', 'request_id': 'req-91860723-eeb8-4421-83ad-13fee19bfe0a'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:46:29.328733 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-91860723-eeb8-4421-83ad-13fee19bfe0a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8fd9fd2a82b40deb6ba0cf82a88fc95', 'request_id': 'req-91860723-eeb8-4421-83ad-13fee19bfe0a'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:46:29.342924 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-91860723-eeb8-4421-83ad-13fee19bfe0a admin admin] The token cache is being invalidate because project c8fd9fd2a82b40deb6ba0cf82a88fc95 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80352) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 15:46:29.343687 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-91860723-eeb8-4421-83ad-13fee19bfe0a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:46:29.344621 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-91860723-eeb8-4421-83ad-13fee19bfe0a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:46:29.346722 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1071/2122] 10.222.0.102 () {58 vars in 1238 bytes} [Mon Aug 1 15:46:28 2022] DELETE /identity/v3/projects/c8fd9fd2a82b40deb6ba0cf82a88fc95 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:46:29.359587 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cc1578-2f66-4d13-8d89-68347bc9dbfd None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:46:29.360019 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cc1578-2f66-4d13-8d89-68347bc9dbfd None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:46:29.360124 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cc1578-2f66-4d13-8d89-68347bc9dbfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:46:29.390152 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-b0cc1578-2f66-4d13-8d89-68347bc9dbfd None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:46:29.391581 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-b0cc1578-2f66-4d13-8d89-68347bc9dbfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:46:29.562312 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1052/2123] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:46:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:46:29.570933 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b99092-d99f-4c52-8110-9cee540fe892 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:46:29.571238 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b99092-d99f-4c52-8110-9cee540fe892 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:46:29.571514 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b99092-d99f-4c52-8110-9cee540fe892 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:46:29.599007 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-a9b99092-d99f-4c52-8110-9cee540fe892 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:46:29.606604 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-a9b99092-d99f-4c52-8110-9cee540fe892 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:46:29.608794 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1072/2124] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:46:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:46:29.613477 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cc1578-2f66-4d13-8d89-68347bc9dbfd None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:46:29.624584 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cc1578-2f66-4d13-8d89-68347bc9dbfd None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:46:29.632070 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b03635-3bc8-4f28-9e5b-16d688ce6d58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:46:29.634088 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b03635-3bc8-4f28-9e5b-16d688ce6d58 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:46:29.634088 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b03635-3bc8-4f28-9e5b-16d688ce6d58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:46:29.634088 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b03635-3bc8-4f28-9e5b-16d688ce6d58 admin admin] PATH_INFO: `/v3/domains` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:46:29.634088 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b03635-3bc8-4f28-9e5b-16d688ce6d58 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:46:29.634594 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b03635-3bc8-4f28-9e5b-16d688ce6d58 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:46:29.635930 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b03635-3bc8-4f28-9e5b-16d688ce6d58 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:46:29.649620 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1053/2125] 10.222.0.102 () {58 vars in 1158 bytes} [Mon Aug 1 15:46:29 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:46:29.659620 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b99092-d99f-4c52-8110-9cee540fe892 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:46:29.675864 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b99092-d99f-4c52-8110-9cee540fe892 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:46:29.700480 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a7066c-e966-4d6d-b6b1-0471929145e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:46:29.701340 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a7066c-e966-4d6d-b6b1-0471929145e2 admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:46:29.701948 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a7066c-e966-4d6d-b6b1-0471929145e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:46:29.702256 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a7066c-e966-4d6d-b6b1-0471929145e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:46:29.702985 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a7066c-e966-4d6d-b6b1-0471929145e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:46:29.705614 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a7066c-e966-4d6d-b6b1-0471929145e2 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:46:29.845272 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:46:29.855751 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1073/2126] 10.222.0.102 () {60 vars in 1158 bytes} [Mon Aug 1 15:46:29 2022] POST /identity/v3/projects => generated 372 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 15:46:29.860036 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b03635-3bc8-4f28-9e5b-16d688ce6d58 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:46:29.873241 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b03635-3bc8-4f28-9e5b-16d688ce6d58 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:46:29.973762 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f81918-1682-40da-a39d-7c8d401c8378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:46:29.974598 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f81918-1682-40da-a39d-7c8d401c8378 admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:46:29.974955 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f81918-1682-40da-a39d-7c8d401c8378 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:46:29.975193 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f81918-1682-40da-a39d-7c8d401c8378 admin admin] PATH_INFO: `/v3/users` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:46:29.975870 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f81918-1682-40da-a39d-7c8d401c8378 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:46:29.978309 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f81918-1682-40da-a39d-7c8d401c8378 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:46:30.192246 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1054/2127] 10.222.0.102 () {60 vars in 1149 bytes} [Mon Aug 1 15:46:29 2022] POST /identity/v3/users => generated 287 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:46:30.203921 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a7066c-e966-4d6d-b6b1-0471929145e2 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:46:30.214191 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a7066c-e966-4d6d-b6b1-0471929145e2 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:46:30.218834 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a1c7d3-c5d7-4735-8869-f9c8b33f19f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:46:30.219390 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a1c7d3-c5d7-4735-8869-f9c8b33f19f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:46:30.219668 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a1c7d3-c5d7-4735-8869-f9c8b33f19f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:46:30.219941 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a1c7d3-c5d7-4735-8869-f9c8b33f19f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:46:30.220632 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a1c7d3-c5d7-4735-8869-f9c8b33f19f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:46:30.222807 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a1c7d3-c5d7-4735-8869-f9c8b33f19f9 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:46:30.233575 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1074/2128] 10.222.0.102 () {58 vars in 1127 bytes} [Mon Aug 1 15:46:30 2022] GET /identity/v3/roles => generated 1427 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:46:30.238075 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f81918-1682-40da-a39d-7c8d401c8378 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:46:30.248794 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f81918-1682-40da-a39d-7c8d401c8378 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:46:30.253635 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3112f2b-e319-4ba7-af0e-df1eac528d5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:46:30.254266 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3112f2b-e319-4ba7-af0e-df1eac528d5f admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:46:30.254550 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3112f2b-e319-4ba7-af0e-df1eac528d5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:46:30.254825 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3112f2b-e319-4ba7-af0e-df1eac528d5f admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:46:30.255527 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3112f2b-e319-4ba7-af0e-df1eac528d5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:46:30.267010 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3112f2b-e319-4ba7-af0e-df1eac528d5f admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:46:30.270107 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1055/2129] 10.222.0.102 () {58 vars in 1127 bytes} [Mon Aug 1 15:46:30 2022] GET /identity/v3/roles => generated 1427 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 15:46:30.273168 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a1c7d3-c5d7-4735-8869-f9c8b33f19f9 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:46:30.290392 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a1c7d3-c5d7-4735-8869-f9c8b33f19f9 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:46:30.298696 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a63d304-31fd-4aea-84c6-91b34160bab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:46:30.300539 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a63d304-31fd-4aea-84c6-91b34160bab7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:46:30.300820 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a63d304-31fd-4aea-84c6-91b34160bab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:46:30.301127 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a63d304-31fd-4aea-84c6-91b34160bab7 admin admin] PATH_INFO: `/v3/projects/050c29a5d4c74e06bdf32712237f1d40/users/b92c6cfdfe2342c1b75f1af7e649f841/roles/27f5093ac0674d799cdbd17c68482e32` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:46:30.318433 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a63d304-31fd-4aea-84c6-91b34160bab7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=050c29a5d4c74e06bdf32712237f1d40, user_id=b92c6cfdfe2342c1b75f1af7e649f841, role_id=27f5093ac0674d799cdbd17c68482e32)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:46:30.321278 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a63d304-31fd-4aea-84c6-91b34160bab7 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:46:30.392084 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:46:30.434090 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1075/2130] 10.222.0.102 () {60 vars in 1488 bytes} [Mon Aug 1 15:46:30 2022] PUT /identity/v3/projects/050c29a5d4c74e06bdf32712237f1d40/users/b92c6cfdfe2342c1b75f1af7e649f841/roles/27f5093ac0674d799cdbd17c68482e32 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:46:30.446022 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4c88be-0e6c-42ca-a710-b2244b8faaa1 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:46:30.446473 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4c88be-0e6c-42ca-a710-b2244b8faaa1 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:46:30.446661 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4c88be-0e6c-42ca-a710-b2244b8faaa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:46:30.479348 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-4d4c88be-0e6c-42ca-a710-b2244b8faaa1 None None] MFA Rules not processed for user `b92c6cfdfe2342c1b75f1af7e649f841`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:46:30.483027 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-4d4c88be-0e6c-42ca-a710-b2244b8faaa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:46:30.570557 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1056/2131] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:46:30 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 15:46:30.582563 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a63d304-31fd-4aea-84c6-91b34160bab7 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:46:30.585611 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-3a63d304-31fd-4aea-84c6-91b34160bab7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:46:30.666567 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a63d304-31fd-4aea-84c6-91b34160bab7 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:46:30.671039 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00efb15-cfda-4132-a6b4-53c4bfe75f98 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff810b37183c4729859c1b05edff1703', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:46:30.671694 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00efb15-cfda-4132-a6b4-53c4bfe75f98 service cinder] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:46:30.671976 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00efb15-cfda-4132-a6b4-53c4bfe75f98 service cinder] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:46:30.672250 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00efb15-cfda-4132-a6b4-53c4bfe75f98 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:46:30.682323 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00efb15-cfda-4132-a6b4-53c4bfe75f98 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:46:30.683766 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00efb15-cfda-4132-a6b4-53c4bfe75f98 service cinder] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:46:30.694646 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1076/2132] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:46:30 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:46:30.723477 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4c88be-0e6c-42ca-a710-b2244b8faaa1 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:46:30.803011 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4c88be-0e6c-42ca-a710-b2244b8faaa1 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:46:30.809505 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3483c147-445b-4d19-874a-405dd1d8291e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:46:30.810169 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3483c147-445b-4d19-874a-405dd1d8291e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:46:30.810668 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3483c147-445b-4d19-874a-405dd1d8291e admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:46:30.810954 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3483c147-445b-4d19-874a-405dd1d8291e admin admin] PATH_INFO: `/v3/users/b92c6cfdfe2342c1b75f1af7e649f841` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:46:30.812438 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3483c147-445b-4d19-874a-405dd1d8291e admin admin] RBAC: Authorizing `identity:delete_user(user_id=b92c6cfdfe2342c1b75f1af7e649f841)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:46:30.814713 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3483c147-445b-4d19-874a-405dd1d8291e admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:46:31.097299 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-3483c147-445b-4d19-874a-405dd1d8291e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b92c6cfdfe2342c1b75f1af7e649f841'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:46:31.190974 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-3483c147-445b-4d19-874a-405dd1d8291e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b92c6cfdfe2342c1b75f1af7e649f841'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:46:31.209993 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-3483c147-445b-4d19-874a-405dd1d8291e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b92c6cfdfe2342c1b75f1af7e649f841'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:46:31.210355 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-3483c147-445b-4d19-874a-405dd1d8291e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b92c6cfdfe2342c1b75f1af7e649f841'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:46:31.212720 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-3483c147-445b-4d19-874a-405dd1d8291e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b92c6cfdfe2342c1b75f1af7e649f841'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:46:31.237902 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1057/2133] 10.222.0.102 () {58 vars in 1229 bytes} [Mon Aug 1 15:46:30 2022] DELETE /identity/v3/users/b92c6cfdfe2342c1b75f1af7e649f841 => generated 0 bytes in 516 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:46:31.242588 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3858a9-3977-429b-9b93-a37aee116828 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:46:31.243400 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3858a9-3977-429b-9b93-a37aee116828 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:46:31.243683 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3858a9-3977-429b-9b93-a37aee116828 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:46:31.265696 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-cd3858a9-3977-429b-9b93-a37aee116828 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:46:31.266916 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-cd3858a9-3977-429b-9b93-a37aee116828 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:46:31.331927 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1077/2134] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:46:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 15:46:31.343329 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3483c147-445b-4d19-874a-405dd1d8291e admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:46:31.345082 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-3483c147-445b-4d19-874a-405dd1d8291e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:46:31.403567 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3483c147-445b-4d19-874a-405dd1d8291e admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:46:31.407360 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cd6f1d-1af1-4356-adc7-d72cf0805aaf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a856a413100443939fe9b10daa868518', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:46:31.407979 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cd6f1d-1af1-4356-adc7-d72cf0805aaf service neutron] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:46:31.408257 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cd6f1d-1af1-4356-adc7-d72cf0805aaf service neutron] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:46:31.408606 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cd6f1d-1af1-4356-adc7-d72cf0805aaf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:46:31.418423 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cd6f1d-1af1-4356-adc7-d72cf0805aaf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:46:31.419942 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cd6f1d-1af1-4356-adc7-d72cf0805aaf service neutron] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:46:31.429774 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1058/2135] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:46:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:46:31.887031 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3858a9-3977-429b-9b93-a37aee116828 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:46:31.894141 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-cd3858a9-3977-429b-9b93-a37aee116828 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:46:31.949894 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3858a9-3977-429b-9b93-a37aee116828 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:46:31.959179 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb8e1de-350d-4e46-85b5-b3b21733453e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:46:31.960260 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb8e1de-350d-4e46-85b5-b3b21733453e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:46:31.960818 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb8e1de-350d-4e46-85b5-b3b21733453e admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:46:31.961414 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb8e1de-350d-4e46-85b5-b3b21733453e admin admin] PATH_INFO: `/v3/projects/050c29a5d4c74e06bdf32712237f1d40` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:46:31.963685 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb8e1de-350d-4e46-85b5-b3b21733453e admin admin] RBAC: Authorizing `identity:delete_project(project_id=050c29a5d4c74e06bdf32712237f1d40)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:46:31.967745 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb8e1de-350d-4e46-85b5-b3b21733453e admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:46:32.115979 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-0cb8e1de-350d-4e46-85b5-b3b21733453e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '050c29a5d4c74e06bdf32712237f1d40', 'request_id': 'req-0cb8e1de-350d-4e46-85b5-b3b21733453e'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:46:32.123183 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-0cb8e1de-350d-4e46-85b5-b3b21733453e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '050c29a5d4c74e06bdf32712237f1d40', 'request_id': 'req-0cb8e1de-350d-4e46-85b5-b3b21733453e'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:46:32.226132 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-0cb8e1de-350d-4e46-85b5-b3b21733453e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '050c29a5d4c74e06bdf32712237f1d40', 'request_id': 'req-0cb8e1de-350d-4e46-85b5-b3b21733453e'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:46:32.237627 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-0cb8e1de-350d-4e46-85b5-b3b21733453e admin admin] The token cache is being invalidate because project 050c29a5d4c74e06bdf32712237f1d40 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80352) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 15:46:32.237911 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-0cb8e1de-350d-4e46-85b5-b3b21733453e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:46:32.238543 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-0cb8e1de-350d-4e46-85b5-b3b21733453e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:46:32.240175 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1078/2136] 10.222.0.102 () {58 vars in 1238 bytes} [Mon Aug 1 15:46:31 2022] DELETE /identity/v3/projects/050c29a5d4c74e06bdf32712237f1d40 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:46:32.648194 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:46:32.883690 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:46:33.521123 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:46:33.689425 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:46:34.186964 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:46:34.655371 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:46:35.819272 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:46:36.097101 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:46:38.019556 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:46:38.409692 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:46:38.793588 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cd6f1d-1af1-4356-adc7-d72cf0805aaf service neutron] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:46:38.795024 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-66cd6f1d-1af1-4356-adc7-d72cf0805aaf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:46:38.810259 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cd6f1d-1af1-4356-adc7-d72cf0805aaf service neutron] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:46:38.875169 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22533d3c-54bc-4734-b35b-5e19f0368d05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:46:38.875794 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22533d3c-54bc-4734-b35b-5e19f0368d05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:46:38.876191 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22533d3c-54bc-4734-b35b-5e19f0368d05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:46:38.876441 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22533d3c-54bc-4734-b35b-5e19f0368d05 admin admin] PATH_INFO: `/v3/users/69079c4cf9f74cde986147848f080322` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:46:38.877771 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22533d3c-54bc-4734-b35b-5e19f0368d05 admin admin] RBAC: Authorizing `identity:delete_user(user_id=69079c4cf9f74cde986147848f080322)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:46:38.879801 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22533d3c-54bc-4734-b35b-5e19f0368d05 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:46:39.107849 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-22533d3c-54bc-4734-b35b-5e19f0368d05 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '69079c4cf9f74cde986147848f080322'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:46:39.220080 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-22533d3c-54bc-4734-b35b-5e19f0368d05 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '69079c4cf9f74cde986147848f080322'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:46:39.232643 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-22533d3c-54bc-4734-b35b-5e19f0368d05 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '69079c4cf9f74cde986147848f080322'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:46:39.233331 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-22533d3c-54bc-4734-b35b-5e19f0368d05 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '69079c4cf9f74cde986147848f080322'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:46:39.233940 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-22533d3c-54bc-4734-b35b-5e19f0368d05 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '69079c4cf9f74cde986147848f080322'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:46:39.246349 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1059/2137] 10.222.0.102 () {58 vars in 1229 bytes} [Mon Aug 1 15:46:38 2022] DELETE /identity/v3/users/69079c4cf9f74cde986147848f080322 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:46:39.289248 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb8e1de-350d-4e46-85b5-b3b21733453e admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:46:39.291282 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-0cb8e1de-350d-4e46-85b5-b3b21733453e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:46:39.305554 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb8e1de-350d-4e46-85b5-b3b21733453e admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:46:39.365595 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dae43e5-585b-42cc-9014-fdb3f0903cb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:46:39.366274 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dae43e5-585b-42cc-9014-fdb3f0903cb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:46:39.367083 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dae43e5-585b-42cc-9014-fdb3f0903cb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:46:39.367369 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dae43e5-585b-42cc-9014-fdb3f0903cb9 admin admin] PATH_INFO: `/v3/users/861dc4a1a9ba4d2f8ca190bbcf81f188` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:46:39.368565 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dae43e5-585b-42cc-9014-fdb3f0903cb9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=861dc4a1a9ba4d2f8ca190bbcf81f188)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:46:39.370569 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dae43e5-585b-42cc-9014-fdb3f0903cb9 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:46:39.534708 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22533d3c-54bc-4734-b35b-5e19f0368d05 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:46:39.536630 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-22533d3c-54bc-4734-b35b-5e19f0368d05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:46:39.549364 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22533d3c-54bc-4734-b35b-5e19f0368d05 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:46:39.556754 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea739b8-cb5c-45fb-87aa-b8e42a1e52d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:46:39.564130 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea739b8-cb5c-45fb-87aa-b8e42a1e52d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:46:39.564130 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea739b8-cb5c-45fb-87aa-b8e42a1e52d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:46:39.564130 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea739b8-cb5c-45fb-87aa-b8e42a1e52d0 admin admin] PATH_INFO: `/v3/projects/080ed86efe41426eb9d8764223a3dea1` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:46:39.564130 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea739b8-cb5c-45fb-87aa-b8e42a1e52d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=080ed86efe41426eb9d8764223a3dea1)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:46:39.564130 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea739b8-cb5c-45fb-87aa-b8e42a1e52d0 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:46:39.650611 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-6dae43e5-585b-42cc-9014-fdb3f0903cb9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '861dc4a1a9ba4d2f8ca190bbcf81f188'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:46:39.665121 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-6dae43e5-585b-42cc-9014-fdb3f0903cb9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '861dc4a1a9ba4d2f8ca190bbcf81f188'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:46:39.673574 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-6dae43e5-585b-42cc-9014-fdb3f0903cb9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '861dc4a1a9ba4d2f8ca190bbcf81f188'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:46:39.673574 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-6dae43e5-585b-42cc-9014-fdb3f0903cb9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '861dc4a1a9ba4d2f8ca190bbcf81f188'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:46:39.673897 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-6dae43e5-585b-42cc-9014-fdb3f0903cb9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '861dc4a1a9ba4d2f8ca190bbcf81f188'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:46:39.761729 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-8ea739b8-cb5c-45fb-87aa-b8e42a1e52d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '080ed86efe41426eb9d8764223a3dea1', 'request_id': 'req-8ea739b8-cb5c-45fb-87aa-b8e42a1e52d0'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:46:39.774619 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1079/2138] 10.222.0.102 () {58 vars in 1229 bytes} [Mon Aug 1 15:46:39 2022] DELETE /identity/v3/users/861dc4a1a9ba4d2f8ca190bbcf81f188 => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:46:39.776142 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9734fe7-b685-473a-be12-34553d913d7f None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:46:39.776435 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9734fe7-b685-473a-be12-34553d913d7f None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:46:39.776790 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9734fe7-b685-473a-be12-34553d913d7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:46:39.796985 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-b9734fe7-b685-473a-be12-34553d913d7f None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:46:39.805105 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-b9734fe7-b685-473a-be12-34553d913d7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:46:39.860623 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1080/2139] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:46:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 15:46:39.871222 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9734fe7-b685-473a-be12-34553d913d7f None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:46:39.873618 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-b9734fe7-b685-473a-be12-34553d913d7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:46:39.923328 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-8ea739b8-cb5c-45fb-87aa-b8e42a1e52d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '080ed86efe41426eb9d8764223a3dea1', 'request_id': 'req-8ea739b8-cb5c-45fb-87aa-b8e42a1e52d0'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:46:39.931055 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-8ea739b8-cb5c-45fb-87aa-b8e42a1e52d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '080ed86efe41426eb9d8764223a3dea1', 'request_id': 'req-8ea739b8-cb5c-45fb-87aa-b8e42a1e52d0'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:46:39.948625 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9734fe7-b685-473a-be12-34553d913d7f None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:46:39.950293 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-8ea739b8-cb5c-45fb-87aa-b8e42a1e52d0 admin admin] The token cache is being invalidate because project 080ed86efe41426eb9d8764223a3dea1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80353) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 15:46:39.950930 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-8ea739b8-cb5c-45fb-87aa-b8e42a1e52d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:46:39.952352 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-8ea739b8-cb5c-45fb-87aa-b8e42a1e52d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:46:39.954818 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1060/2140] 10.222.0.102 () {58 vars in 1238 bytes} [Mon Aug 1 15:46:39 2022] DELETE /identity/v3/projects/080ed86efe41426eb9d8764223a3dea1 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 15:46:39.955350 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23016f0-9f70-4973-ba99-c32c630d7e42 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a856a413100443939fe9b10daa868518', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:46:39.956186 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23016f0-9f70-4973-ba99-c32c630d7e42 service neutron] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:46:39.956520 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23016f0-9f70-4973-ba99-c32c630d7e42 service neutron] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:46:39.956745 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23016f0-9f70-4973-ba99-c32c630d7e42 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:46:39.959320 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-d23016f0-9f70-4973-ba99-c32c630d7e42 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:46:39.959442 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea739b8-cb5c-45fb-87aa-b8e42a1e52d0 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:46:39.961196 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-8ea739b8-cb5c-45fb-87aa-b8e42a1e52d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:46:39.975249 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23016f0-9f70-4973-ba99-c32c630d7e42 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:46:39.976936 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23016f0-9f70-4973-ba99-c32c630d7e42 service neutron] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:46:39.988432 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1081/2141] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:46:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 15:46:40.036021 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea739b8-cb5c-45fb-87aa-b8e42a1e52d0 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:46:40.040948 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f7799f-c920-4d2a-a3c4-5e1ea3c9ed16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:46:40.041639 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f7799f-c920-4d2a-a3c4-5e1ea3c9ed16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:46:40.041922 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f7799f-c920-4d2a-a3c4-5e1ea3c9ed16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:46:40.042226 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f7799f-c920-4d2a-a3c4-5e1ea3c9ed16 admin admin] PATH_INFO: `/v3/users/219244970f7741138535157810d2117c` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:46:40.043412 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f7799f-c920-4d2a-a3c4-5e1ea3c9ed16 admin admin] RBAC: Authorizing `identity:delete_user(user_id=219244970f7741138535157810d2117c)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:46:40.045405 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f7799f-c920-4d2a-a3c4-5e1ea3c9ed16 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:46:40.156495 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:46:40.268475 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-39f7799f-c920-4d2a-a3c4-5e1ea3c9ed16 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '219244970f7741138535157810d2117c'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:46:40.389752 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-39f7799f-c920-4d2a-a3c4-5e1ea3c9ed16 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '219244970f7741138535157810d2117c'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:46:40.403015 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-39f7799f-c920-4d2a-a3c4-5e1ea3c9ed16 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '219244970f7741138535157810d2117c'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:46:40.403814 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-39f7799f-c920-4d2a-a3c4-5e1ea3c9ed16 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '219244970f7741138535157810d2117c'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:46:40.404641 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-39f7799f-c920-4d2a-a3c4-5e1ea3c9ed16 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '219244970f7741138535157810d2117c'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:46:40.417598 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1061/2142] 10.222.0.102 () {58 vars in 1229 bytes} [Mon Aug 1 15:46:39 2022] DELETE /identity/v3/users/219244970f7741138535157810d2117c => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:46:40.490193 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23016f0-9f70-4973-ba99-c32c630d7e42 service neutron] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:46:40.498119 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-d23016f0-9f70-4973-ba99-c32c630d7e42 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:46:40.504915 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23016f0-9f70-4973-ba99-c32c630d7e42 service neutron] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:46:40.583640 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73befa13-4e0f-4212-86f1-d5fe6c33db26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:46:40.585408 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73befa13-4e0f-4212-86f1-d5fe6c33db26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:46:40.585408 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73befa13-4e0f-4212-86f1-d5fe6c33db26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:46:40.585408 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73befa13-4e0f-4212-86f1-d5fe6c33db26 admin admin] PATH_INFO: `/v3/projects/980076d5f1e3404db6fff44c9261e007` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:46:40.586460 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73befa13-4e0f-4212-86f1-d5fe6c33db26 admin admin] RBAC: Authorizing `identity:delete_project(project_id=980076d5f1e3404db6fff44c9261e007)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:46:40.588683 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73befa13-4e0f-4212-86f1-d5fe6c33db26 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:46:40.685178 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f7799f-c920-4d2a-a3c4-5e1ea3c9ed16 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:46:40.688529 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-39f7799f-c920-4d2a-a3c4-5e1ea3c9ed16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:46:40.699573 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-73befa13-4e0f-4212-86f1-d5fe6c33db26 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '980076d5f1e3404db6fff44c9261e007', 'request_id': 'req-73befa13-4e0f-4212-86f1-d5fe6c33db26'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:46:40.705968 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f7799f-c920-4d2a-a3c4-5e1ea3c9ed16 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:46:40.708227 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-73befa13-4e0f-4212-86f1-d5fe6c33db26 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '980076d5f1e3404db6fff44c9261e007', 'request_id': 'req-73befa13-4e0f-4212-86f1-d5fe6c33db26'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:46:40.718019 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:46:40.765475 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144b4971-aa0a-4f5e-8997-c4841a8a84a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:46:40.766127 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144b4971-aa0a-4f5e-8997-c4841a8a84a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:46:40.766409 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144b4971-aa0a-4f5e-8997-c4841a8a84a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:46:40.766682 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144b4971-aa0a-4f5e-8997-c4841a8a84a7 admin admin] PATH_INFO: `/v3/projects/5491feaf62ca4fe1826dbdf61ba69728` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:46:40.767966 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144b4971-aa0a-4f5e-8997-c4841a8a84a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5491feaf62ca4fe1826dbdf61ba69728)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:46:40.769938 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144b4971-aa0a-4f5e-8997-c4841a8a84a7 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:46:40.791891 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-73befa13-4e0f-4212-86f1-d5fe6c33db26 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '980076d5f1e3404db6fff44c9261e007', 'request_id': 'req-73befa13-4e0f-4212-86f1-d5fe6c33db26'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:46:40.802951 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-73befa13-4e0f-4212-86f1-d5fe6c33db26 admin admin] The token cache is being invalidate because project 980076d5f1e3404db6fff44c9261e007 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80352) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 15:46:40.803233 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-73befa13-4e0f-4212-86f1-d5fe6c33db26 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:46:40.805780 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-73befa13-4e0f-4212-86f1-d5fe6c33db26 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:46:40.805780 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1082/2143] 10.222.0.102 () {58 vars in 1238 bytes} [Mon Aug 1 15:46:40 2022] DELETE /identity/v3/projects/980076d5f1e3404db6fff44c9261e007 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:46:40.936132 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-144b4971-aa0a-4f5e-8997-c4841a8a84a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5491feaf62ca4fe1826dbdf61ba69728', 'request_id': 'req-144b4971-aa0a-4f5e-8997-c4841a8a84a7'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:46:41.039183 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-144b4971-aa0a-4f5e-8997-c4841a8a84a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5491feaf62ca4fe1826dbdf61ba69728', 'request_id': 'req-144b4971-aa0a-4f5e-8997-c4841a8a84a7'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:46:41.047005 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-144b4971-aa0a-4f5e-8997-c4841a8a84a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5491feaf62ca4fe1826dbdf61ba69728', 'request_id': 'req-144b4971-aa0a-4f5e-8997-c4841a8a84a7'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:46:41.059352 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-144b4971-aa0a-4f5e-8997-c4841a8a84a7 admin admin] The token cache is being invalidate because project 5491feaf62ca4fe1826dbdf61ba69728 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80353) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 15:46:41.060232 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-144b4971-aa0a-4f5e-8997-c4841a8a84a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:46:41.060958 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-144b4971-aa0a-4f5e-8997-c4841a8a84a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:46:41.062561 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1062/2144] 10.222.0.102 () {58 vars in 1238 bytes} [Mon Aug 1 15:46:40 2022] DELETE /identity/v3/projects/5491feaf62ca4fe1826dbdf61ba69728 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:46:41.068836 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc19dfd-8db6-4d46-a85d-b6a96053cde7 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:46:41.069321 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc19dfd-8db6-4d46-a85d-b6a96053cde7 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:46:41.069662 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc19dfd-8db6-4d46-a85d-b6a96053cde7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:46:41.093925 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-4fc19dfd-8db6-4d46-a85d-b6a96053cde7 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:46:41.095237 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-4fc19dfd-8db6-4d46-a85d-b6a96053cde7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:46:41.163794 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1083/2145] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:46:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:46:41.165517 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58880da6-006d-4fcc-aef7-99cb9bea7968 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:46:41.165753 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58880da6-006d-4fcc-aef7-99cb9bea7968 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:46:41.166034 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58880da6-006d-4fcc-aef7-99cb9bea7968 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:46:41.186666 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-58880da6-006d-4fcc-aef7-99cb9bea7968 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:46:41.187905 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-58880da6-006d-4fcc-aef7-99cb9bea7968 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:46:41.197410 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1063/2146] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:46:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:46:41.202244 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc19dfd-8db6-4d46-a85d-b6a96053cde7 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:46:41.213132 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc19dfd-8db6-4d46-a85d-b6a96053cde7 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:46:41.217874 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7ded02-41f2-4394-9394-8d2914a50078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:46:41.218489 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7ded02-41f2-4394-9394-8d2914a50078 admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:46:41.218756 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7ded02-41f2-4394-9394-8d2914a50078 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:46:41.219049 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7ded02-41f2-4394-9394-8d2914a50078 admin admin] PATH_INFO: `/v3/domains` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:46:41.219721 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7ded02-41f2-4394-9394-8d2914a50078 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:46:41.220019 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7ded02-41f2-4394-9394-8d2914a50078 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:46:41.221771 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7ded02-41f2-4394-9394-8d2914a50078 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:46:41.238793 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1084/2147] 10.222.0.102 () {58 vars in 1158 bytes} [Mon Aug 1 15:46:41 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:46:41.240211 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58880da6-006d-4fcc-aef7-99cb9bea7968 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:46:41.249699 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58880da6-006d-4fcc-aef7-99cb9bea7968 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:46:41.262941 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89beebad-9ffc-4aa3-b2e7-1893e68090f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:46:41.263630 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89beebad-9ffc-4aa3-b2e7-1893e68090f0 admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:46:41.263905 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89beebad-9ffc-4aa3-b2e7-1893e68090f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:46:41.264387 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89beebad-9ffc-4aa3-b2e7-1893e68090f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:46:41.265220 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89beebad-9ffc-4aa3-b2e7-1893e68090f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:46:41.267419 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89beebad-9ffc-4aa3-b2e7-1893e68090f0 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:46:41.420193 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1064/2148] 10.222.0.102 () {60 vars in 1158 bytes} [Mon Aug 1 15:46:41 2022] POST /identity/v3/projects => generated 386 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 15:46:41.421471 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7ded02-41f2-4394-9394-8d2914a50078 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:46:41.432489 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7ded02-41f2-4394-9394-8d2914a50078 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:46:41.492366 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f7dac3-8b9a-4997-b04e-6f9e434bc0d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:46:41.493137 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f7dac3-8b9a-4997-b04e-6f9e434bc0d6 admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:46:41.493369 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f7dac3-8b9a-4997-b04e-6f9e434bc0d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:46:41.493635 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f7dac3-8b9a-4997-b04e-6f9e434bc0d6 admin admin] PATH_INFO: `/v3/users` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:46:41.494298 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f7dac3-8b9a-4997-b04e-6f9e434bc0d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:46:41.496295 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f7dac3-8b9a-4997-b04e-6f9e434bc0d6 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:46:41.604212 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1085/2149] 10.222.0.102 () {60 vars in 1149 bytes} [Mon Aug 1 15:46:41 2022] POST /identity/v3/users => generated 294 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:46:41.608211 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89beebad-9ffc-4aa3-b2e7-1893e68090f0 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:46:41.619305 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89beebad-9ffc-4aa3-b2e7-1893e68090f0 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:46:41.623863 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a407d307-1e7a-47fd-9fd1-ff5c209a98f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:46:41.624582 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a407d307-1e7a-47fd-9fd1-ff5c209a98f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:46:41.624811 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a407d307-1e7a-47fd-9fd1-ff5c209a98f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:46:41.625079 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a407d307-1e7a-47fd-9fd1-ff5c209a98f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:46:41.625774 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a407d307-1e7a-47fd-9fd1-ff5c209a98f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:46:41.627380 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a407d307-1e7a-47fd-9fd1-ff5c209a98f7 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:46:41.637733 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1065/2150] 10.222.0.102 () {58 vars in 1127 bytes} [Mon Aug 1 15:46:41 2022] GET /identity/v3/roles => generated 1427 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:46:41.641836 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f7dac3-8b9a-4997-b04e-6f9e434bc0d6 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:46:41.651849 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f7dac3-8b9a-4997-b04e-6f9e434bc0d6 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:46:41.656614 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78feea4a-4bd4-497f-bf18-a41996653d2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:46:41.660662 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78feea4a-4bd4-497f-bf18-a41996653d2b admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:46:41.660662 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78feea4a-4bd4-497f-bf18-a41996653d2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:46:41.660662 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78feea4a-4bd4-497f-bf18-a41996653d2b admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:46:41.660662 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78feea4a-4bd4-497f-bf18-a41996653d2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:46:41.660662 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78feea4a-4bd4-497f-bf18-a41996653d2b admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:46:41.670712 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1086/2151] 10.222.0.102 () {58 vars in 1127 bytes} [Mon Aug 1 15:46:41 2022] GET /identity/v3/roles => generated 1427 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:46:41.675713 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a407d307-1e7a-47fd-9fd1-ff5c209a98f7 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:46:41.685776 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a407d307-1e7a-47fd-9fd1-ff5c209a98f7 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:46:41.690425 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf8f3c5-5f4c-4044-9ca4-694dc3d91c1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:46:41.691231 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf8f3c5-5f4c-4044-9ca4-694dc3d91c1b admin admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:46:41.691508 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf8f3c5-5f4c-4044-9ca4-694dc3d91c1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:46:41.691782 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf8f3c5-5f4c-4044-9ca4-694dc3d91c1b admin admin] PATH_INFO: `/v3/projects/354db1666444451481ac989a999f04db/users/cbb85ea16f4c470b8c13debdf911fe30/roles/27f5093ac0674d799cdbd17c68482e32` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:46:41.708344 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf8f3c5-5f4c-4044-9ca4-694dc3d91c1b admin admin] RBAC: Authorizing `identity:create_grant(project_id=354db1666444451481ac989a999f04db, user_id=cbb85ea16f4c470b8c13debdf911fe30, role_id=27f5093ac0674d799cdbd17c68482e32)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:46:41.711266 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf8f3c5-5f4c-4044-9ca4-694dc3d91c1b admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:46:41.832684 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1066/2152] 10.222.0.102 () {60 vars in 1488 bytes} [Mon Aug 1 15:46:41 2022] PUT /identity/v3/projects/354db1666444451481ac989a999f04db/users/cbb85ea16f4c470b8c13debdf911fe30/roles/27f5093ac0674d799cdbd17c68482e32 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:46:41.843748 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9799533d-0d69-4dba-91f6-6c62c82734bb None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:46:41.844034 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9799533d-0d69-4dba-91f6-6c62c82734bb None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:46:41.844311 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9799533d-0d69-4dba-91f6-6c62c82734bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:46:41.874935 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-9799533d-0d69-4dba-91f6-6c62c82734bb None None] MFA Rules not processed for user `cbb85ea16f4c470b8c13debdf911fe30`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:46:41.875208 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-9799533d-0d69-4dba-91f6-6c62c82734bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:46:41.944327 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1087/2153] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:46:41 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:46:41.956394 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf8f3c5-5f4c-4044-9ca4-694dc3d91c1b admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:46:41.958157 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-acf8f3c5-5f4c-4044-9ca4-694dc3d91c1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:46:42.017594 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf8f3c5-5f4c-4044-9ca4-694dc3d91c1b admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:46:42.021754 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5076a01c-f4d8-497a-bee5-47946aec66d2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff810b37183c4729859c1b05edff1703', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:46:42.022374 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5076a01c-f4d8-497a-bee5-47946aec66d2 service cinder] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:46:42.022652 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5076a01c-f4d8-497a-bee5-47946aec66d2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:46:42.022919 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5076a01c-f4d8-497a-bee5-47946aec66d2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:46:42.033033 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5076a01c-f4d8-497a-bee5-47946aec66d2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:46:42.034612 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5076a01c-f4d8-497a-bee5-47946aec66d2 service cinder] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:46:42.044274 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1067/2154] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:46:41 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:46:42.066431 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9799533d-0d69-4dba-91f6-6c62c82734bb None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:46:42.263190 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9799533d-0d69-4dba-91f6-6c62c82734bb None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:46:42.268409 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d28adf3-a4fa-4faa-8718-209edc5103e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:46:42.269178 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d28adf3-a4fa-4faa-8718-209edc5103e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:46:42.269547 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d28adf3-a4fa-4faa-8718-209edc5103e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:46:42.271633 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d28adf3-a4fa-4faa-8718-209edc5103e0 admin admin] PATH_INFO: `/v3/users/cbb85ea16f4c470b8c13debdf911fe30` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:46:42.272921 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d28adf3-a4fa-4faa-8718-209edc5103e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cbb85ea16f4c470b8c13debdf911fe30)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:46:42.274927 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d28adf3-a4fa-4faa-8718-209edc5103e0 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:46:42.312249 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:46:42.535593 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-7d28adf3-a4fa-4faa-8718-209edc5103e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cbb85ea16f4c470b8c13debdf911fe30'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:46:42.551220 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-7d28adf3-a4fa-4faa-8718-209edc5103e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cbb85ea16f4c470b8c13debdf911fe30'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:46:42.559896 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-7d28adf3-a4fa-4faa-8718-209edc5103e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cbb85ea16f4c470b8c13debdf911fe30'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:46:42.561084 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-7d28adf3-a4fa-4faa-8718-209edc5103e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cbb85ea16f4c470b8c13debdf911fe30'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:46:42.564559 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-7d28adf3-a4fa-4faa-8718-209edc5103e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cbb85ea16f4c470b8c13debdf911fe30'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:46:42.584530 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:46:42.657353 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1088/2155] 10.222.0.102 () {58 vars in 1229 bytes} [Mon Aug 1 15:46:42 2022] DELETE /identity/v3/users/cbb85ea16f4c470b8c13debdf911fe30 => generated 0 bytes in 594 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:46:42.662055 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294ce1bf-4105-4b8a-b127-dae4ea8509fb None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:46:42.662409 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294ce1bf-4105-4b8a-b127-dae4ea8509fb None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:46:42.662689 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294ce1bf-4105-4b8a-b127-dae4ea8509fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:46:42.684384 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-294ce1bf-4105-4b8a-b127-dae4ea8509fb None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:46:42.686252 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-294ce1bf-4105-4b8a-b127-dae4ea8509fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:46:42.748307 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1068/2156] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:46:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:46:42.759914 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d28adf3-a4fa-4faa-8718-209edc5103e0 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:46:42.760343 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-7d28adf3-a4fa-4faa-8718-209edc5103e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:46:42.822156 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d28adf3-a4fa-4faa-8718-209edc5103e0 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:46:42.822687 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294ce1bf-4105-4b8a-b127-dae4ea8509fb None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:46:42.824174 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-294ce1bf-4105-4b8a-b127-dae4ea8509fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:46:42.825997 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9f7641-a169-4059-a521-a8d510bcade4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a856a413100443939fe9b10daa868518', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:46:42.826858 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9f7641-a169-4059-a521-a8d510bcade4 service neutron] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:46:42.827131 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9f7641-a169-4059-a521-a8d510bcade4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:46:42.827436 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9f7641-a169-4059-a521-a8d510bcade4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:46:42.837015 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294ce1bf-4105-4b8a-b127-dae4ea8509fb None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:46:42.837740 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9f7641-a169-4059-a521-a8d510bcade4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:46:42.839245 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9f7641-a169-4059-a521-a8d510bcade4 service neutron] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:46:42.842624 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7903c447-5349-4d2f-a2ca-497adf819abc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:46:42.843315 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7903c447-5349-4d2f-a2ca-497adf819abc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:46:42.844162 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7903c447-5349-4d2f-a2ca-497adf819abc admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:46:42.844162 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7903c447-5349-4d2f-a2ca-497adf819abc admin admin] PATH_INFO: `/v3/users/baf54f9e95694084aa66c38e48cdff49` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:46:42.845252 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7903c447-5349-4d2f-a2ca-497adf819abc admin admin] RBAC: Authorizing `identity:delete_user(user_id=baf54f9e95694084aa66c38e48cdff49)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:46:42.847828 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7903c447-5349-4d2f-a2ca-497adf819abc admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:46:42.850150 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1089/2157] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:46:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:46:43.112112 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-7903c447-5349-4d2f-a2ca-497adf819abc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'baf54f9e95694084aa66c38e48cdff49'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:46:43.214824 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-7903c447-5349-4d2f-a2ca-497adf819abc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'baf54f9e95694084aa66c38e48cdff49'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:46:43.228543 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-7903c447-5349-4d2f-a2ca-497adf819abc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'baf54f9e95694084aa66c38e48cdff49'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:46:43.229609 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-7903c447-5349-4d2f-a2ca-497adf819abc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'baf54f9e95694084aa66c38e48cdff49'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:46:43.230501 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-7903c447-5349-4d2f-a2ca-497adf819abc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'baf54f9e95694084aa66c38e48cdff49'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:46:43.245468 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1069/2158] 10.222.0.102 () {58 vars in 1229 bytes} [Mon Aug 1 15:46:42 2022] DELETE /identity/v3/users/baf54f9e95694084aa66c38e48cdff49 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 15:46:43.249800 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b717f92-cd4d-44fa-9868-621ea521a201 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:46:43.250086 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b717f92-cd4d-44fa-9868-621ea521a201 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:46:43.250364 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b717f92-cd4d-44fa-9868-621ea521a201 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:46:43.269899 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-9b717f92-cd4d-44fa-9868-621ea521a201 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:46:43.271118 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-9b717f92-cd4d-44fa-9868-621ea521a201 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:46:43.336071 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1090/2159] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:46:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:46:43.347694 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7903c447-5349-4d2f-a2ca-497adf819abc admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:46:43.350794 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:46:43.351825 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-7903c447-5349-4d2f-a2ca-497adf819abc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:46:43.391483 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b717f92-cd4d-44fa-9868-621ea521a201 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:46:43.392961 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-9b717f92-cd4d-44fa-9868-621ea521a201 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:46:43.405204 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b717f92-cd4d-44fa-9868-621ea521a201 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:46:43.410484 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398e7c34-0683-489b-a269-b48956ad156a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:46:43.411194 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398e7c34-0683-489b-a269-b48956ad156a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:46:43.411464 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398e7c34-0683-489b-a269-b48956ad156a admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:46:43.411742 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398e7c34-0683-489b-a269-b48956ad156a admin admin] PATH_INFO: `/v3/projects/354db1666444451481ac989a999f04db` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:46:43.413013 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398e7c34-0683-489b-a269-b48956ad156a admin admin] RBAC: Authorizing `identity:delete_project(project_id=354db1666444451481ac989a999f04db)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:46:43.414936 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398e7c34-0683-489b-a269-b48956ad156a admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:46:43.432191 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7903c447-5349-4d2f-a2ca-497adf819abc admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:46:43.437234 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd218374-7006-43a1-be91-929ec103407f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a856a413100443939fe9b10daa868518', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:46:43.439734 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd218374-7006-43a1-be91-929ec103407f service neutron] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:46:43.440510 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd218374-7006-43a1-be91-929ec103407f service neutron] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:46:43.440768 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd218374-7006-43a1-be91-929ec103407f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:46:43.455512 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd218374-7006-43a1-be91-929ec103407f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:46:43.457468 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd218374-7006-43a1-be91-929ec103407f service neutron] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:46:43.470636 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:46:43.475213 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1070/2160] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:46:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:46:43.583222 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-398e7c34-0683-489b-a269-b48956ad156a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '354db1666444451481ac989a999f04db', 'request_id': 'req-398e7c34-0683-489b-a269-b48956ad156a'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:46:43.590531 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-398e7c34-0683-489b-a269-b48956ad156a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '354db1666444451481ac989a999f04db', 'request_id': 'req-398e7c34-0683-489b-a269-b48956ad156a'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:46:43.672707 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-398e7c34-0683-489b-a269-b48956ad156a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '354db1666444451481ac989a999f04db', 'request_id': 'req-398e7c34-0683-489b-a269-b48956ad156a'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:46:43.687999 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-398e7c34-0683-489b-a269-b48956ad156a admin admin] The token cache is being invalidate because project 354db1666444451481ac989a999f04db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80352) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 15:46:43.688260 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-398e7c34-0683-489b-a269-b48956ad156a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:46:43.689080 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-398e7c34-0683-489b-a269-b48956ad156a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:46:43.693935 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1091/2161] 10.222.0.102 () {58 vars in 1238 bytes} [Mon Aug 1 15:46:43 2022] DELETE /identity/v3/projects/354db1666444451481ac989a999f04db => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 15:46:43.696372 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25c520c-513b-4428-a45b-2927df75a173 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:46:43.697358 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25c520c-513b-4428-a45b-2927df75a173 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:46:43.697641 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25c520c-513b-4428-a45b-2927df75a173 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:46:43.743318 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-f25c520c-513b-4428-a45b-2927df75a173 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:46:43.744601 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-f25c520c-513b-4428-a45b-2927df75a173 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:46:43.832370 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1071/2162] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:46:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:46:43.840244 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3809c627-e071-43ea-9567-a2ad7341e9c5 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:46:43.840569 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3809c627-e071-43ea-9567-a2ad7341e9c5 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:46:43.840785 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3809c627-e071-43ea-9567-a2ad7341e9c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:46:43.862668 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-3809c627-e071-43ea-9567-a2ad7341e9c5 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:46:43.864486 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-3809c627-e071-43ea-9567-a2ad7341e9c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:46:43.876681 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1092/2163] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:46:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:46:43.880129 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25c520c-513b-4428-a45b-2927df75a173 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:46:43.890423 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25c520c-513b-4428-a45b-2927df75a173 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:46:43.897873 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665820c9-e948-46f2-b917-8e10b9420189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:46:43.898578 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665820c9-e948-46f2-b917-8e10b9420189 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:46:43.898925 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665820c9-e948-46f2-b917-8e10b9420189 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:46:43.899268 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665820c9-e948-46f2-b917-8e10b9420189 admin admin] PATH_INFO: `/v3/domains` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:46:43.900039 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665820c9-e948-46f2-b917-8e10b9420189 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:46:43.900443 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665820c9-e948-46f2-b917-8e10b9420189 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:46:43.902136 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665820c9-e948-46f2-b917-8e10b9420189 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:46:43.914392 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1072/2164] 10.222.0.102 () {58 vars in 1158 bytes} [Mon Aug 1 15:46:43 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:46:43.918861 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3809c627-e071-43ea-9567-a2ad7341e9c5 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:46:43.928466 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3809c627-e071-43ea-9567-a2ad7341e9c5 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:46:43.933131 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95dc840-e470-4878-95d5-e8ed51147bc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:46:43.933726 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95dc840-e470-4878-95d5-e8ed51147bc8 admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:46:43.934004 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95dc840-e470-4878-95d5-e8ed51147bc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:46:43.934267 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95dc840-e470-4878-95d5-e8ed51147bc8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:46:43.934931 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95dc840-e470-4878-95d5-e8ed51147bc8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:46:43.937072 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95dc840-e470-4878-95d5-e8ed51147bc8 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:46:43.974027 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665820c9-e948-46f2-b917-8e10b9420189 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:46:43.975887 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-665820c9-e948-46f2-b917-8e10b9420189 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:46:43.989721 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665820c9-e948-46f2-b917-8e10b9420189 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:46:43.994649 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6257b918-9b64-410c-83c5-ada7f6e4b9a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:46:43.995322 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6257b918-9b64-410c-83c5-ada7f6e4b9a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:46:43.995732 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6257b918-9b64-410c-83c5-ada7f6e4b9a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:46:43.996018 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6257b918-9b64-410c-83c5-ada7f6e4b9a3 admin admin] PATH_INFO: `/v3/projects/e163423954fb45928787468cec71b3a0` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:46:43.997223 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6257b918-9b64-410c-83c5-ada7f6e4b9a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e163423954fb45928787468cec71b3a0)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:46:43.999133 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6257b918-9b64-410c-83c5-ada7f6e4b9a3 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:46:44.034077 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1093/2165] 10.222.0.102 () {60 vars in 1158 bytes} [Mon Aug 1 15:46:43 2022] POST /identity/v3/projects => generated 374 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:46:44.038531 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95dc840-e470-4878-95d5-e8ed51147bc8 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:46:44.101961 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95dc840-e470-4878-95d5-e8ed51147bc8 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:46:44.106522 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf50aef6-49bc-44c6-bee8-3d703b997358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:46:44.107141 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf50aef6-49bc-44c6-bee8-3d703b997358 admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:46:44.107417 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf50aef6-49bc-44c6-bee8-3d703b997358 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:46:44.107686 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf50aef6-49bc-44c6-bee8-3d703b997358 admin admin] PATH_INFO: `/v3/users` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:46:44.110140 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf50aef6-49bc-44c6-bee8-3d703b997358 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:46:44.110350 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf50aef6-49bc-44c6-bee8-3d703b997358 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:46:44.161971 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-6257b918-9b64-410c-83c5-ada7f6e4b9a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e163423954fb45928787468cec71b3a0', 'request_id': 'req-6257b918-9b64-410c-83c5-ada7f6e4b9a3'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:46:44.215937 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1094/2166] 10.222.0.102 () {60 vars in 1149 bytes} [Mon Aug 1 15:46:44 2022] POST /identity/v3/users => generated 288 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 15:46:44.220136 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf50aef6-49bc-44c6-bee8-3d703b997358 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:46:44.229996 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf50aef6-49bc-44c6-bee8-3d703b997358 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:46:44.238633 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-6257b918-9b64-410c-83c5-ada7f6e4b9a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e163423954fb45928787468cec71b3a0', 'request_id': 'req-6257b918-9b64-410c-83c5-ada7f6e4b9a3'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:46:44.247328 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-6257b918-9b64-410c-83c5-ada7f6e4b9a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e163423954fb45928787468cec71b3a0', 'request_id': 'req-6257b918-9b64-410c-83c5-ada7f6e4b9a3'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:46:44.259628 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-6257b918-9b64-410c-83c5-ada7f6e4b9a3 admin admin] The token cache is being invalidate because project e163423954fb45928787468cec71b3a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80353) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 15:46:44.259915 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-6257b918-9b64-410c-83c5-ada7f6e4b9a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:46:44.260595 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-6257b918-9b64-410c-83c5-ada7f6e4b9a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:46:44.262171 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1073/2167] 10.222.0.102 () {58 vars in 1238 bytes} [Mon Aug 1 15:46:43 2022] DELETE /identity/v3/projects/e163423954fb45928787468cec71b3a0 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 15:46:44.266153 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6257b918-9b64-410c-83c5-ada7f6e4b9a3 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:46:44.267723 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-6257b918-9b64-410c-83c5-ada7f6e4b9a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:46:44.294909 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b181aa60-1ac8-46d5-8dab-5d9aadb011e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:46:44.295531 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b181aa60-1ac8-46d5-8dab-5d9aadb011e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:46:44.295810 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b181aa60-1ac8-46d5-8dab-5d9aadb011e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:46:44.296080 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b181aa60-1ac8-46d5-8dab-5d9aadb011e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:46:44.296990 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b181aa60-1ac8-46d5-8dab-5d9aadb011e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:46:44.298591 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b181aa60-1ac8-46d5-8dab-5d9aadb011e6 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:46:44.309683 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1095/2168] 10.222.0.102 () {58 vars in 1127 bytes} [Mon Aug 1 15:46:44 2022] GET /identity/v3/roles => generated 1427 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:46:44.313367 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b181aa60-1ac8-46d5-8dab-5d9aadb011e6 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:46:44.315197 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-b181aa60-1ac8-46d5-8dab-5d9aadb011e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:46:44.329072 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b181aa60-1ac8-46d5-8dab-5d9aadb011e6 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:46:44.333785 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a83ecdd-8494-498b-ac80-7b43d1d479e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:46:44.334619 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a83ecdd-8494-498b-ac80-7b43d1d479e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:46:44.334969 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a83ecdd-8494-498b-ac80-7b43d1d479e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:46:44.335309 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a83ecdd-8494-498b-ac80-7b43d1d479e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:46:44.336063 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a83ecdd-8494-498b-ac80-7b43d1d479e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:46:44.337764 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a83ecdd-8494-498b-ac80-7b43d1d479e5 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:46:44.343276 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6257b918-9b64-410c-83c5-ada7f6e4b9a3 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:46:44.349387 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1096/2169] 10.222.0.102 () {58 vars in 1127 bytes} [Mon Aug 1 15:46:44 2022] GET /identity/v3/roles => generated 1427 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 15:46:44.350319 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912bd05d-2dfb-4ae4-9612-9d709b2957f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:46:44.355536 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912bd05d-2dfb-4ae4-9612-9d709b2957f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:46:44.355536 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912bd05d-2dfb-4ae4-9612-9d709b2957f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:46:44.355536 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912bd05d-2dfb-4ae4-9612-9d709b2957f9 admin admin] PATH_INFO: `/v3/users/a1b944f86649467fb60f7e0387617dac` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:46:44.355830 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:46:44.355921 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912bd05d-2dfb-4ae4-9612-9d709b2957f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1b944f86649467fb60f7e0387617dac)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:46:44.356017 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a83ecdd-8494-498b-ac80-7b43d1d479e5 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:46:44.356103 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912bd05d-2dfb-4ae4-9612-9d709b2957f9 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:46:44.363964 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a83ecdd-8494-498b-ac80-7b43d1d479e5 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:46:44.368718 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb53dc7-d115-4bda-8f47-0199467afe7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:46:44.369432 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb53dc7-d115-4bda-8f47-0199467afe7f admin admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:46:44.369705 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb53dc7-d115-4bda-8f47-0199467afe7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:46:44.369975 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb53dc7-d115-4bda-8f47-0199467afe7f admin admin] PATH_INFO: `/v3/projects/074c48e458c5411fa4715cf7d215cce7/users/2b224611fd9d40e58e3bb3d2deb17411/roles/27f5093ac0674d799cdbd17c68482e32` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:46:44.385157 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb53dc7-d115-4bda-8f47-0199467afe7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=074c48e458c5411fa4715cf7d215cce7, user_id=2b224611fd9d40e58e3bb3d2deb17411, role_id=27f5093ac0674d799cdbd17c68482e32)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:46:44.387957 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb53dc7-d115-4bda-8f47-0199467afe7f admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:46:44.452708 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1097/2170] 10.222.0.102 () {60 vars in 1488 bytes} [Mon Aug 1 15:46:44 2022] PUT /identity/v3/projects/074c48e458c5411fa4715cf7d215cce7/users/2b224611fd9d40e58e3bb3d2deb17411/roles/27f5093ac0674d799cdbd17c68482e32 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:46:44.464313 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f075e900-1560-4251-a555-110916d4ab39 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:46:44.464598 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f075e900-1560-4251-a555-110916d4ab39 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:46:44.464898 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f075e900-1560-4251-a555-110916d4ab39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:46:44.495835 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-f075e900-1560-4251-a555-110916d4ab39 None None] MFA Rules not processed for user `2b224611fd9d40e58e3bb3d2deb17411`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:46:44.497088 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-f075e900-1560-4251-a555-110916d4ab39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:46:44.538395 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:46:44.559677 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-912bd05d-2dfb-4ae4-9612-9d709b2957f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1b944f86649467fb60f7e0387617dac'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:46:44.560985 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1098/2171] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:46:44 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 15:46:44.572666 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f075e900-1560-4251-a555-110916d4ab39 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:46:44.574229 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-f075e900-1560-4251-a555-110916d4ab39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:46:44.631149 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f075e900-1560-4251-a555-110916d4ab39 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:46:44.634722 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ff436d-2946-421f-8e37-c33aafcae3fe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff810b37183c4729859c1b05edff1703', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:46:44.635330 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ff436d-2946-421f-8e37-c33aafcae3fe service cinder] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:46:44.635604 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ff436d-2946-421f-8e37-c33aafcae3fe service cinder] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:46:44.635873 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ff436d-2946-421f-8e37-c33aafcae3fe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:46:44.644758 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ff436d-2946-421f-8e37-c33aafcae3fe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:46:44.646341 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ff436d-2946-421f-8e37-c33aafcae3fe service cinder] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:46:44.654343 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-912bd05d-2dfb-4ae4-9612-9d709b2957f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1b944f86649467fb60f7e0387617dac'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:46:44.655049 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1099/2172] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:46:44 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 15:46:44.667410 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-912bd05d-2dfb-4ae4-9612-9d709b2957f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1b944f86649467fb60f7e0387617dac'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:46:44.668175 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-912bd05d-2dfb-4ae4-9612-9d709b2957f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1b944f86649467fb60f7e0387617dac'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:46:44.668819 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-912bd05d-2dfb-4ae4-9612-9d709b2957f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1b944f86649467fb60f7e0387617dac'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:46:44.676781 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ff436d-2946-421f-8e37-c33aafcae3fe service cinder] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:46:44.682688 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1074/2173] 10.222.0.102 () {58 vars in 1229 bytes} [Mon Aug 1 15:46:44 2022] DELETE /identity/v3/users/a1b944f86649467fb60f7e0387617dac => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 15:46:44.750556 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ff436d-2946-421f-8e37-c33aafcae3fe service cinder] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:46:44.819582 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ff853b-df53-408e-8f75-373c00db10a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:46:44.820232 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ff853b-df53-408e-8f75-373c00db10a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:46:44.820513 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ff853b-df53-408e-8f75-373c00db10a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:46:44.820784 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ff853b-df53-408e-8f75-373c00db10a0 admin admin] PATH_INFO: `/v3/users/2b224611fd9d40e58e3bb3d2deb17411` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:46:44.822183 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ff853b-df53-408e-8f75-373c00db10a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b224611fd9d40e58e3bb3d2deb17411)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:46:44.824231 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ff853b-df53-408e-8f75-373c00db10a0 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:46:45.054670 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-d6ff853b-df53-408e-8f75-373c00db10a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b224611fd9d40e58e3bb3d2deb17411'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:46:45.067560 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-d6ff853b-df53-408e-8f75-373c00db10a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b224611fd9d40e58e3bb3d2deb17411'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:46:45.074626 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-d6ff853b-df53-408e-8f75-373c00db10a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b224611fd9d40e58e3bb3d2deb17411'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:46:45.075338 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-d6ff853b-df53-408e-8f75-373c00db10a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b224611fd9d40e58e3bb3d2deb17411'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:46:45.075953 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-d6ff853b-df53-408e-8f75-373c00db10a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b224611fd9d40e58e3bb3d2deb17411'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:46:45.177556 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:46:45.182900 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1100/2174] 10.222.0.102 () {58 vars in 1229 bytes} [Mon Aug 1 15:46:44 2022] DELETE /identity/v3/users/2b224611fd9d40e58e3bb3d2deb17411 => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 15:46:45.187161 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119a43c8-dd48-462f-aa3d-f3b9c70e52fc None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:46:45.187706 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119a43c8-dd48-462f-aa3d-f3b9c70e52fc None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:46:45.187706 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119a43c8-dd48-462f-aa3d-f3b9c70e52fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:46:45.208268 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-119a43c8-dd48-462f-aa3d-f3b9c70e52fc None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:46:45.209543 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-119a43c8-dd48-462f-aa3d-f3b9c70e52fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:46:45.281468 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1075/2175] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:46:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:46:45.294561 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ff853b-df53-408e-8f75-373c00db10a0 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:46:45.296287 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-d6ff853b-df53-408e-8f75-373c00db10a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:46:45.312228 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:46:45.364260 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ff853b-df53-408e-8f75-373c00db10a0 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:46:45.369700 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8750cfbf-ec21-4a77-9cc0-8d41c910bd90 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a856a413100443939fe9b10daa868518', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:46:45.370331 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8750cfbf-ec21-4a77-9cc0-8d41c910bd90 service neutron] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:46:45.370607 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8750cfbf-ec21-4a77-9cc0-8d41c910bd90 service neutron] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:46:45.371023 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8750cfbf-ec21-4a77-9cc0-8d41c910bd90 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:46:45.383035 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8750cfbf-ec21-4a77-9cc0-8d41c910bd90 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:46:45.388498 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8750cfbf-ec21-4a77-9cc0-8d41c910bd90 service neutron] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:46:45.394854 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1101/2176] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:46:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 15:46:45.483666 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119a43c8-dd48-462f-aa3d-f3b9c70e52fc None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:46:45.485386 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-119a43c8-dd48-462f-aa3d-f3b9c70e52fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:46:45.497411 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119a43c8-dd48-462f-aa3d-f3b9c70e52fc None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:46:45.502018 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1f12c4-0ffc-418e-bec2-740644879e2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:46:45.502722 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1f12c4-0ffc-418e-bec2-740644879e2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:46:45.503025 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1f12c4-0ffc-418e-bec2-740644879e2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:46:45.503278 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1f12c4-0ffc-418e-bec2-740644879e2e admin admin] PATH_INFO: `/v3/projects/d69ba5f69c9a45be88725973b0ffbba5` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:46:45.504479 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1f12c4-0ffc-418e-bec2-740644879e2e admin admin] RBAC: Authorizing `identity:delete_project(project_id=d69ba5f69c9a45be88725973b0ffbba5)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:46:45.507274 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1f12c4-0ffc-418e-bec2-740644879e2e admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:46:45.657992 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-be1f12c4-0ffc-418e-bec2-740644879e2e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd69ba5f69c9a45be88725973b0ffbba5', 'request_id': 'req-be1f12c4-0ffc-418e-bec2-740644879e2e'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:46:45.755823 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-be1f12c4-0ffc-418e-bec2-740644879e2e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd69ba5f69c9a45be88725973b0ffbba5', 'request_id': 'req-be1f12c4-0ffc-418e-bec2-740644879e2e'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:46:45.764208 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-be1f12c4-0ffc-418e-bec2-740644879e2e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd69ba5f69c9a45be88725973b0ffbba5', 'request_id': 'req-be1f12c4-0ffc-418e-bec2-740644879e2e'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:46:45.777215 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-be1f12c4-0ffc-418e-bec2-740644879e2e admin admin] The token cache is being invalidate because project d69ba5f69c9a45be88725973b0ffbba5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80353) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 15:46:45.777750 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-be1f12c4-0ffc-418e-bec2-740644879e2e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:46:45.778223 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-be1f12c4-0ffc-418e-bec2-740644879e2e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:46:45.779793 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1076/2177] 10.222.0.102 () {58 vars in 1238 bytes} [Mon Aug 1 15:46:45 2022] DELETE /identity/v3/projects/d69ba5f69c9a45be88725973b0ffbba5 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:46:45.787032 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc00c8db-6e08-4187-889d-ca8211d93b3b None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:46:45.787569 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc00c8db-6e08-4187-889d-ca8211d93b3b None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:46:45.787679 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc00c8db-6e08-4187-889d-ca8211d93b3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:46:45.807697 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-fc00c8db-6e08-4187-889d-ca8211d93b3b None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:46:45.808946 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-fc00c8db-6e08-4187-889d-ca8211d93b3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:46:45.882864 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1102/2178] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:46:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 15:46:45.891092 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98010c8f-1fd4-48fb-9994-95d88748fa96 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:46:45.891470 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98010c8f-1fd4-48fb-9994-95d88748fa96 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:46:45.891829 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98010c8f-1fd4-48fb-9994-95d88748fa96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:46:45.903570 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc00c8db-6e08-4187-889d-ca8211d93b3b None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:46:45.905228 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-fc00c8db-6e08-4187-889d-ca8211d93b3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:46:45.912608 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-98010c8f-1fd4-48fb-9994-95d88748fa96 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:46:45.913863 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-98010c8f-1fd4-48fb-9994-95d88748fa96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:46:45.922630 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc00c8db-6e08-4187-889d-ca8211d93b3b None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:46:45.926606 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1077/2179] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:46:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 15:46:45.930501 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf979a76-c0c8-464a-a331-4d8e10b07c78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:46:45.930734 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98010c8f-1fd4-48fb-9994-95d88748fa96 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:46:45.931198 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf979a76-c0c8-464a-a331-4d8e10b07c78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:46:45.931483 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf979a76-c0c8-464a-a331-4d8e10b07c78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:46:45.931760 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf979a76-c0c8-464a-a331-4d8e10b07c78 admin admin] PATH_INFO: `/v3/projects/074c48e458c5411fa4715cf7d215cce7` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:46:45.932989 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf979a76-c0c8-464a-a331-4d8e10b07c78 admin admin] RBAC: Authorizing `identity:delete_project(project_id=074c48e458c5411fa4715cf7d215cce7)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:46:45.934916 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf979a76-c0c8-464a-a331-4d8e10b07c78 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:46:45.940919 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98010c8f-1fd4-48fb-9994-95d88748fa96 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:46:45.946051 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082d5d66-00ce-434a-987d-51f9c2b8b1df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:46:45.946659 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082d5d66-00ce-434a-987d-51f9c2b8b1df admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:46:45.946981 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082d5d66-00ce-434a-987d-51f9c2b8b1df admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:46:45.947381 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082d5d66-00ce-434a-987d-51f9c2b8b1df admin admin] PATH_INFO: `/v3/domains` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:46:45.948197 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082d5d66-00ce-434a-987d-51f9c2b8b1df admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:46:45.953121 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082d5d66-00ce-434a-987d-51f9c2b8b1df admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:46:45.953121 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082d5d66-00ce-434a-987d-51f9c2b8b1df admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:46:45.968426 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1078/2180] 10.222.0.102 () {58 vars in 1158 bytes} [Mon Aug 1 15:46:45 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:46:45.969807 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082d5d66-00ce-434a-987d-51f9c2b8b1df admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:46:45.982083 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082d5d66-00ce-434a-987d-51f9c2b8b1df admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:46:45.986826 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747285f4-256b-4479-92c1-43dd99149da5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:46:45.987488 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747285f4-256b-4479-92c1-43dd99149da5 admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:46:45.987790 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747285f4-256b-4479-92c1-43dd99149da5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:46:45.988065 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747285f4-256b-4479-92c1-43dd99149da5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:46:45.988725 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747285f4-256b-4479-92c1-43dd99149da5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:46:45.990673 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747285f4-256b-4479-92c1-43dd99149da5 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:46:46.059018 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-cf979a76-c0c8-464a-a331-4d8e10b07c78 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '074c48e458c5411fa4715cf7d215cce7', 'request_id': 'req-cf979a76-c0c8-464a-a331-4d8e10b07c78'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:46:46.065705 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-cf979a76-c0c8-464a-a331-4d8e10b07c78 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '074c48e458c5411fa4715cf7d215cce7', 'request_id': 'req-cf979a76-c0c8-464a-a331-4d8e10b07c78'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:46:46.075444 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:46:46.162901 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1079/2181] 10.222.0.102 () {60 vars in 1158 bytes} [Mon Aug 1 15:46:45 2022] POST /identity/v3/projects => generated 376 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 15:46:46.167072 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-cf979a76-c0c8-464a-a331-4d8e10b07c78 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '074c48e458c5411fa4715cf7d215cce7', 'request_id': 'req-cf979a76-c0c8-464a-a331-4d8e10b07c78'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:46:46.167343 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=87,keystone:INSERT=4,keystone:DELETE=9 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:46:46.168467 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747285f4-256b-4479-92c1-43dd99149da5 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:46:46.178911 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-cf979a76-c0c8-464a-a331-4d8e10b07c78 admin admin] The token cache is being invalidate because project 074c48e458c5411fa4715cf7d215cce7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80352) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 15:46:46.179245 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-cf979a76-c0c8-464a-a331-4d8e10b07c78 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:46:46.179835 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-cf979a76-c0c8-464a-a331-4d8e10b07c78 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:46:46.181994 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1103/2182] 10.222.0.102 () {58 vars in 1238 bytes} [Mon Aug 1 15:46:45 2022] DELETE /identity/v3/projects/074c48e458c5411fa4715cf7d215cce7 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 15:46:46.186439 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2a251b-d5d4-4287-b2e3-f99564ae730e None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:46:46.186809 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2a251b-d5d4-4287-b2e3-f99564ae730e None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:46:46.187149 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2a251b-d5d4-4287-b2e3-f99564ae730e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:46:46.208738 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-8d2a251b-d5d4-4287-b2e3-f99564ae730e None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:46:46.209967 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-8d2a251b-d5d4-4287-b2e3-f99564ae730e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:46:46.231116 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747285f4-256b-4479-92c1-43dd99149da5 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:46:46.235873 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6cca9c-c8ed-4859-8b57-6ca9136e39d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:46:46.237037 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6cca9c-c8ed-4859-8b57-6ca9136e39d6 admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:46:46.237318 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6cca9c-c8ed-4859-8b57-6ca9136e39d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:46:46.237589 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6cca9c-c8ed-4859-8b57-6ca9136e39d6 admin admin] PATH_INFO: `/v3/users` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:46:46.238244 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6cca9c-c8ed-4859-8b57-6ca9136e39d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:46:46.240219 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6cca9c-c8ed-4859-8b57-6ca9136e39d6 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:46:46.270947 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1104/2183] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:46:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:46:46.337600 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dae06cc-42c1-4b49-92e6-e75380c26bdc None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:46:46.337880 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dae06cc-42c1-4b49-92e6-e75380c26bdc None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:46:46.338156 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dae06cc-42c1-4b49-92e6-e75380c26bdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:46:46.347643 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1080/2184] 10.222.0.102 () {60 vars in 1149 bytes} [Mon Aug 1 15:46:46 2022] POST /identity/v3/users => generated 289 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:46:46.348651 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6cca9c-c8ed-4859-8b57-6ca9136e39d6 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:46:46.350286 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-0a6cca9c-c8ed-4859-8b57-6ca9136e39d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:46:46.357489 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-2dae06cc-42c1-4b49-92e6-e75380c26bdc None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:46:46.358656 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-2dae06cc-42c1-4b49-92e6-e75380c26bdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:46:46.363121 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6cca9c-c8ed-4859-8b57-6ca9136e39d6 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:46:46.367348 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1105/2185] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:46:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 15:46:46.368979 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f89dbfb-e84e-4bfd-817d-8593c6dbbdd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:46:46.369688 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f89dbfb-e84e-4bfd-817d-8593c6dbbdd2 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:46:46.370038 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f89dbfb-e84e-4bfd-817d-8593c6dbbdd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:46:46.370322 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f89dbfb-e84e-4bfd-817d-8593c6dbbdd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:46:46.371077 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f89dbfb-e84e-4bfd-817d-8593c6dbbdd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:46:46.371198 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dae06cc-42c1-4b49-92e6-e75380c26bdc None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:46:46.372740 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f89dbfb-e84e-4bfd-817d-8593c6dbbdd2 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:46:46.381571 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dae06cc-42c1-4b49-92e6-e75380c26bdc None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:46:46.385482 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1081/2186] 10.222.0.102 () {58 vars in 1127 bytes} [Mon Aug 1 15:46:46 2022] GET /identity/v3/roles => generated 1427 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:46:46.386405 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc5fa97-1d24-442d-9926-ec89ddf14ce3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:46:46.387007 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc5fa97-1d24-442d-9926-ec89ddf14ce3 admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:46:46.387281 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc5fa97-1d24-442d-9926-ec89ddf14ce3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:46:46.387550 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc5fa97-1d24-442d-9926-ec89ddf14ce3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:46:46.388239 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc5fa97-1d24-442d-9926-ec89ddf14ce3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:46:46.388542 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc5fa97-1d24-442d-9926-ec89ddf14ce3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:46:46.388729 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f89dbfb-e84e-4bfd-817d-8593c6dbbdd2 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:46:46.390167 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc5fa97-1d24-442d-9926-ec89ddf14ce3 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:46:46.398580 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f89dbfb-e84e-4bfd-817d-8593c6dbbdd2 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:46:46.402078 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1106/2187] 10.222.0.102 () {58 vars in 1158 bytes} [Mon Aug 1 15:46:46 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:46:46.406285 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc5fa97-1d24-442d-9926-ec89ddf14ce3 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:46:46.406730 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6b5e2e-21ce-4c5c-865d-594ba09ec8c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:46:46.407492 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6b5e2e-21ce-4c5c-865d-594ba09ec8c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:46:46.407793 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6b5e2e-21ce-4c5c-865d-594ba09ec8c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:46:46.408063 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6b5e2e-21ce-4c5c-865d-594ba09ec8c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:46:46.408805 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6b5e2e-21ce-4c5c-865d-594ba09ec8c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:46:46.410446 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6b5e2e-21ce-4c5c-865d-594ba09ec8c1 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:46:46.416108 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc5fa97-1d24-442d-9926-ec89ddf14ce3 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:46:46.420988 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9717d18-e16e-4b0f-9256-6d4921d2499f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:46:46.421613 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9717d18-e16e-4b0f-9256-6d4921d2499f admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:46:46.421892 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9717d18-e16e-4b0f-9256-6d4921d2499f admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:46:46.422164 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9717d18-e16e-4b0f-9256-6d4921d2499f admin admin] PATH_INFO: `/v3/projects` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:46:46.422817 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9717d18-e16e-4b0f-9256-6d4921d2499f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:46:46.427957 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1082/2188] 10.222.0.102 () {58 vars in 1127 bytes} [Mon Aug 1 15:46:46 2022] GET /identity/v3/roles => generated 1427 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 15:46:46.428110 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9717d18-e16e-4b0f-9256-6d4921d2499f admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:46:46.428997 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6b5e2e-21ce-4c5c-865d-594ba09ec8c1 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:46:46.447900 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6b5e2e-21ce-4c5c-865d-594ba09ec8c1 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:46:46.447900 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618d3b89-d2a3-4971-80bb-7d044d983a1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:46:46.447900 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618d3b89-d2a3-4971-80bb-7d044d983a1d admin admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:46:46.447900 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618d3b89-d2a3-4971-80bb-7d044d983a1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:46:46.448348 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618d3b89-d2a3-4971-80bb-7d044d983a1d admin admin] PATH_INFO: `/v3/projects/2b4a1052f9a8462280fcbf01515ff8bb/users/406cbf68ca324d6dbbb5d9dc113dfaec/roles/27f5093ac0674d799cdbd17c68482e32` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:46:46.460718 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618d3b89-d2a3-4971-80bb-7d044d983a1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b4a1052f9a8462280fcbf01515ff8bb, user_id=406cbf68ca324d6dbbb5d9dc113dfaec, role_id=27f5093ac0674d799cdbd17c68482e32)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:46:46.463420 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618d3b89-d2a3-4971-80bb-7d044d983a1d admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:46:46.540390 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1107/2189] 10.222.0.102 () {60 vars in 1158 bytes} [Mon Aug 1 15:46:46 2022] POST /identity/v3/projects => generated 374 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 15:46:46.544390 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9717d18-e16e-4b0f-9256-6d4921d2499f admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:46:46.562013 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1083/2190] 10.222.0.102 () {60 vars in 1488 bytes} [Mon Aug 1 15:46:46 2022] PUT /identity/v3/projects/2b4a1052f9a8462280fcbf01515ff8bb/users/406cbf68ca324d6dbbb5d9dc113dfaec/roles/27f5093ac0674d799cdbd17c68482e32 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 15:46:46.573660 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4799225a-a260-4f0c-972b-a2591f1f8fc1 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:46:46.573941 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4799225a-a260-4f0c-972b-a2591f1f8fc1 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:46:46.574229 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4799225a-a260-4f0c-972b-a2591f1f8fc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:46:46.602936 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-4799225a-a260-4f0c-972b-a2591f1f8fc1 None None] MFA Rules not processed for user `406cbf68ca324d6dbbb5d9dc113dfaec`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:46:46.604179 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-4799225a-a260-4f0c-972b-a2591f1f8fc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:46:46.607477 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9717d18-e16e-4b0f-9256-6d4921d2499f admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:46:46.663622 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de745542-3ccf-47ff-aaea-d97aa3af83ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:46:46.664225 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de745542-3ccf-47ff-aaea-d97aa3af83ae admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:46:46.664501 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de745542-3ccf-47ff-aaea-d97aa3af83ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:46:46.664767 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de745542-3ccf-47ff-aaea-d97aa3af83ae admin admin] PATH_INFO: `/v3/users` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:46:46.665461 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de745542-3ccf-47ff-aaea-d97aa3af83ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:46:46.667388 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de745542-3ccf-47ff-aaea-d97aa3af83ae admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:46:46.668748 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1084/2191] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:46:46 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 15:46:46.673114 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:DELETE=3,keystone:SELECT=94,keystone:INSERT=3 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:46:46.681230 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4799225a-a260-4f0c-972b-a2591f1f8fc1 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:46:46.682697 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-4799225a-a260-4f0c-972b-a2591f1f8fc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:46:46.703077 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:46:46.741792 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4799225a-a260-4f0c-972b-a2591f1f8fc1 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:46:46.745597 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8bacbe-85bf-4f99-abd0-1cb2309e5096 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff810b37183c4729859c1b05edff1703', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:46:46.746263 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8bacbe-85bf-4f99-abd0-1cb2309e5096 service cinder] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:46:46.746544 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8bacbe-85bf-4f99-abd0-1cb2309e5096 service cinder] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:46:46.746819 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8bacbe-85bf-4f99-abd0-1cb2309e5096 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:46:46.755810 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8bacbe-85bf-4f99-abd0-1cb2309e5096 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:46:46.759166 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1108/2192] 10.222.0.102 () {60 vars in 1149 bytes} [Mon Aug 1 15:46:46 2022] POST /identity/v3/users => generated 288 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 15:46:46.759319 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8bacbe-85bf-4f99-abd0-1cb2309e5096 service cinder] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:46:46.760321 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de745542-3ccf-47ff-aaea-d97aa3af83ae admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:46:46.767115 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1085/2193] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:46:46 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:46:46.770762 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de745542-3ccf-47ff-aaea-d97aa3af83ae admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:46:46.775539 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d48936-963a-4791-8935-aa7671f3c31f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:46:46.776137 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d48936-963a-4791-8935-aa7671f3c31f admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:46:46.776397 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d48936-963a-4791-8935-aa7671f3c31f admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:46:46.776801 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d48936-963a-4791-8935-aa7671f3c31f admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:46:46.782243 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d48936-963a-4791-8935-aa7671f3c31f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:46:46.782243 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d48936-963a-4791-8935-aa7671f3c31f admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:46:46.791121 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1109/2194] 10.222.0.102 () {58 vars in 1127 bytes} [Mon Aug 1 15:46:46 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:46:46.795205 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8bacbe-85bf-4f99-abd0-1cb2309e5096 service cinder] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:46:46.806816 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8bacbe-85bf-4f99-abd0-1cb2309e5096 service cinder] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:46:46.811711 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1807715c-9868-402e-abbf-a295b93cc767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:46:46.812310 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1807715c-9868-402e-abbf-a295b93cc767 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:46:46.812591 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1807715c-9868-402e-abbf-a295b93cc767 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:46:46.813513 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1807715c-9868-402e-abbf-a295b93cc767 admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:46:46.813628 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1807715c-9868-402e-abbf-a295b93cc767 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:46:46.815169 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1807715c-9868-402e-abbf-a295b93cc767 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:46:46.828276 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1086/2195] 10.222.0.102 () {58 vars in 1127 bytes} [Mon Aug 1 15:46:46 2022] GET /identity/v3/roles => generated 1427 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:46:46.829679 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d48936-963a-4791-8935-aa7671f3c31f admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:46:46.840261 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d48936-963a-4791-8935-aa7671f3c31f admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:46:46.846583 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19886f3-b951-4385-8047-61c4e461bf83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:46:46.847265 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19886f3-b951-4385-8047-61c4e461bf83 admin admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:46:46.847549 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19886f3-b951-4385-8047-61c4e461bf83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:46:46.847830 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19886f3-b951-4385-8047-61c4e461bf83 admin admin] PATH_INFO: `/v3/projects/05d41e92674a48c4a4a199ff96bca4da/users/dbd52d082c304b7ea0a2b23c8744fdce/roles/27f5093ac0674d799cdbd17c68482e32` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:46:46.864257 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19886f3-b951-4385-8047-61c4e461bf83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=05d41e92674a48c4a4a199ff96bca4da, user_id=dbd52d082c304b7ea0a2b23c8744fdce, role_id=27f5093ac0674d799cdbd17c68482e32)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:46:46.866985 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19886f3-b951-4385-8047-61c4e461bf83 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:46:46.984466 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1110/2196] 10.222.0.102 () {60 vars in 1488 bytes} [Mon Aug 1 15:46:46 2022] PUT /identity/v3/projects/05d41e92674a48c4a4a199ff96bca4da/users/dbd52d082c304b7ea0a2b23c8744fdce/roles/27f5093ac0674d799cdbd17c68482e32 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:46:46.994388 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109115f4-19ca-4dc7-9dc2-422e0f95bacd None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:46:46.994674 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109115f4-19ca-4dc7-9dc2-422e0f95bacd None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:46:46.994949 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109115f4-19ca-4dc7-9dc2-422e0f95bacd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:46:47.025772 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-109115f4-19ca-4dc7-9dc2-422e0f95bacd None None] MFA Rules not processed for user `dbd52d082c304b7ea0a2b23c8744fdce`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:46:47.027039 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-109115f4-19ca-4dc7-9dc2-422e0f95bacd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:46:47.095370 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1087/2197] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:46:46 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:46:47.100449 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19886f3-b951-4385-8047-61c4e461bf83 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:46:47.161238 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19886f3-b951-4385-8047-61c4e461bf83 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:46:47.166149 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23af766f-11f5-4140-b3a6-bbbe6cb6c75d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:46:47.170687 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23af766f-11f5-4140-b3a6-bbbe6cb6c75d admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:46:47.170687 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23af766f-11f5-4140-b3a6-bbbe6cb6c75d admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:46:47.170687 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23af766f-11f5-4140-b3a6-bbbe6cb6c75d admin admin] PATH_INFO: `/v3/projects` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:46:47.170687 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23af766f-11f5-4140-b3a6-bbbe6cb6c75d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:46:47.170687 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23af766f-11f5-4140-b3a6-bbbe6cb6c75d admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:46:47.247061 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:46:47.296681 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1111/2198] 10.222.0.102 () {60 vars in 1158 bytes} [Mon Aug 1 15:46:47 2022] POST /identity/v3/projects => generated 376 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:46:47.297922 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109115f4-19ca-4dc7-9dc2-422e0f95bacd None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:46:47.308816 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109115f4-19ca-4dc7-9dc2-422e0f95bacd None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:46:47.318038 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:46:47.365252 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebee447-f4f6-4d77-bf15-ea75d3ece704 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:46:47.365878 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebee447-f4f6-4d77-bf15-ea75d3ece704 admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:46:47.366155 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebee447-f4f6-4d77-bf15-ea75d3ece704 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:46:47.366422 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebee447-f4f6-4d77-bf15-ea75d3ece704 admin admin] PATH_INFO: `/v3/users` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:46:47.367077 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebee447-f4f6-4d77-bf15-ea75d3ece704 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:46:47.369045 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebee447-f4f6-4d77-bf15-ea75d3ece704 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:46:47.481205 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1088/2199] 10.222.0.102 () {60 vars in 1149 bytes} [Mon Aug 1 15:46:47 2022] POST /identity/v3/users => generated 289 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:46:47.485251 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23af766f-11f5-4140-b3a6-bbbe6cb6c75d admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:46:47.495456 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23af766f-11f5-4140-b3a6-bbbe6cb6c75d admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:46:47.500051 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2277a8-8225-49c4-8b37-bb484253248c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:46:47.500591 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2277a8-8225-49c4-8b37-bb484253248c admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:46:47.500894 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2277a8-8225-49c4-8b37-bb484253248c admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:46:47.501171 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2277a8-8225-49c4-8b37-bb484253248c admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:46:47.501857 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2277a8-8225-49c4-8b37-bb484253248c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:46:47.503945 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2277a8-8225-49c4-8b37-bb484253248c admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:46:47.514311 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1112/2200] 10.222.0.102 () {58 vars in 1127 bytes} [Mon Aug 1 15:46:47 2022] GET /identity/v3/roles => generated 1427 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:46:47.524105 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebee447-f4f6-4d77-bf15-ea75d3ece704 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:46:47.534030 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebee447-f4f6-4d77-bf15-ea75d3ece704 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:46:47.538608 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3a5e7f-9cdc-46bf-a0ec-8d0a65a80bad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:46:47.539250 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3a5e7f-9cdc-46bf-a0ec-8d0a65a80bad admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:46:47.539526 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3a5e7f-9cdc-46bf-a0ec-8d0a65a80bad admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:46:47.539795 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3a5e7f-9cdc-46bf-a0ec-8d0a65a80bad admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:46:47.540483 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3a5e7f-9cdc-46bf-a0ec-8d0a65a80bad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:46:47.542110 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3a5e7f-9cdc-46bf-a0ec-8d0a65a80bad admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:46:47.552004 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1089/2201] 10.222.0.102 () {58 vars in 1127 bytes} [Mon Aug 1 15:46:47 2022] GET /identity/v3/roles => generated 1427 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:46:47.556040 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2277a8-8225-49c4-8b37-bb484253248c admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:46:47.566576 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2277a8-8225-49c4-8b37-bb484253248c admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:46:47.571401 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98416704-b648-4966-a9c0-483fabba6f4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:46:47.572057 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98416704-b648-4966-a9c0-483fabba6f4d admin admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:46:47.572333 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98416704-b648-4966-a9c0-483fabba6f4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:46:47.573174 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98416704-b648-4966-a9c0-483fabba6f4d admin admin] PATH_INFO: `/v3/projects/61a2b4d156b049dfa535eae97236996a/users/ccc987b03d3d4a0a8e1a745243f1a5f0/roles/27f5093ac0674d799cdbd17c68482e32` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:46:47.589368 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98416704-b648-4966-a9c0-483fabba6f4d admin admin] RBAC: Authorizing `identity:create_grant(project_id=61a2b4d156b049dfa535eae97236996a, user_id=ccc987b03d3d4a0a8e1a745243f1a5f0, role_id=27f5093ac0674d799cdbd17c68482e32)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:46:47.592406 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98416704-b648-4966-a9c0-483fabba6f4d admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:46:47.683520 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1113/2202] 10.222.0.102 () {60 vars in 1488 bytes} [Mon Aug 1 15:46:47 2022] PUT /identity/v3/projects/61a2b4d156b049dfa535eae97236996a/users/ccc987b03d3d4a0a8e1a745243f1a5f0/roles/27f5093ac0674d799cdbd17c68482e32 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 15:46:47.695478 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd34db1-49d3-4d6d-b2ea-447d941d4a5d None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:46:47.695943 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd34db1-49d3-4d6d-b2ea-447d941d4a5d None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:46:47.696063 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd34db1-49d3-4d6d-b2ea-447d941d4a5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:46:47.723703 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-7fd34db1-49d3-4d6d-b2ea-447d941d4a5d None None] MFA Rules not processed for user `ccc987b03d3d4a0a8e1a745243f1a5f0`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:46:47.725047 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-7fd34db1-49d3-4d6d-b2ea-447d941d4a5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:46:47.793097 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1090/2203] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:46:47 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:46:47.797697 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98416704-b648-4966-a9c0-483fabba6f4d admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:46:47.862527 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98416704-b648-4966-a9c0-483fabba6f4d admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:46:47.867446 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ba3f6d-b98b-4826-88c1-e796be60b372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:46:47.868058 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ba3f6d-b98b-4826-88c1-e796be60b372 admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:46:47.873365 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ba3f6d-b98b-4826-88c1-e796be60b372 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:46:47.873365 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ba3f6d-b98b-4826-88c1-e796be60b372 admin admin] PATH_INFO: `/v3/projects` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:46:47.873365 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ba3f6d-b98b-4826-88c1-e796be60b372 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:46:47.873365 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ba3f6d-b98b-4826-88c1-e796be60b372 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:46:47.892915 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:46:48.007392 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:46:48.014108 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1114/2204] 10.222.0.102 () {60 vars in 1158 bytes} [Mon Aug 1 15:46:47 2022] POST /identity/v3/projects => generated 378 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:46:48.018196 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd34db1-49d3-4d6d-b2ea-447d941d4a5d None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:46:48.029286 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd34db1-49d3-4d6d-b2ea-447d941d4a5d None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:46:48.086321 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15ac0af-9e24-41ce-904f-8d80541bd237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:46:48.086946 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15ac0af-9e24-41ce-904f-8d80541bd237 admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:46:48.087227 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15ac0af-9e24-41ce-904f-8d80541bd237 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:46:48.087501 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15ac0af-9e24-41ce-904f-8d80541bd237 admin admin] PATH_INFO: `/v3/users` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:46:48.088163 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15ac0af-9e24-41ce-904f-8d80541bd237 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:46:48.090147 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15ac0af-9e24-41ce-904f-8d80541bd237 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:46:48.208678 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1091/2205] 10.222.0.102 () {60 vars in 1149 bytes} [Mon Aug 1 15:46:48 2022] POST /identity/v3/users => generated 296 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:46:48.212387 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ba3f6d-b98b-4826-88c1-e796be60b372 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:46:48.224702 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ba3f6d-b98b-4826-88c1-e796be60b372 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:46:48.237532 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131c5ae8-74af-4b83-bc2c-736e59ad222b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:46:48.237532 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131c5ae8-74af-4b83-bc2c-736e59ad222b admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:46:48.237532 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131c5ae8-74af-4b83-bc2c-736e59ad222b admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:46:48.237532 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131c5ae8-74af-4b83-bc2c-736e59ad222b admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:46:48.237919 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131c5ae8-74af-4b83-bc2c-736e59ad222b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:46:48.237919 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131c5ae8-74af-4b83-bc2c-736e59ad222b admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:46:48.246955 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1115/2206] 10.222.0.102 () {58 vars in 1127 bytes} [Mon Aug 1 15:46:48 2022] GET /identity/v3/roles => generated 1427 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:46:48.251261 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15ac0af-9e24-41ce-904f-8d80541bd237 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:46:48.261499 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15ac0af-9e24-41ce-904f-8d80541bd237 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:46:48.270174 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faea190b-c5fe-4106-938a-4b21fcc246b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:46:48.270868 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faea190b-c5fe-4106-938a-4b21fcc246b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:46:48.271143 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faea190b-c5fe-4106-938a-4b21fcc246b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:46:48.271643 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faea190b-c5fe-4106-938a-4b21fcc246b1 admin admin] PATH_INFO: `/v3/projects/d2106b1be45241bda95b77085f30a0b2/users/c8726e0a38b942e489b8e0b6b54cd0ed/roles/de1374f966c04c27b579515b54334fd2` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:46:48.283236 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:46:48.287028 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faea190b-c5fe-4106-938a-4b21fcc246b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2106b1be45241bda95b77085f30a0b2, user_id=c8726e0a38b942e489b8e0b6b54cd0ed, role_id=de1374f966c04c27b579515b54334fd2)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:46:48.289711 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faea190b-c5fe-4106-938a-4b21fcc246b1 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:46:48.352477 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1092/2207] 10.222.0.102 () {60 vars in 1488 bytes} [Mon Aug 1 15:46:48 2022] PUT /identity/v3/projects/d2106b1be45241bda95b77085f30a0b2/users/c8726e0a38b942e489b8e0b6b54cd0ed/roles/de1374f966c04c27b579515b54334fd2 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:46:48.356429 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131c5ae8-74af-4b83-bc2c-736e59ad222b admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:46:48.357609 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:46:48.367060 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131c5ae8-74af-4b83-bc2c-736e59ad222b admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:46:48.426777 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6542cc0f-fece-48d2-8329-bdc07f065262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:46:48.427379 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6542cc0f-fece-48d2-8329-bdc07f065262 admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:46:48.427652 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6542cc0f-fece-48d2-8329-bdc07f065262 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:46:48.427921 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6542cc0f-fece-48d2-8329-bdc07f065262 admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:46:48.428602 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6542cc0f-fece-48d2-8329-bdc07f065262 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:46:48.430279 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6542cc0f-fece-48d2-8329-bdc07f065262 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:46:48.439964 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1116/2208] 10.222.0.102 () {58 vars in 1127 bytes} [Mon Aug 1 15:46:48 2022] GET /identity/v3/roles => generated 1427 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:46:48.444312 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faea190b-c5fe-4106-938a-4b21fcc246b1 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:46:48.454895 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faea190b-c5fe-4106-938a-4b21fcc246b1 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:46:48.460121 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a582fe11-b672-4855-8af4-925726e4289d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:46:48.460927 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a582fe11-b672-4855-8af4-925726e4289d admin admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:46:48.461412 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a582fe11-b672-4855-8af4-925726e4289d admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:46:48.461785 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a582fe11-b672-4855-8af4-925726e4289d admin admin] PATH_INFO: `/v3/projects/d2106b1be45241bda95b77085f30a0b2/users/c8726e0a38b942e489b8e0b6b54cd0ed/roles/de1374f966c04c27b579515b54334fd2` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:46:48.463908 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a582fe11-b672-4855-8af4-925726e4289d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2106b1be45241bda95b77085f30a0b2, user_id=c8726e0a38b942e489b8e0b6b54cd0ed, role_id=de1374f966c04c27b579515b54334fd2)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:46:48.467093 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a582fe11-b672-4855-8af4-925726e4289d admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:46:48.480491 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1093/2209] 10.222.0.102 () {60 vars in 1488 bytes} [Mon Aug 1 15:46:48 2022] PUT /identity/v3/projects/d2106b1be45241bda95b77085f30a0b2/users/c8726e0a38b942e489b8e0b6b54cd0ed/roles/de1374f966c04c27b579515b54334fd2 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:46:48.491950 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99644a81-8615-4aaa-b4b6-861318250560 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:46:48.492215 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99644a81-8615-4aaa-b4b6-861318250560 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:46:48.492482 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99644a81-8615-4aaa-b4b6-861318250560 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:46:48.521628 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-99644a81-8615-4aaa-b4b6-861318250560 None None] MFA Rules not processed for user `c8726e0a38b942e489b8e0b6b54cd0ed`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:46:48.524197 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:46:48.524828 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-99644a81-8615-4aaa-b4b6-861318250560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:46:48.604554 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1117/2210] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:46:48 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 15:46:48.616332 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a582fe11-b672-4855-8af4-925726e4289d admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:46:48.617969 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-a582fe11-b672-4855-8af4-925726e4289d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:46:48.680033 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a582fe11-b672-4855-8af4-925726e4289d admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:46:48.683932 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f67204-4fdc-4a30-85ec-9535690eb7b7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff810b37183c4729859c1b05edff1703', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:46:48.684667 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f67204-4fdc-4a30-85ec-9535690eb7b7 service cinder] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:46:48.685097 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f67204-4fdc-4a30-85ec-9535690eb7b7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:46:48.691385 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f67204-4fdc-4a30-85ec-9535690eb7b7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:46:48.746164 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f67204-4fdc-4a30-85ec-9535690eb7b7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:46:48.747637 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f67204-4fdc-4a30-85ec-9535690eb7b7 service cinder] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:46:48.757583 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1094/2211] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:46:48 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:46:48.927430 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:46:49.259082 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:46:49.573059 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:46:49.780008 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178d4cba-3ecd-46a6-a21e-82414f90b792 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:46:49.780283 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178d4cba-3ecd-46a6-a21e-82414f90b792 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:46:49.780549 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178d4cba-3ecd-46a6-a21e-82414f90b792 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:46:49.845282 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-178d4cba-3ecd-46a6-a21e-82414f90b792 None None] MFA Rules not processed for user `406cbf68ca324d6dbbb5d9dc113dfaec`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:46:49.846505 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-178d4cba-3ecd-46a6-a21e-82414f90b792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:46:49.901840 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1118/2212] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:46:49 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:46:49.915845 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:46:50.166963 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:46:50.197790 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:46:50.363614 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:46:50.735149 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:46:51.778425 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f67204-4fdc-4a30-85ec-9535690eb7b7 service cinder] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:46:51.787335 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f67204-4fdc-4a30-85ec-9535690eb7b7 service cinder] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:46:51.791272 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a40d56-6605-472a-b607-424c6fa85570 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff810b37183c4729859c1b05edff1703', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:46:51.791881 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a40d56-6605-472a-b607-424c6fa85570 service cinder] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:46:51.792154 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a40d56-6605-472a-b607-424c6fa85570 service cinder] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:46:51.792447 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a40d56-6605-472a-b607-424c6fa85570 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:46:51.850564 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a40d56-6605-472a-b607-424c6fa85570 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:46:51.852012 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a40d56-6605-472a-b607-424c6fa85570 service cinder] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:46:51.860998 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1095/2213] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:46:51 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:46:53.614691 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178d4cba-3ecd-46a6-a21e-82414f90b792 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:46:53.626680 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178d4cba-3ecd-46a6-a21e-82414f90b792 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:46:53.630392 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cf8f1e-5885-411f-8ac3-ad571da861b8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff810b37183c4729859c1b05edff1703', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:46:53.631003 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cf8f1e-5885-411f-8ac3-ad571da861b8 service cinder] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:46:53.631277 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cf8f1e-5885-411f-8ac3-ad571da861b8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:46:53.631542 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cf8f1e-5885-411f-8ac3-ad571da861b8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:46:53.640965 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cf8f1e-5885-411f-8ac3-ad571da861b8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:46:53.642409 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cf8f1e-5885-411f-8ac3-ad571da861b8 service cinder] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:46:53.653210 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1119/2214] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:46:53 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:46:58.459659 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a40d56-6605-472a-b607-424c6fa85570 service cinder] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:46:58.531118 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a40d56-6605-472a-b607-424c6fa85570 service cinder] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:46:58.535701 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7190c8f9-f69b-4117-8532-f04500c8def1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:46:58.536348 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7190c8f9-f69b-4117-8532-f04500c8def1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:46:58.536631 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7190c8f9-f69b-4117-8532-f04500c8def1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:46:58.536945 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7190c8f9-f69b-4117-8532-f04500c8def1 admin admin] PATH_INFO: `/v3/users/dbd52d082c304b7ea0a2b23c8744fdce` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:46:58.538217 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7190c8f9-f69b-4117-8532-f04500c8def1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dbd52d082c304b7ea0a2b23c8744fdce)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:46:58.540170 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7190c8f9-f69b-4117-8532-f04500c8def1 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:46:58.705789 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:46:58.718401 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-7190c8f9-f69b-4117-8532-f04500c8def1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dbd52d082c304b7ea0a2b23c8744fdce'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:46:58.803099 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-7190c8f9-f69b-4117-8532-f04500c8def1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dbd52d082c304b7ea0a2b23c8744fdce'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:46:58.815558 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-7190c8f9-f69b-4117-8532-f04500c8def1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dbd52d082c304b7ea0a2b23c8744fdce'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:46:58.816202 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-7190c8f9-f69b-4117-8532-f04500c8def1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dbd52d082c304b7ea0a2b23c8744fdce'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:46:58.817441 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-7190c8f9-f69b-4117-8532-f04500c8def1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dbd52d082c304b7ea0a2b23c8744fdce'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:46:58.830638 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1096/2215] 10.222.0.102 () {58 vars in 1229 bytes} [Mon Aug 1 15:46:58 2022] DELETE /identity/v3/users/dbd52d082c304b7ea0a2b23c8744fdce => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:46:58.835154 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e57fd7f-aa17-4272-84e9-a8c5c48e8c08 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:46:58.835711 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e57fd7f-aa17-4272-84e9-a8c5c48e8c08 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:46:58.835711 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e57fd7f-aa17-4272-84e9-a8c5c48e8c08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:46:58.854126 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-5e57fd7f-aa17-4272-84e9-a8c5c48e8c08 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:46:58.858903 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-5e57fd7f-aa17-4272-84e9-a8c5c48e8c08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:46:58.882588 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:46:58.920073 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1120/2216] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:46:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:46:58.930451 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7190c8f9-f69b-4117-8532-f04500c8def1 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:46:58.931914 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-7190c8f9-f69b-4117-8532-f04500c8def1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:46:58.991109 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7190c8f9-f69b-4117-8532-f04500c8def1 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:46:58.994774 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01deb18b-1d0a-4fbc-bbaf-2667e8739092 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a856a413100443939fe9b10daa868518', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:46:58.995389 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01deb18b-1d0a-4fbc-bbaf-2667e8739092 service neutron] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:46:58.995668 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01deb18b-1d0a-4fbc-bbaf-2667e8739092 service neutron] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:46:58.995943 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01deb18b-1d0a-4fbc-bbaf-2667e8739092 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:46:59.005089 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01deb18b-1d0a-4fbc-bbaf-2667e8739092 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:46:59.006500 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01deb18b-1d0a-4fbc-bbaf-2667e8739092 service neutron] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:46:59.016008 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1097/2217] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:46:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:46:59.438401 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e57fd7f-aa17-4272-84e9-a8c5c48e8c08 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:46:59.440024 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-5e57fd7f-aa17-4272-84e9-a8c5c48e8c08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:46:59.454913 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e57fd7f-aa17-4272-84e9-a8c5c48e8c08 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:46:59.460964 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee1c556-3139-4614-a62a-eaa511d4eda2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:46:59.462120 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee1c556-3139-4614-a62a-eaa511d4eda2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:46:59.462628 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee1c556-3139-4614-a62a-eaa511d4eda2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:46:59.463054 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee1c556-3139-4614-a62a-eaa511d4eda2 admin admin] PATH_INFO: `/v3/projects/05d41e92674a48c4a4a199ff96bca4da` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:46:59.464183 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee1c556-3139-4614-a62a-eaa511d4eda2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=05d41e92674a48c4a4a199ff96bca4da)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:46:59.466130 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee1c556-3139-4614-a62a-eaa511d4eda2 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:46:59.579510 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-dee1c556-3139-4614-a62a-eaa511d4eda2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05d41e92674a48c4a4a199ff96bca4da', 'request_id': 'req-dee1c556-3139-4614-a62a-eaa511d4eda2'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:46:59.588577 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-dee1c556-3139-4614-a62a-eaa511d4eda2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05d41e92674a48c4a4a199ff96bca4da', 'request_id': 'req-dee1c556-3139-4614-a62a-eaa511d4eda2'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:46:59.654251 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-dee1c556-3139-4614-a62a-eaa511d4eda2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05d41e92674a48c4a4a199ff96bca4da', 'request_id': 'req-dee1c556-3139-4614-a62a-eaa511d4eda2'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:46:59.668118 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-dee1c556-3139-4614-a62a-eaa511d4eda2 admin admin] The token cache is being invalidate because project 05d41e92674a48c4a4a199ff96bca4da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80352) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 15:46:59.668407 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-dee1c556-3139-4614-a62a-eaa511d4eda2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:46:59.669091 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-dee1c556-3139-4614-a62a-eaa511d4eda2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:46:59.670680 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1121/2218] 10.222.0.102 () {58 vars in 1238 bytes} [Mon Aug 1 15:46:59 2022] DELETE /identity/v3/projects/05d41e92674a48c4a4a199ff96bca4da => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:46:59.674638 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01deb18b-1d0a-4fbc-bbaf-2667e8739092 service neutron] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:46:59.684983 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01deb18b-1d0a-4fbc-bbaf-2667e8739092 service neutron] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:46:59.743163 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fcd92b-fafd-4448-9ac8-5908ce46fb6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:46:59.743517 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fcd92b-fafd-4448-9ac8-5908ce46fb6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:46:59.743799 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fcd92b-fafd-4448-9ac8-5908ce46fb6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:46:59.744073 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fcd92b-fafd-4448-9ac8-5908ce46fb6e admin admin] PATH_INFO: `/v3/users/ccc987b03d3d4a0a8e1a745243f1a5f0` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:46:59.745347 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fcd92b-fafd-4448-9ac8-5908ce46fb6e admin admin] RBAC: Authorizing `identity:delete_user(user_id=ccc987b03d3d4a0a8e1a745243f1a5f0)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:46:59.747364 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fcd92b-fafd-4448-9ac8-5908ce46fb6e admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:46:59.923559 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-35fcd92b-fafd-4448-9ac8-5908ce46fb6e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ccc987b03d3d4a0a8e1a745243f1a5f0'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:46:59.927656 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:47:00.012011 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-35fcd92b-fafd-4448-9ac8-5908ce46fb6e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ccc987b03d3d4a0a8e1a745243f1a5f0'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:47:00.028649 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-35fcd92b-fafd-4448-9ac8-5908ce46fb6e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ccc987b03d3d4a0a8e1a745243f1a5f0'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:47:00.029387 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-35fcd92b-fafd-4448-9ac8-5908ce46fb6e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ccc987b03d3d4a0a8e1a745243f1a5f0'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:47:00.029993 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-35fcd92b-fafd-4448-9ac8-5908ce46fb6e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ccc987b03d3d4a0a8e1a745243f1a5f0'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:47:00.042785 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1098/2219] 10.222.0.102 () {58 vars in 1229 bytes} [Mon Aug 1 15:46:59 2022] DELETE /identity/v3/users/ccc987b03d3d4a0a8e1a745243f1a5f0 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:47:00.484191 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee1c556-3139-4614-a62a-eaa511d4eda2 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:47:00.485705 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-dee1c556-3139-4614-a62a-eaa511d4eda2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:47:00.500090 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee1c556-3139-4614-a62a-eaa511d4eda2 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:47:00.559435 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c12003-3add-4bcf-bc91-270186f1c878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:47:00.560080 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c12003-3add-4bcf-bc91-270186f1c878 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:47:00.560353 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c12003-3add-4bcf-bc91-270186f1c878 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:47:00.560620 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c12003-3add-4bcf-bc91-270186f1c878 admin admin] PATH_INFO: `/v3/projects/61a2b4d156b049dfa535eae97236996a` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:47:00.561803 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c12003-3add-4bcf-bc91-270186f1c878 admin admin] RBAC: Authorizing `identity:delete_project(project_id=61a2b4d156b049dfa535eae97236996a)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:47:00.563712 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c12003-3add-4bcf-bc91-270186f1c878 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:47:00.699570 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-78c12003-3add-4bcf-bc91-270186f1c878 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61a2b4d156b049dfa535eae97236996a', 'request_id': 'req-78c12003-3add-4bcf-bc91-270186f1c878'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:47:00.706131 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-78c12003-3add-4bcf-bc91-270186f1c878 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61a2b4d156b049dfa535eae97236996a', 'request_id': 'req-78c12003-3add-4bcf-bc91-270186f1c878'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:47:00.708716 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:47:00.766645 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-78c12003-3add-4bcf-bc91-270186f1c878 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61a2b4d156b049dfa535eae97236996a', 'request_id': 'req-78c12003-3add-4bcf-bc91-270186f1c878'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:47:00.778529 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-78c12003-3add-4bcf-bc91-270186f1c878 admin admin] The token cache is being invalidate because project 61a2b4d156b049dfa535eae97236996a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80352) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 15:47:00.778810 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-78c12003-3add-4bcf-bc91-270186f1c878 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:47:00.779475 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-78c12003-3add-4bcf-bc91-270186f1c878 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:47:00.781023 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1122/2220] 10.222.0.102 () {58 vars in 1238 bytes} [Mon Aug 1 15:47:00 2022] DELETE /identity/v3/projects/61a2b4d156b049dfa535eae97236996a => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:47:00.785632 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fcd92b-fafd-4448-9ac8-5908ce46fb6e admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:47:00.787066 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-35fcd92b-fafd-4448-9ac8-5908ce46fb6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:47:00.800061 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fcd92b-fafd-4448-9ac8-5908ce46fb6e admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:47:00.858997 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542cd188-3e19-4f25-8990-9eeb725bc155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:47:00.859710 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542cd188-3e19-4f25-8990-9eeb725bc155 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:47:00.860118 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542cd188-3e19-4f25-8990-9eeb725bc155 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:47:00.860404 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542cd188-3e19-4f25-8990-9eeb725bc155 admin admin] PATH_INFO: `/v3/users/c8726e0a38b942e489b8e0b6b54cd0ed` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:47:00.861621 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542cd188-3e19-4f25-8990-9eeb725bc155 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c8726e0a38b942e489b8e0b6b54cd0ed)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:47:00.863591 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542cd188-3e19-4f25-8990-9eeb725bc155 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:47:01.078416 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-542cd188-3e19-4f25-8990-9eeb725bc155 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c8726e0a38b942e489b8e0b6b54cd0ed'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:47:01.168400 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-542cd188-3e19-4f25-8990-9eeb725bc155 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c8726e0a38b942e489b8e0b6b54cd0ed'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:47:01.181549 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-542cd188-3e19-4f25-8990-9eeb725bc155 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c8726e0a38b942e489b8e0b6b54cd0ed'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:47:01.182197 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-542cd188-3e19-4f25-8990-9eeb725bc155 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c8726e0a38b942e489b8e0b6b54cd0ed'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:47:01.182809 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-542cd188-3e19-4f25-8990-9eeb725bc155 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c8726e0a38b942e489b8e0b6b54cd0ed'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:47:01.194872 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1099/2221] 10.222.0.102 () {58 vars in 1229 bytes} [Mon Aug 1 15:47:00 2022] DELETE /identity/v3/users/c8726e0a38b942e489b8e0b6b54cd0ed => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:47:01.665964 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c12003-3add-4bcf-bc91-270186f1c878 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:47:01.667567 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-78c12003-3add-4bcf-bc91-270186f1c878 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:47:01.680638 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c12003-3add-4bcf-bc91-270186f1c878 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:47:01.741332 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4994ec59-6cfc-4c15-a748-5006c89db186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:47:01.742066 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4994ec59-6cfc-4c15-a748-5006c89db186 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:47:01.742720 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4994ec59-6cfc-4c15-a748-5006c89db186 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:47:01.742882 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4994ec59-6cfc-4c15-a748-5006c89db186 admin admin] PATH_INFO: `/v3/projects/d2106b1be45241bda95b77085f30a0b2` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:47:01.744129 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4994ec59-6cfc-4c15-a748-5006c89db186 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2106b1be45241bda95b77085f30a0b2)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:47:01.746261 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4994ec59-6cfc-4c15-a748-5006c89db186 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:47:01.872190 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-4994ec59-6cfc-4c15-a748-5006c89db186 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2106b1be45241bda95b77085f30a0b2', 'request_id': 'req-4994ec59-6cfc-4c15-a748-5006c89db186'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:47:01.884606 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-4994ec59-6cfc-4c15-a748-5006c89db186 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2106b1be45241bda95b77085f30a0b2', 'request_id': 'req-4994ec59-6cfc-4c15-a748-5006c89db186'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:47:01.962992 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-4994ec59-6cfc-4c15-a748-5006c89db186 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2106b1be45241bda95b77085f30a0b2', 'request_id': 'req-4994ec59-6cfc-4c15-a748-5006c89db186'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:47:01.976293 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-4994ec59-6cfc-4c15-a748-5006c89db186 admin admin] The token cache is being invalidate because project d2106b1be45241bda95b77085f30a0b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80352) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 15:47:01.977056 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-4994ec59-6cfc-4c15-a748-5006c89db186 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:47:01.977768 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-4994ec59-6cfc-4c15-a748-5006c89db186 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:47:01.979900 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1123/2222] 10.222.0.102 () {58 vars in 1238 bytes} [Mon Aug 1 15:47:01 2022] DELETE /identity/v3/projects/d2106b1be45241bda95b77085f30a0b2 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:47:11.191317 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=65,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:47:11.972315 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:DELETE=10,keystone:SELECT=55,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:47:13.189960 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddb3273-7d6c-4681-a704-3b8f487f8921 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:47:13.190408 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddb3273-7d6c-4681-a704-3b8f487f8921 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:47:13.190495 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddb3273-7d6c-4681-a704-3b8f487f8921 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:47:13.209987 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-7ddb3273-7d6c-4681-a704-3b8f487f8921 None None] MFA Rules not processed for user `ae8514df55144c9086ed98ba44efbbd4`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:47:13.211193 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-7ddb3273-7d6c-4681-a704-3b8f487f8921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:47:13.270740 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1100/2223] 10.222.0.102 () {58 vars in 1014 bytes} [Mon Aug 1 15:47:13 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:47:13.323859 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4994ec59-6cfc-4c15-a748-5006c89db186 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:47:13.325957 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-4994ec59-6cfc-4c15-a748-5006c89db186 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:47:13.398988 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4994ec59-6cfc-4c15-a748-5006c89db186 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:47:13.403870 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9955d0-9267-48f6-958d-64441052d46d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90673f47354f4403aa0e12e3658441c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:47:13.404485 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9955d0-9267-48f6-958d-64441052d46d service swift] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:47:13.404863 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9955d0-9267-48f6-958d-64441052d46d service swift] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:47:13.414551 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9955d0-9267-48f6-958d-64441052d46d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:47:13.414551 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9955d0-9267-48f6-958d-64441052d46d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:47:13.415362 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9955d0-9267-48f6-958d-64441052d46d service swift] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:47:13.423834 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1124/2224] 10.222.0.102 () {60 vars in 1389 bytes} [Mon Aug 1 15:47:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 01 15:47:14.330865 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ac7d1e-1ea3-475b-b262-c875da729d89 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:47:14.331922 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ac7d1e-1ea3-475b-b262-c875da729d89 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:47:14.332202 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ac7d1e-1ea3-475b-b262-c875da729d89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:47:14.352453 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-35ac7d1e-1ea3-475b-b262-c875da729d89 None None] MFA Rules not processed for user `ae8514df55144c9086ed98ba44efbbd4`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:47:14.353773 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-35ac7d1e-1ea3-475b-b262-c875da729d89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:47:14.361123 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1101/2225] 10.222.0.102 () {58 vars in 972 bytes} [Mon Aug 1 15:47:14 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:47:14.373597 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9955d0-9267-48f6-958d-64441052d46d service swift] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:47:14.384833 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9955d0-9267-48f6-958d-64441052d46d service swift] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:47:14.390248 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf52d7ef-cc40-4a54-9f23-b6a6ec3b79e9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90673f47354f4403aa0e12e3658441c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:47:14.390877 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf52d7ef-cc40-4a54-9f23-b6a6ec3b79e9 service swift] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:47:14.391149 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf52d7ef-cc40-4a54-9f23-b6a6ec3b79e9 service swift] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:47:14.391413 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf52d7ef-cc40-4a54-9f23-b6a6ec3b79e9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:47:14.400642 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf52d7ef-cc40-4a54-9f23-b6a6ec3b79e9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:47:14.402356 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf52d7ef-cc40-4a54-9f23-b6a6ec3b79e9 service swift] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:47:14.411257 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1125/2226] 10.222.0.102 () {60 vars in 1389 bytes} [Mon Aug 1 15:47:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 01 15:47:15.258440 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec98725-412d-498e-8740-23bd8dc023f0 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:47:15.258729 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec98725-412d-498e-8740-23bd8dc023f0 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:47:15.259000 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec98725-412d-498e-8740-23bd8dc023f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:47:15.278309 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-fec98725-412d-498e-8740-23bd8dc023f0 None None] MFA Rules not processed for user `ae8514df55144c9086ed98ba44efbbd4`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:47:15.279510 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-fec98725-412d-498e-8740-23bd8dc023f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:47:15.288276 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1102/2227] 10.222.0.102 () {58 vars in 1014 bytes} [Mon Aug 1 15:47:15 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:47:15.300232 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf52d7ef-cc40-4a54-9f23-b6a6ec3b79e9 service swift] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:47:15.310726 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf52d7ef-cc40-4a54-9f23-b6a6ec3b79e9 service swift] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:47:15.315704 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8a4d71-1eac-48e6-b88a-ba7631c58c8e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90673f47354f4403aa0e12e3658441c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:47:15.316300 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8a4d71-1eac-48e6-b88a-ba7631c58c8e service swift] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:47:15.316574 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8a4d71-1eac-48e6-b88a-ba7631c58c8e service swift] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:47:15.316842 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8a4d71-1eac-48e6-b88a-ba7631c58c8e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:47:15.324754 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8a4d71-1eac-48e6-b88a-ba7631c58c8e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:47:15.326615 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8a4d71-1eac-48e6-b88a-ba7631c58c8e service swift] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:47:15.335400 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1126/2228] 10.222.0.102 () {60 vars in 1389 bytes} [Mon Aug 1 15:47:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 01 15:47:15.944093 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce233730-1faa-402e-a44a-139aa98242c3 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:47:15.944600 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce233730-1faa-402e-a44a-139aa98242c3 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:47:15.944728 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce233730-1faa-402e-a44a-139aa98242c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:47:15.965627 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-ce233730-1faa-402e-a44a-139aa98242c3 None None] MFA Rules not processed for user `ae8514df55144c9086ed98ba44efbbd4`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:47:15.966828 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-ce233730-1faa-402e-a44a-139aa98242c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:47:15.974660 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1103/2229] 10.222.0.102 () {58 vars in 972 bytes} [Mon Aug 1 15:47:15 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:47:15.988236 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8a4d71-1eac-48e6-b88a-ba7631c58c8e service swift] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:47:15.998753 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8a4d71-1eac-48e6-b88a-ba7631c58c8e service swift] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:47:16.004406 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4ffc3c-795d-4b05-a21d-02ac793337ce service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90673f47354f4403aa0e12e3658441c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:47:16.005077 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4ffc3c-795d-4b05-a21d-02ac793337ce service swift] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:47:16.005460 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4ffc3c-795d-4b05-a21d-02ac793337ce service swift] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:47:16.005739 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4ffc3c-795d-4b05-a21d-02ac793337ce service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:47:16.014013 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4ffc3c-795d-4b05-a21d-02ac793337ce service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:47:16.015642 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4ffc3c-795d-4b05-a21d-02ac793337ce service swift] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:47:16.023937 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1127/2230] 10.222.0.102 () {60 vars in 1389 bytes} [Mon Aug 1 15:47:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 01 15:47:19.126252 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce233730-1faa-402e-a44a-139aa98242c3 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:47:19.128255 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-ce233730-1faa-402e-a44a-139aa98242c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:47:19.196517 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce233730-1faa-402e-a44a-139aa98242c3 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:47:19.201380 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fd98ee-4a66-4fbf-a5d4-eda722b1493f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:47:19.202027 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fd98ee-4a66-4fbf-a5d4-eda722b1493f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:47:19.202310 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fd98ee-4a66-4fbf-a5d4-eda722b1493f admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:47:19.202585 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fd98ee-4a66-4fbf-a5d4-eda722b1493f admin admin] PATH_INFO: `/v3/users/406cbf68ca324d6dbbb5d9dc113dfaec` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:47:19.203915 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fd98ee-4a66-4fbf-a5d4-eda722b1493f admin admin] RBAC: Authorizing `identity:delete_user(user_id=406cbf68ca324d6dbbb5d9dc113dfaec)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:47:19.205937 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fd98ee-4a66-4fbf-a5d4-eda722b1493f admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:47:19.473352 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-55fd98ee-4a66-4fbf-a5d4-eda722b1493f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '406cbf68ca324d6dbbb5d9dc113dfaec'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:47:19.561754 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-55fd98ee-4a66-4fbf-a5d4-eda722b1493f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '406cbf68ca324d6dbbb5d9dc113dfaec'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:47:19.574839 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-55fd98ee-4a66-4fbf-a5d4-eda722b1493f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '406cbf68ca324d6dbbb5d9dc113dfaec'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:47:19.575756 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-55fd98ee-4a66-4fbf-a5d4-eda722b1493f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '406cbf68ca324d6dbbb5d9dc113dfaec'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:47:19.576368 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-55fd98ee-4a66-4fbf-a5d4-eda722b1493f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '406cbf68ca324d6dbbb5d9dc113dfaec'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:47:19.593410 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1104/2231] 10.222.0.102 () {58 vars in 1229 bytes} [Mon Aug 1 15:47:19 2022] DELETE /identity/v3/users/406cbf68ca324d6dbbb5d9dc113dfaec => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:47:19.598669 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61139930-b93f-4c26-bb6a-42ba2c629764 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:47:19.599217 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61139930-b93f-4c26-bb6a-42ba2c629764 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:47:19.599217 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61139930-b93f-4c26-bb6a-42ba2c629764 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:47:19.619336 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-61139930-b93f-4c26-bb6a-42ba2c629764 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:47:19.620555 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-61139930-b93f-4c26-bb6a-42ba2c629764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:47:19.701312 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1128/2232] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:47:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:47:19.714837 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fd98ee-4a66-4fbf-a5d4-eda722b1493f admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:47:19.716251 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-55fd98ee-4a66-4fbf-a5d4-eda722b1493f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:47:19.723551 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:47:19.781754 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fd98ee-4a66-4fbf-a5d4-eda722b1493f admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:47:19.785710 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b784977-7312-44ce-9132-1f374990d692 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a856a413100443939fe9b10daa868518', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:47:19.786375 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b784977-7312-44ce-9132-1f374990d692 service neutron] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:47:19.786675 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b784977-7312-44ce-9132-1f374990d692 service neutron] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:47:19.786988 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b784977-7312-44ce-9132-1f374990d692 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:47:19.802015 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b784977-7312-44ce-9132-1f374990d692 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:47:19.803434 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b784977-7312-44ce-9132-1f374990d692 service neutron] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:47:19.813892 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1105/2233] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:47:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:47:20.116242 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61139930-b93f-4c26-bb6a-42ba2c629764 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:47:20.117914 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-61139930-b93f-4c26-bb6a-42ba2c629764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:47:20.136153 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61139930-b93f-4c26-bb6a-42ba2c629764 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:47:20.161947 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5850e5-b2b4-40fc-8135-2ea35fe2c3a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:47:20.162750 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5850e5-b2b4-40fc-8135-2ea35fe2c3a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:47:20.162862 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5850e5-b2b4-40fc-8135-2ea35fe2c3a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:47:20.163273 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5850e5-b2b4-40fc-8135-2ea35fe2c3a9 admin admin] PATH_INFO: `/v3/projects/2b4a1052f9a8462280fcbf01515ff8bb` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:47:20.164591 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5850e5-b2b4-40fc-8135-2ea35fe2c3a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b4a1052f9a8462280fcbf01515ff8bb)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:47:20.166607 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5850e5-b2b4-40fc-8135-2ea35fe2c3a9 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:47:20.298880 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:47:20.302498 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-fe5850e5-b2b4-40fc-8135-2ea35fe2c3a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b4a1052f9a8462280fcbf01515ff8bb', 'request_id': 'req-fe5850e5-b2b4-40fc-8135-2ea35fe2c3a9'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:47:20.308782 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-fe5850e5-b2b4-40fc-8135-2ea35fe2c3a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b4a1052f9a8462280fcbf01515ff8bb', 'request_id': 'req-fe5850e5-b2b4-40fc-8135-2ea35fe2c3a9'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:47:20.401926 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-fe5850e5-b2b4-40fc-8135-2ea35fe2c3a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b4a1052f9a8462280fcbf01515ff8bb', 'request_id': 'req-fe5850e5-b2b4-40fc-8135-2ea35fe2c3a9'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:47:20.413898 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-fe5850e5-b2b4-40fc-8135-2ea35fe2c3a9 admin admin] The token cache is being invalidate because project 2b4a1052f9a8462280fcbf01515ff8bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80352) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 15:47:20.414189 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-fe5850e5-b2b4-40fc-8135-2ea35fe2c3a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:47:20.414839 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-fe5850e5-b2b4-40fc-8135-2ea35fe2c3a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:47:20.416377 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1129/2234] 10.222.0.102 () {58 vars in 1238 bytes} [Mon Aug 1 15:47:20 2022] DELETE /identity/v3/projects/2b4a1052f9a8462280fcbf01515ff8bb => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 15:47:20.421339 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071ad47c-73e0-4132-b359-4e67c7d710dc None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:47:20.421856 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071ad47c-73e0-4132-b359-4e67c7d710dc None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:47:20.421950 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071ad47c-73e0-4132-b359-4e67c7d710dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:47:20.442353 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-071ad47c-73e0-4132-b359-4e67c7d710dc None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:47:20.443566 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-071ad47c-73e0-4132-b359-4e67c7d710dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:47:20.505308 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1106/2235] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:47:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 15:47:20.513977 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae16c4a6-e336-4264-bf3b-fa6f5055e22c None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:47:20.514421 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae16c4a6-e336-4264-bf3b-fa6f5055e22c None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:47:20.514698 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae16c4a6-e336-4264-bf3b-fa6f5055e22c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:47:20.535043 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-ae16c4a6-e336-4264-bf3b-fa6f5055e22c None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:47:20.536263 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-ae16c4a6-e336-4264-bf3b-fa6f5055e22c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:47:20.546679 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1130/2236] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:47:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:47:20.551131 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071ad47c-73e0-4132-b359-4e67c7d710dc None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:47:20.563655 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071ad47c-73e0-4132-b359-4e67c7d710dc None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:47:20.570590 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712c073b-d2f1-4f2c-987e-1b33e3089621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:47:20.571518 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712c073b-d2f1-4f2c-987e-1b33e3089621 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:47:20.571961 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712c073b-d2f1-4f2c-987e-1b33e3089621 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:47:20.572466 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712c073b-d2f1-4f2c-987e-1b33e3089621 admin admin] PATH_INFO: `/v3/domains` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:47:20.573645 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712c073b-d2f1-4f2c-987e-1b33e3089621 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:47:20.573961 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712c073b-d2f1-4f2c-987e-1b33e3089621 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:47:20.577075 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712c073b-d2f1-4f2c-987e-1b33e3089621 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:47:20.608236 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1107/2237] 10.222.0.102 () {58 vars in 1158 bytes} [Mon Aug 1 15:47:20 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:47:20.616801 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae16c4a6-e336-4264-bf3b-fa6f5055e22c None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:47:20.626683 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae16c4a6-e336-4264-bf3b-fa6f5055e22c None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:47:20.632521 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d547666-e7fa-4c59-9fb1-9211c0243039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:47:20.633759 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d547666-e7fa-4c59-9fb1-9211c0243039 admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:47:20.633759 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d547666-e7fa-4c59-9fb1-9211c0243039 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:47:20.634047 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d547666-e7fa-4c59-9fb1-9211c0243039 admin admin] PATH_INFO: `/v3/projects` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:47:20.634481 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d547666-e7fa-4c59-9fb1-9211c0243039 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:47:20.636399 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d547666-e7fa-4c59-9fb1-9211c0243039 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:47:20.723996 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1131/2238] 10.222.0.102 () {60 vars in 1158 bytes} [Mon Aug 1 15:47:20 2022] POST /identity/v3/projects => generated 388 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:47:20.728156 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712c073b-d2f1-4f2c-987e-1b33e3089621 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:47:20.739826 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712c073b-d2f1-4f2c-987e-1b33e3089621 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:47:20.807138 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91993c41-770f-4cf7-bf1d-75e219190044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:47:20.807977 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91993c41-770f-4cf7-bf1d-75e219190044 admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:47:20.808259 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91993c41-770f-4cf7-bf1d-75e219190044 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:47:20.808596 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91993c41-770f-4cf7-bf1d-75e219190044 admin admin] PATH_INFO: `/v3/users` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:47:20.809344 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91993c41-770f-4cf7-bf1d-75e219190044 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:47:20.811388 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91993c41-770f-4cf7-bf1d-75e219190044 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:47:20.921977 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1108/2239] 10.222.0.102 () {60 vars in 1149 bytes} [Mon Aug 1 15:47:20 2022] POST /identity/v3/users => generated 295 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:47:20.926755 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d547666-e7fa-4c59-9fb1-9211c0243039 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:47:20.936800 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d547666-e7fa-4c59-9fb1-9211c0243039 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:47:20.941535 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89113274-c2b5-4173-bc78-8211b4582dfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:47:20.942163 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89113274-c2b5-4173-bc78-8211b4582dfe admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:47:20.942467 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89113274-c2b5-4173-bc78-8211b4582dfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:47:20.942786 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89113274-c2b5-4173-bc78-8211b4582dfe admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:47:20.943420 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89113274-c2b5-4173-bc78-8211b4582dfe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:47:20.945132 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89113274-c2b5-4173-bc78-8211b4582dfe admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:47:20.955243 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1132/2240] 10.222.0.102 () {58 vars in 1127 bytes} [Mon Aug 1 15:47:20 2022] GET /identity/v3/roles => generated 1427 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:47:20.959141 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91993c41-770f-4cf7-bf1d-75e219190044 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:47:20.969292 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91993c41-770f-4cf7-bf1d-75e219190044 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:47:20.974481 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e35ce10-2535-46cb-a2ea-4306f047845d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:47:20.975085 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e35ce10-2535-46cb-a2ea-4306f047845d admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:47:20.975367 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e35ce10-2535-46cb-a2ea-4306f047845d admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:47:20.975642 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e35ce10-2535-46cb-a2ea-4306f047845d admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:47:20.976336 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e35ce10-2535-46cb-a2ea-4306f047845d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:47:20.978040 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e35ce10-2535-46cb-a2ea-4306f047845d admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:47:20.989679 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1109/2241] 10.222.0.102 () {58 vars in 1127 bytes} [Mon Aug 1 15:47:20 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:47:20.993365 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89113274-c2b5-4173-bc78-8211b4582dfe admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:47:21.003319 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89113274-c2b5-4173-bc78-8211b4582dfe admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:47:21.007862 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7086434-fe81-4fb0-86cf-22af984a9c1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:47:21.008502 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7086434-fe81-4fb0-86cf-22af984a9c1a admin admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:47:21.008799 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7086434-fe81-4fb0-86cf-22af984a9c1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:47:21.009189 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7086434-fe81-4fb0-86cf-22af984a9c1a admin admin] PATH_INFO: `/v3/projects/a1135884c7634f818b5a57587ab8c90b/users/cf618576c6d541fcb60e582b16afcaeb/roles/27f5093ac0674d799cdbd17c68482e32` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:47:21.025063 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7086434-fe81-4fb0-86cf-22af984a9c1a admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1135884c7634f818b5a57587ab8c90b, user_id=cf618576c6d541fcb60e582b16afcaeb, role_id=27f5093ac0674d799cdbd17c68482e32)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:47:21.027839 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7086434-fe81-4fb0-86cf-22af984a9c1a admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:47:21.117094 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1133/2242] 10.222.0.102 () {60 vars in 1488 bytes} [Mon Aug 1 15:47:20 2022] PUT /identity/v3/projects/a1135884c7634f818b5a57587ab8c90b/users/cf618576c6d541fcb60e582b16afcaeb/roles/27f5093ac0674d799cdbd17c68482e32 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:47:21.127300 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eca4175-7f76-4979-b03b-c9451dd463cf None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:47:21.129763 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eca4175-7f76-4979-b03b-c9451dd463cf None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:47:21.129763 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eca4175-7f76-4979-b03b-c9451dd463cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:47:21.155459 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:47:21.160174 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-9eca4175-7f76-4979-b03b-c9451dd463cf None None] MFA Rules not processed for user `cf618576c6d541fcb60e582b16afcaeb`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:47:21.163066 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-9eca4175-7f76-4979-b03b-c9451dd463cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:47:21.230704 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1110/2243] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:47:21 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:47:21.242686 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7086434-fe81-4fb0-86cf-22af984a9c1a admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:47:21.244715 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-c7086434-fe81-4fb0-86cf-22af984a9c1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:47:21.324185 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7086434-fe81-4fb0-86cf-22af984a9c1a admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:47:21.329745 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54cb2be-a4b0-42a4-ab58-88cfc465f1ef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff810b37183c4729859c1b05edff1703', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:47:21.330270 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54cb2be-a4b0-42a4-ab58-88cfc465f1ef service cinder] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:47:21.332577 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54cb2be-a4b0-42a4-ab58-88cfc465f1ef service cinder] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:47:21.332577 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54cb2be-a4b0-42a4-ab58-88cfc465f1ef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:47:21.340595 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54cb2be-a4b0-42a4-ab58-88cfc465f1ef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:47:21.342104 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54cb2be-a4b0-42a4-ab58-88cfc465f1ef service cinder] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:47:21.359848 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1134/2244] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:47:21 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:47:21.666568 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e463635-d40f-4d7a-ad30-817314b2b8b9 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:47:21.667154 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e463635-d40f-4d7a-ad30-817314b2b8b9 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:47:21.667154 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e463635-d40f-4d7a-ad30-817314b2b8b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:47:21.685657 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-5e463635-d40f-4d7a-ad30-817314b2b8b9 None None] MFA Rules not processed for user `82ab36c0e0804e4d8aaff377095aade7`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:47:21.686862 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-5e463635-d40f-4d7a-ad30-817314b2b8b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:47:21.749509 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1111/2245] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:47:21 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:47:30.918428 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50327615-1e53-4847-987b-359474eb0f40 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:47:30.919007 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50327615-1e53-4847-987b-359474eb0f40 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:47:30.919007 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50327615-1e53-4847-987b-359474eb0f40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:47:30.943206 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-50327615-1e53-4847-987b-359474eb0f40 None None] MFA Rules not processed for user `d60a67da3f284a469d374b8f1d93ea45`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:47:30.944534 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-50327615-1e53-4847-987b-359474eb0f40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:47:31.015070 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1135/2246] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:47:30 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:47:31.736535 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=51 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:47:37.810859 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e463635-d40f-4d7a-ad30-817314b2b8b9 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:47:37.875957 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e463635-d40f-4d7a-ad30-817314b2b8b9 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:47:37.881300 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4289200-b9d4-43c2-8b48-32b2d2181b57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:47:37.881977 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4289200-b9d4-43c2-8b48-32b2d2181b57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:47:37.882259 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4289200-b9d4-43c2-8b48-32b2d2181b57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:47:37.882528 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4289200-b9d4-43c2-8b48-32b2d2181b57 admin admin] PATH_INFO: `/v3/users/cf618576c6d541fcb60e582b16afcaeb` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:47:37.883700 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4289200-b9d4-43c2-8b48-32b2d2181b57 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf618576c6d541fcb60e582b16afcaeb)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:47:37.885735 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4289200-b9d4-43c2-8b48-32b2d2181b57 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:47:38.162448 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-a4289200-b9d4-43c2-8b48-32b2d2181b57 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf618576c6d541fcb60e582b16afcaeb'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:47:38.240972 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-a4289200-b9d4-43c2-8b48-32b2d2181b57 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf618576c6d541fcb60e582b16afcaeb'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:47:38.263511 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-a4289200-b9d4-43c2-8b48-32b2d2181b57 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf618576c6d541fcb60e582b16afcaeb'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:47:38.264306 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-a4289200-b9d4-43c2-8b48-32b2d2181b57 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf618576c6d541fcb60e582b16afcaeb'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:47:38.264945 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-a4289200-b9d4-43c2-8b48-32b2d2181b57 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf618576c6d541fcb60e582b16afcaeb'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:47:38.278577 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1112/2247] 10.222.0.102 () {58 vars in 1229 bytes} [Mon Aug 1 15:47:37 2022] DELETE /identity/v3/users/cf618576c6d541fcb60e582b16afcaeb => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 15:47:38.283900 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3274337-4db4-445d-bf3f-79560b8920ed None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:47:38.284446 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3274337-4db4-445d-bf3f-79560b8920ed None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:47:38.284446 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3274337-4db4-445d-bf3f-79560b8920ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:47:38.307919 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-a3274337-4db4-445d-bf3f-79560b8920ed None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:47:38.309704 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-a3274337-4db4-445d-bf3f-79560b8920ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:47:38.330920 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:DELETE=4,keystone:SELECT=93,keystone:INSERT=3 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:47:38.384260 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1136/2248] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:47:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:47:38.395494 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4289200-b9d4-43c2-8b48-32b2d2181b57 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:47:38.396947 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-a4289200-b9d4-43c2-8b48-32b2d2181b57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:47:38.456725 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4289200-b9d4-43c2-8b48-32b2d2181b57 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:47:38.460683 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73458fe5-091e-4b6f-a4d3-227479a2fae7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a856a413100443939fe9b10daa868518', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:47:38.461331 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73458fe5-091e-4b6f-a4d3-227479a2fae7 service neutron] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:47:38.461620 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73458fe5-091e-4b6f-a4d3-227479a2fae7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:47:38.461980 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73458fe5-091e-4b6f-a4d3-227479a2fae7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:47:38.473255 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73458fe5-091e-4b6f-a4d3-227479a2fae7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:47:38.474743 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73458fe5-091e-4b6f-a4d3-227479a2fae7 service neutron] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:47:38.485298 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1113/2249] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:47:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:47:39.072178 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3274337-4db4-445d-bf3f-79560b8920ed None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:47:39.073740 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-a3274337-4db4-445d-bf3f-79560b8920ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:47:39.087599 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3274337-4db4-445d-bf3f-79560b8920ed None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:47:39.092728 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa90aa40-56ca-4b1e-b884-b1e15011d5d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:47:39.093428 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa90aa40-56ca-4b1e-b884-b1e15011d5d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:47:39.093706 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa90aa40-56ca-4b1e-b884-b1e15011d5d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:47:39.093978 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa90aa40-56ca-4b1e-b884-b1e15011d5d3 admin admin] PATH_INFO: `/v3/projects/a1135884c7634f818b5a57587ab8c90b` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:47:39.095398 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa90aa40-56ca-4b1e-b884-b1e15011d5d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1135884c7634f818b5a57587ab8c90b)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:47:39.097530 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa90aa40-56ca-4b1e-b884-b1e15011d5d3 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:47:39.255042 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-aa90aa40-56ca-4b1e-b884-b1e15011d5d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1135884c7634f818b5a57587ab8c90b', 'request_id': 'req-aa90aa40-56ca-4b1e-b884-b1e15011d5d3'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:47:39.263107 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-aa90aa40-56ca-4b1e-b884-b1e15011d5d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1135884c7634f818b5a57587ab8c90b', 'request_id': 'req-aa90aa40-56ca-4b1e-b884-b1e15011d5d3'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:47:39.401754 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-aa90aa40-56ca-4b1e-b884-b1e15011d5d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1135884c7634f818b5a57587ab8c90b', 'request_id': 'req-aa90aa40-56ca-4b1e-b884-b1e15011d5d3'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:47:39.414371 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-aa90aa40-56ca-4b1e-b884-b1e15011d5d3 admin admin] The token cache is being invalidate because project a1135884c7634f818b5a57587ab8c90b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80352) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 15:47:39.414655 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-aa90aa40-56ca-4b1e-b884-b1e15011d5d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:47:39.415287 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-aa90aa40-56ca-4b1e-b884-b1e15011d5d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:47:39.416961 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1137/2250] 10.222.0.102 () {58 vars in 1238 bytes} [Mon Aug 1 15:47:39 2022] DELETE /identity/v3/projects/a1135884c7634f818b5a57587ab8c90b => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:47:39.421952 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0ff4dc-a25e-43d8-aa11-2492a69e02db None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:47:39.422432 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0ff4dc-a25e-43d8-aa11-2492a69e02db None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:47:39.422531 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0ff4dc-a25e-43d8-aa11-2492a69e02db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:47:39.444813 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-7e0ff4dc-a25e-43d8-aa11-2492a69e02db None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:47:39.446154 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-7e0ff4dc-a25e-43d8-aa11-2492a69e02db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:47:39.464457 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:47:39.508025 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1114/2251] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:47:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:47:39.517763 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296436c3-08f0-45b0-bf10-60b2283e4a1e None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:47:39.517968 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296436c3-08f0-45b0-bf10-60b2283e4a1e None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:47:39.518235 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296436c3-08f0-45b0-bf10-60b2283e4a1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:47:39.537838 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-296436c3-08f0-45b0-bf10-60b2283e4a1e None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:47:39.539051 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-296436c3-08f0-45b0-bf10-60b2283e4a1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:47:39.547352 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1138/2252] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:47:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:47:39.551598 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0ff4dc-a25e-43d8-aa11-2492a69e02db None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:47:39.561209 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0ff4dc-a25e-43d8-aa11-2492a69e02db None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:47:39.567583 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a417ff5-62de-47a6-9d6c-6e4eaa7c56b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:47:39.568335 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a417ff5-62de-47a6-9d6c-6e4eaa7c56b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:47:39.568800 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a417ff5-62de-47a6-9d6c-6e4eaa7c56b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:47:39.569165 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a417ff5-62de-47a6-9d6c-6e4eaa7c56b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:47:39.570057 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a417ff5-62de-47a6-9d6c-6e4eaa7c56b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:47:39.570573 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a417ff5-62de-47a6-9d6c-6e4eaa7c56b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:47:39.572910 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a417ff5-62de-47a6-9d6c-6e4eaa7c56b9 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:47:39.586731 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1115/2253] 10.222.0.102 () {58 vars in 1158 bytes} [Mon Aug 1 15:47:39 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:47:39.591052 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296436c3-08f0-45b0-bf10-60b2283e4a1e None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:47:39.600243 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296436c3-08f0-45b0-bf10-60b2283e4a1e None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:47:39.604820 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1082cf00-acc5-4bc5-a1d0-7a0718ac524e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:47:39.605455 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1082cf00-acc5-4bc5-a1d0-7a0718ac524e admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:47:39.605726 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1082cf00-acc5-4bc5-a1d0-7a0718ac524e admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:47:39.605986 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1082cf00-acc5-4bc5-a1d0-7a0718ac524e admin admin] PATH_INFO: `/v3/projects` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:47:39.606639 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1082cf00-acc5-4bc5-a1d0-7a0718ac524e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:47:39.608526 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1082cf00-acc5-4bc5-a1d0-7a0718ac524e admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:47:39.733384 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1139/2254] 10.222.0.102 () {60 vars in 1158 bytes} [Mon Aug 1 15:47:39 2022] POST /identity/v3/projects => generated 386 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:47:39.734359 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a417ff5-62de-47a6-9d6c-6e4eaa7c56b9 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:47:39.744546 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a417ff5-62de-47a6-9d6c-6e4eaa7c56b9 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:47:39.810480 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64eb180-7723-44d8-8426-a273d9ec6790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:47:39.811078 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64eb180-7723-44d8-8426-a273d9ec6790 admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:47:39.811368 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64eb180-7723-44d8-8426-a273d9ec6790 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:47:39.811650 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64eb180-7723-44d8-8426-a273d9ec6790 admin admin] PATH_INFO: `/v3/users` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:47:39.812333 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64eb180-7723-44d8-8426-a273d9ec6790 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:47:39.814873 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64eb180-7723-44d8-8426-a273d9ec6790 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:47:39.967636 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1116/2255] 10.222.0.102 () {60 vars in 1149 bytes} [Mon Aug 1 15:47:39 2022] POST /identity/v3/users => generated 294 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:47:39.971728 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1082cf00-acc5-4bc5-a1d0-7a0718ac524e admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:47:39.983511 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1082cf00-acc5-4bc5-a1d0-7a0718ac524e admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:47:39.988874 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d0d146-4471-4653-a2e3-9e890e3b3615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:47:39.993609 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d0d146-4471-4653-a2e3-9e890e3b3615 admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:47:39.993609 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d0d146-4471-4653-a2e3-9e890e3b3615 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:47:39.993609 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d0d146-4471-4653-a2e3-9e890e3b3615 admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:47:39.993609 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d0d146-4471-4653-a2e3-9e890e3b3615 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:47:39.993609 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d0d146-4471-4653-a2e3-9e890e3b3615 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:47:40.004151 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1140/2256] 10.222.0.102 () {58 vars in 1127 bytes} [Mon Aug 1 15:47:39 2022] GET /identity/v3/roles => generated 1427 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:47:40.008285 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64eb180-7723-44d8-8426-a273d9ec6790 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:47:40.019977 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64eb180-7723-44d8-8426-a273d9ec6790 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:47:40.025171 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09734cdd-8e7c-47ab-ab3b-9b7fde86ac97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:47:40.025898 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09734cdd-8e7c-47ab-ab3b-9b7fde86ac97 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:47:40.026083 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09734cdd-8e7c-47ab-ab3b-9b7fde86ac97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:47:40.026346 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09734cdd-8e7c-47ab-ab3b-9b7fde86ac97 admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:47:40.027082 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09734cdd-8e7c-47ab-ab3b-9b7fde86ac97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:47:40.028949 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09734cdd-8e7c-47ab-ab3b-9b7fde86ac97 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:47:40.066944 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1117/2257] 10.222.0.102 () {58 vars in 1127 bytes} [Mon Aug 1 15:47:40 2022] GET /identity/v3/roles => generated 1427 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:47:40.068138 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d0d146-4471-4653-a2e3-9e890e3b3615 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:47:40.078459 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d0d146-4471-4653-a2e3-9e890e3b3615 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:47:40.083108 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad56691-0349-4eb1-9b3f-0b37d532a1c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:47:40.085384 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad56691-0349-4eb1-9b3f-0b37d532a1c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:47:40.085384 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad56691-0349-4eb1-9b3f-0b37d532a1c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:47:40.085384 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad56691-0349-4eb1-9b3f-0b37d532a1c2 admin admin] PATH_INFO: `/v3/projects/a35e023a0c8141f8b60b8fc3ceae3bbf/users/693b4234e0b24e61a2e67ebe4f286a12/roles/27f5093ac0674d799cdbd17c68482e32` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:47:40.104817 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad56691-0349-4eb1-9b3f-0b37d532a1c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a35e023a0c8141f8b60b8fc3ceae3bbf, user_id=693b4234e0b24e61a2e67ebe4f286a12, role_id=27f5093ac0674d799cdbd17c68482e32)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:47:40.107990 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad56691-0349-4eb1-9b3f-0b37d532a1c2 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:47:40.189710 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1141/2258] 10.222.0.102 () {60 vars in 1488 bytes} [Mon Aug 1 15:47:40 2022] PUT /identity/v3/projects/a35e023a0c8141f8b60b8fc3ceae3bbf/users/693b4234e0b24e61a2e67ebe4f286a12/roles/27f5093ac0674d799cdbd17c68482e32 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:47:40.194806 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa66b4e1-bf81-4242-b174-11efc1a7f7cf None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:47:40.195112 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa66b4e1-bf81-4242-b174-11efc1a7f7cf None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:47:40.195383 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa66b4e1-bf81-4242-b174-11efc1a7f7cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:47:40.216247 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-fa66b4e1-bf81-4242-b174-11efc1a7f7cf None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:47:40.217483 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-fa66b4e1-bf81-4242-b174-11efc1a7f7cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:47:40.280154 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1118/2259] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:47:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 15:47:40.290812 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad56691-0349-4eb1-9b3f-0b37d532a1c2 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:47:40.292568 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-8ad56691-0349-4eb1-9b3f-0b37d532a1c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:47:40.338666 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:47:40.353601 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad56691-0349-4eb1-9b3f-0b37d532a1c2 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:47:40.357253 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941ef204-c62e-44c8-a4e2-376802da1bcd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a856a413100443939fe9b10daa868518', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:47:40.357859 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941ef204-c62e-44c8-a4e2-376802da1bcd service neutron] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:47:40.358135 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941ef204-c62e-44c8-a4e2-376802da1bcd service neutron] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:47:40.358405 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941ef204-c62e-44c8-a4e2-376802da1bcd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:47:40.368596 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941ef204-c62e-44c8-a4e2-376802da1bcd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:47:40.370502 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941ef204-c62e-44c8-a4e2-376802da1bcd service neutron] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:47:40.381190 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1142/2260] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:47:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:47:46.648334 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88c6c9d-0670-4fed-ad98-3d0d4bca9cf5 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:47:46.648888 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88c6c9d-0670-4fed-ad98-3d0d4bca9cf5 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:47:46.649256 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88c6c9d-0670-4fed-ad98-3d0d4bca9cf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:47:46.688590 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-d88c6c9d-0670-4fed-ad98-3d0d4bca9cf5 None None] MFA Rules not processed for user `693b4234e0b24e61a2e67ebe4f286a12`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:47:46.689983 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-d88c6c9d-0670-4fed-ad98-3d0d4bca9cf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:47:46.711579 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:47:46.800258 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1119/2261] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:47:46 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:47:46.808058 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941ef204-c62e-44c8-a4e2-376802da1bcd service neutron] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:47:46.827561 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941ef204-c62e-44c8-a4e2-376802da1bcd service neutron] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:47:46.832749 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafb3d64-6b42-4636-a6eb-fa9444b5528a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:47:46.834725 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafb3d64-6b42-4636-a6eb-fa9444b5528a admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:47:46.834725 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafb3d64-6b42-4636-a6eb-fa9444b5528a admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:47:46.834725 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafb3d64-6b42-4636-a6eb-fa9444b5528a admin admin] PATH_INFO: `/v3/projects` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:47:46.834986 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafb3d64-6b42-4636-a6eb-fa9444b5528a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:47:46.836930 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafb3d64-6b42-4636-a6eb-fa9444b5528a admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:47:46.941056 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1143/2262] 10.222.0.102 () {60 vars in 1158 bytes} [Mon Aug 1 15:47:46 2022] POST /identity/v3/projects => generated 386 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 15:47:46.945138 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88c6c9d-0670-4fed-ad98-3d0d4bca9cf5 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:47:46.957828 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88c6c9d-0670-4fed-ad98-3d0d4bca9cf5 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:47:47.025338 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1198b5-83ac-4d62-ad05-03d0c49eeb03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:47:47.026149 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1198b5-83ac-4d62-ad05-03d0c49eeb03 admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:47:47.026500 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1198b5-83ac-4d62-ad05-03d0c49eeb03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:47:47.026841 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1198b5-83ac-4d62-ad05-03d0c49eeb03 admin admin] PATH_INFO: `/v3/users` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:47:47.027604 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1198b5-83ac-4d62-ad05-03d0c49eeb03 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:47:47.029691 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1198b5-83ac-4d62-ad05-03d0c49eeb03 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:47:47.133995 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1120/2263] 10.222.0.102 () {60 vars in 1149 bytes} [Mon Aug 1 15:47:46 2022] POST /identity/v3/users => generated 300 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 15:47:47.137493 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafb3d64-6b42-4636-a6eb-fa9444b5528a admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:47:47.149693 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafb3d64-6b42-4636-a6eb-fa9444b5528a admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:47:47.154534 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b715fa-1f7d-4b65-9a70-2d8ff98d23ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:47:47.155152 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b715fa-1f7d-4b65-9a70-2d8ff98d23ec admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:47:47.155434 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b715fa-1f7d-4b65-9a70-2d8ff98d23ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:47:47.155707 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b715fa-1f7d-4b65-9a70-2d8ff98d23ec admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:47:47.156403 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b715fa-1f7d-4b65-9a70-2d8ff98d23ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:47:47.158092 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b715fa-1f7d-4b65-9a70-2d8ff98d23ec admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:47:47.170387 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1144/2264] 10.222.0.102 () {58 vars in 1127 bytes} [Mon Aug 1 15:47:47 2022] GET /identity/v3/roles => generated 1427 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:47:47.174703 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1198b5-83ac-4d62-ad05-03d0c49eeb03 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:47:47.185654 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1198b5-83ac-4d62-ad05-03d0c49eeb03 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:47:47.191611 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaae3ccc-5158-45b0-b274-ccfcff95f1b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:47:47.192424 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaae3ccc-5158-45b0-b274-ccfcff95f1b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:47:47.192708 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaae3ccc-5158-45b0-b274-ccfcff95f1b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:47:47.193030 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaae3ccc-5158-45b0-b274-ccfcff95f1b1 admin admin] PATH_INFO: `/v3/projects/b92228d8cf094066a59975816f2f8d90/users/68f28a2547fa4da2b63f541ed56ebdaa/roles/de1374f966c04c27b579515b54334fd2` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:47:47.219230 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaae3ccc-5158-45b0-b274-ccfcff95f1b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b92228d8cf094066a59975816f2f8d90, user_id=68f28a2547fa4da2b63f541ed56ebdaa, role_id=de1374f966c04c27b579515b54334fd2)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:47:47.224281 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaae3ccc-5158-45b0-b274-ccfcff95f1b1 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:47:47.304202 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1121/2265] 10.222.0.102 () {60 vars in 1488 bytes} [Mon Aug 1 15:47:47 2022] PUT /identity/v3/projects/b92228d8cf094066a59975816f2f8d90/users/68f28a2547fa4da2b63f541ed56ebdaa/roles/de1374f966c04c27b579515b54334fd2 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 15:47:47.308343 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b715fa-1f7d-4b65-9a70-2d8ff98d23ec admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:47:47.319560 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b715fa-1f7d-4b65-9a70-2d8ff98d23ec admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:47:47.379098 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbc7770-9e18-408a-a1e3-5699cfb0149d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:47:47.379728 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbc7770-9e18-408a-a1e3-5699cfb0149d admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:47:47.380007 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbc7770-9e18-408a-a1e3-5699cfb0149d admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:47:47.380343 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbc7770-9e18-408a-a1e3-5699cfb0149d admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:47:47.381142 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbc7770-9e18-408a-a1e3-5699cfb0149d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:47:47.382933 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbc7770-9e18-408a-a1e3-5699cfb0149d admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:47:47.395757 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1145/2266] 10.222.0.102 () {58 vars in 1127 bytes} [Mon Aug 1 15:47:47 2022] GET /identity/v3/roles => generated 1427 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:47:47.399936 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaae3ccc-5158-45b0-b274-ccfcff95f1b1 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:47:47.411381 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaae3ccc-5158-45b0-b274-ccfcff95f1b1 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:47:47.416277 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6086c3-bb10-4685-aafa-30d8611be4ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:47:47.416982 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6086c3-bb10-4685-aafa-30d8611be4ba admin admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:47:47.417266 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6086c3-bb10-4685-aafa-30d8611be4ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:47:47.417547 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6086c3-bb10-4685-aafa-30d8611be4ba admin admin] PATH_INFO: `/v3/projects/b92228d8cf094066a59975816f2f8d90/users/68f28a2547fa4da2b63f541ed56ebdaa/roles/de1374f966c04c27b579515b54334fd2` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:47:47.419566 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6086c3-bb10-4685-aafa-30d8611be4ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=b92228d8cf094066a59975816f2f8d90, user_id=68f28a2547fa4da2b63f541ed56ebdaa, role_id=de1374f966c04c27b579515b54334fd2)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:47:47.423144 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6086c3-bb10-4685-aafa-30d8611be4ba admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:47:47.434089 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1122/2267] 10.222.0.102 () {60 vars in 1488 bytes} [Mon Aug 1 15:47:47 2022] PUT /identity/v3/projects/b92228d8cf094066a59975816f2f8d90/users/68f28a2547fa4da2b63f541ed56ebdaa/roles/de1374f966c04c27b579515b54334fd2 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:47:53.887658 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192c56f1-7883-4bb0-a1ab-0321927fb08d None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:47:53.888150 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192c56f1-7883-4bb0-a1ab-0321927fb08d None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:47:53.888247 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192c56f1-7883-4bb0-a1ab-0321927fb08d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:47:53.916663 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-192c56f1-7883-4bb0-a1ab-0321927fb08d None None] MFA Rules not processed for user `68f28a2547fa4da2b63f541ed56ebdaa`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:47:53.917899 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-192c56f1-7883-4bb0-a1ab-0321927fb08d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:47:53.986092 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1146/2268] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:47:53 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:47:54.004163 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6086c3-bb10-4685-aafa-30d8611be4ba admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:47:54.005991 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-ae6086c3-bb10-4685-aafa-30d8611be4ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:47:54.101341 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6086c3-bb10-4685-aafa-30d8611be4ba admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:47:54.104949 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e2aecc-f3d6-42f5-8e01-51ea1a2c4239 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '613da2657ae34558b355cac53c8bf29a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:47:54.105564 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e2aecc-f3d6-42f5-8e01-51ea1a2c4239 service glance] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:47:54.105845 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e2aecc-f3d6-42f5-8e01-51ea1a2c4239 service glance] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:47:54.106143 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e2aecc-f3d6-42f5-8e01-51ea1a2c4239 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:47:54.110315 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:47:54.168449 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e2aecc-f3d6-42f5-8e01-51ea1a2c4239 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:47:54.169935 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e2aecc-f3d6-42f5-8e01-51ea1a2c4239 service glance] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:47:54.180667 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1123/2269] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:47:54 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:47:54.494984 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b596c9a-22da-40aa-82e1-9e3ae2459421 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:47:54.495391 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b596c9a-22da-40aa-82e1-9e3ae2459421 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:47:54.495670 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b596c9a-22da-40aa-82e1-9e3ae2459421 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:47:54.515435 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-2b596c9a-22da-40aa-82e1-9e3ae2459421 None None] MFA Rules not processed for user `ae8514df55144c9086ed98ba44efbbd4`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:47:54.517303 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-2b596c9a-22da-40aa-82e1-9e3ae2459421 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:47:54.544001 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:47:54.576066 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1147/2270] 10.222.0.102 () {58 vars in 1014 bytes} [Mon Aug 1 15:47:54 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:47:54.589059 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e2aecc-f3d6-42f5-8e01-51ea1a2c4239 service glance] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:47:54.590505 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-58e2aecc-f3d6-42f5-8e01-51ea1a2c4239 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:47:54.663317 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e2aecc-f3d6-42f5-8e01-51ea1a2c4239 service glance] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:47:54.668358 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b05bd5-e27e-43f6-b200-4501e5522dba service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90673f47354f4403aa0e12e3658441c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:47:54.668995 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b05bd5-e27e-43f6-b200-4501e5522dba service swift] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:47:54.669280 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b05bd5-e27e-43f6-b200-4501e5522dba service swift] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:47:54.669553 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b05bd5-e27e-43f6-b200-4501e5522dba service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:47:54.677984 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b05bd5-e27e-43f6-b200-4501e5522dba service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:47:54.679578 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b05bd5-e27e-43f6-b200-4501e5522dba service swift] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:47:54.687870 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1124/2271] 10.222.0.102 () {60 vars in 1389 bytes} [Mon Aug 1 15:47:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 01 15:48:04.662579 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=12 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:48:04.684372 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=57 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:48:06.507526 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14c1788-de2b-4743-9fa2-92cf6db511dd None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:48:06.508067 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14c1788-de2b-4743-9fa2-92cf6db511dd None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:48:06.508067 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14c1788-de2b-4743-9fa2-92cf6db511dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:48:06.527777 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-b14c1788-de2b-4743-9fa2-92cf6db511dd None None] MFA Rules not processed for user `693b4234e0b24e61a2e67ebe4f286a12`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:48:06.528949 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-b14c1788-de2b-4743-9fa2-92cf6db511dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:48:06.535724 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1148/2272] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:48:06 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:48:09.098038 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b05bd5-e27e-43f6-b200-4501e5522dba service swift] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:48:09.099440 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-91b05bd5-e27e-43f6-b200-4501e5522dba service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:48:09.167984 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b05bd5-e27e-43f6-b200-4501e5522dba service swift] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:48:09.173710 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1196b323-9aef-45f4-9c49-23401acb2701 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b78f5749fe9c46a389c88bb9c222cc73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:48:09.175292 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1196b323-9aef-45f4-9c49-23401acb2701 service placement] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:48:09.175292 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1196b323-9aef-45f4-9c49-23401acb2701 service placement] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:48:09.175292 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1196b323-9aef-45f4-9c49-23401acb2701 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:48:09.176568 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-1196b323-9aef-45f4-9c49-23401acb2701 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:48:09.187912 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1196b323-9aef-45f4-9c49-23401acb2701 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:48:09.190054 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1196b323-9aef-45f4-9c49-23401acb2701 service placement] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:48:09.200066 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1125/2273] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:48:09 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:48:11.103031 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318ceab0-1b4b-444f-b42a-7fba1f631a28 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:48:11.103537 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318ceab0-1b4b-444f-b42a-7fba1f631a28 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:48:11.103631 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318ceab0-1b4b-444f-b42a-7fba1f631a28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:48:11.123848 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-318ceab0-1b4b-444f-b42a-7fba1f631a28 None None] MFA Rules not processed for user `ae8514df55144c9086ed98ba44efbbd4`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:48:11.125062 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-318ceab0-1b4b-444f-b42a-7fba1f631a28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:48:11.132070 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1149/2274] 10.222.0.102 () {58 vars in 1014 bytes} [Mon Aug 1 15:48:11 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:48:11.143888 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1196b323-9aef-45f4-9c49-23401acb2701 service placement] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:48:11.155760 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1196b323-9aef-45f4-9c49-23401acb2701 service placement] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:48:11.161256 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a79d10-e418-4020-8ae0-acfdec637c2a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90673f47354f4403aa0e12e3658441c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:48:11.162577 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a79d10-e418-4020-8ae0-acfdec637c2a service swift] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:48:11.162577 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a79d10-e418-4020-8ae0-acfdec637c2a service swift] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:48:11.162577 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a79d10-e418-4020-8ae0-acfdec637c2a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:48:11.170463 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a79d10-e418-4020-8ae0-acfdec637c2a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:48:11.172025 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a79d10-e418-4020-8ae0-acfdec637c2a service swift] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:48:11.180835 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1126/2275] 10.222.0.102 () {60 vars in 1389 bytes} [Mon Aug 1 15:48:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 01 15:48:21.119197 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=6 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:48:21.177604 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=38 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:48:48.524731 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318ceab0-1b4b-444f-b42a-7fba1f631a28 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:48:48.581279 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318ceab0-1b4b-444f-b42a-7fba1f631a28 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:48:48.584822 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a146aa0a-b4e7-4264-9995-8583d9c3e63f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a856a413100443939fe9b10daa868518', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:48:48.585450 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a146aa0a-b4e7-4264-9995-8583d9c3e63f service neutron] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:48:48.585724 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a146aa0a-b4e7-4264-9995-8583d9c3e63f service neutron] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:48:48.585990 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a146aa0a-b4e7-4264-9995-8583d9c3e63f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:48:48.596286 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a146aa0a-b4e7-4264-9995-8583d9c3e63f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:48:48.597783 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a146aa0a-b4e7-4264-9995-8583d9c3e63f service neutron] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:48:48.608228 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1150/2276] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:48:48 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:48:54.145659 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760f9da7-9fe0-4eb8-8f62-1cafe99c0541 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:48:54.146291 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760f9da7-9fe0-4eb8-8f62-1cafe99c0541 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:48:54.146829 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760f9da7-9fe0-4eb8-8f62-1cafe99c0541 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:48:54.168045 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-760f9da7-9fe0-4eb8-8f62-1cafe99c0541 None None] MFA Rules not processed for user `ae8514df55144c9086ed98ba44efbbd4`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:48:54.169982 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-760f9da7-9fe0-4eb8-8f62-1cafe99c0541 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:48:54.177642 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1127/2277] 10.222.0.102 () {58 vars in 1014 bytes} [Mon Aug 1 15:48:54 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:48:54.204745 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a146aa0a-b4e7-4264-9995-8583d9c3e63f service neutron] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:48:54.216309 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a146aa0a-b4e7-4264-9995-8583d9c3e63f service neutron] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:48:54.222008 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09977ee-5a6c-497a-a567-b30778f4135f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90673f47354f4403aa0e12e3658441c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:48:54.222918 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09977ee-5a6c-497a-a567-b30778f4135f service swift] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:48:54.223083 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09977ee-5a6c-497a-a567-b30778f4135f service swift] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:48:54.223438 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09977ee-5a6c-497a-a567-b30778f4135f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:48:54.233564 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09977ee-5a6c-497a-a567-b30778f4135f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:48:54.235800 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09977ee-5a6c-497a-a567-b30778f4135f service swift] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:48:54.245864 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1151/2278] 10.222.0.102 () {60 vars in 1389 bytes} [Mon Aug 1 15:48:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 01 15:49:04.161630 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=3 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:49:04.242370 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=32 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:49:10.779731 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d686f294-f144-4669-9c20-a101afa89e07 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:49:10.780199 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d686f294-f144-4669-9c20-a101afa89e07 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:49:10.780443 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d686f294-f144-4669-9c20-a101afa89e07 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:49:10.781866 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1128/2279] 10.222.0.102 () {54 vars in 926 bytes} [Mon Aug 1 15:49:10 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 15:49:10.788826 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982a1592-c58a-467f-b515-a9bf4d4dd593 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:49:10.789307 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982a1592-c58a-467f-b515-a9bf4d4dd593 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:49:10.789435 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982a1592-c58a-467f-b515-a9bf4d4dd593 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:49:10.808541 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-982a1592-c58a-467f-b515-a9bf4d4dd593 None None] MFA Rules not processed for user `77b43f1ee8cc4be3907a494abe90c1cc`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:49:10.809775 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-982a1592-c58a-467f-b515-a9bf4d4dd593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:49:10.878976 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1152/2280] 10.222.0.102 () {58 vars in 1023 bytes} [Mon Aug 1 15:49:10 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 15:49:10.891334 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d686f294-f144-4669-9c20-a101afa89e07 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:49:10.902479 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d686f294-f144-4669-9c20-a101afa89e07 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:49:10.905921 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfad7425-c4d4-4454-9e56-5e1d2962a574 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '613da2657ae34558b355cac53c8bf29a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:49:10.906525 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfad7425-c4d4-4454-9e56-5e1d2962a574 service glance] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:49:10.906809 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfad7425-c4d4-4454-9e56-5e1d2962a574 service glance] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:49:10.907084 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfad7425-c4d4-4454-9e56-5e1d2962a574 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:49:10.917076 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfad7425-c4d4-4454-9e56-5e1d2962a574 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:49:10.918496 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfad7425-c4d4-4454-9e56-5e1d2962a574 service glance] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:49:10.929117 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1129/2281] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:49:10 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:49:11.111566 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59627b92-6f13-4ef9-8a3b-2fc0bcc69161 None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:49:11.111853 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59627b92-6f13-4ef9-8a3b-2fc0bcc69161 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:49:11.112158 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59627b92-6f13-4ef9-8a3b-2fc0bcc69161 None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:49:11.113550 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1153/2282] 10.222.0.102 () {54 vars in 926 bytes} [Mon Aug 1 15:49:11 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 15:49:11.118965 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c913a5d0-9d1b-4a59-a763-e0e072ce2c9b None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:49:11.119257 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c913a5d0-9d1b-4a59-a763-e0e072ce2c9b None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:49:11.119561 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c913a5d0-9d1b-4a59-a763-e0e072ce2c9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:49:11.140550 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-c913a5d0-9d1b-4a59-a763-e0e072ce2c9b None None] MFA Rules not processed for user `a856a413100443939fe9b10daa868518`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:49:11.141812 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-c913a5d0-9d1b-4a59-a763-e0e072ce2c9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:49:11.148388 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1130/2283] 10.222.0.102 () {58 vars in 1023 bytes} [Mon Aug 1 15:49:11 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:49:11.160011 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59627b92-6f13-4ef9-8a3b-2fc0bcc69161 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:49:11.170902 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59627b92-6f13-4ef9-8a3b-2fc0bcc69161 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:49:11.174481 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692a8580-d23c-4740-a407-7b6cf07881db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a856a413100443939fe9b10daa868518', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:49:11.175075 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692a8580-d23c-4740-a407-7b6cf07881db service neutron] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:49:11.175354 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692a8580-d23c-4740-a407-7b6cf07881db service neutron] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:49:11.175630 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692a8580-d23c-4740-a407-7b6cf07881db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:49:11.183234 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692a8580-d23c-4740-a407-7b6cf07881db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:49:11.184656 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692a8580-d23c-4740-a407-7b6cf07881db service neutron] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:49:11.192368 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1154/2284] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:49:11 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:49:11.275532 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f90ad5-1356-49b1-b63c-412b01e58cb0 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:49:11.275822 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f90ad5-1356-49b1-b63c-412b01e58cb0 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:49:11.276099 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f90ad5-1356-49b1-b63c-412b01e58cb0 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:49:11.277525 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1131/2285] 10.222.0.102 () {54 vars in 926 bytes} [Mon Aug 1 15:49:11 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 15:49:11.282759 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a525d934-062a-47bc-90fe-5308dd97f429 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:49:11.283038 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a525d934-062a-47bc-90fe-5308dd97f429 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:49:11.283306 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a525d934-062a-47bc-90fe-5308dd97f429 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:49:11.303009 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-a525d934-062a-47bc-90fe-5308dd97f429 None None] MFA Rules not processed for user `77b43f1ee8cc4be3907a494abe90c1cc`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:49:11.304188 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-a525d934-062a-47bc-90fe-5308dd97f429 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:49:11.313361 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1155/2286] 10.222.0.102 () {58 vars in 1023 bytes} [Mon Aug 1 15:49:11 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:49:11.323785 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f90ad5-1356-49b1-b63c-412b01e58cb0 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:49:11.334885 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f90ad5-1356-49b1-b63c-412b01e58cb0 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:49:11.339189 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a831f4-9292-4ff0-ae2c-dc816f0c5039 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a856a413100443939fe9b10daa868518', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:49:11.339796 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a831f4-9292-4ff0-ae2c-dc816f0c5039 service neutron] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:49:11.340078 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a831f4-9292-4ff0-ae2c-dc816f0c5039 service neutron] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:49:11.340352 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a831f4-9292-4ff0-ae2c-dc816f0c5039 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:49:11.350702 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a831f4-9292-4ff0-ae2c-dc816f0c5039 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:49:11.352118 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a831f4-9292-4ff0-ae2c-dc816f0c5039 service neutron] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:49:11.363453 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1132/2287] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:49:11 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:49:14.923083 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec30c18c-d466-467f-bbb7-ec21f2c05055 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:49:14.923557 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec30c18c-d466-467f-bbb7-ec21f2c05055 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:49:14.923654 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec30c18c-d466-467f-bbb7-ec21f2c05055 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:49:14.943173 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-ec30c18c-d466-467f-bbb7-ec21f2c05055 None None] MFA Rules not processed for user `ae8514df55144c9086ed98ba44efbbd4`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:49:14.944383 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-ec30c18c-d466-467f-bbb7-ec21f2c05055 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:49:14.952815 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1156/2288] 10.222.0.102 () {58 vars in 1014 bytes} [Mon Aug 1 15:49:14 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:49:14.964674 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a831f4-9292-4ff0-ae2c-dc816f0c5039 service neutron] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:49:14.977519 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a831f4-9292-4ff0-ae2c-dc816f0c5039 service neutron] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:49:14.981353 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91981c7d-df40-4a21-bda8-8a7fc474d8d6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90673f47354f4403aa0e12e3658441c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:49:14.981958 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91981c7d-df40-4a21-bda8-8a7fc474d8d6 service swift] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:49:14.982257 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91981c7d-df40-4a21-bda8-8a7fc474d8d6 service swift] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:49:14.982560 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91981c7d-df40-4a21-bda8-8a7fc474d8d6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:49:14.991182 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91981c7d-df40-4a21-bda8-8a7fc474d8d6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:49:14.993363 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91981c7d-df40-4a21-bda8-8a7fc474d8d6 service swift] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:49:15.001554 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1133/2289] 10.222.0.102 () {60 vars in 1389 bytes} [Mon Aug 1 15:49:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 01 15:49:24.938478 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=43 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:49:24.998371 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=21 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:49:40.025219 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec30c18c-d466-467f-bbb7-ec21f2c05055 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:49:40.026647 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-ec30c18c-d466-467f-bbb7-ec21f2c05055 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:49:40.085363 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec30c18c-d466-467f-bbb7-ec21f2c05055 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:49:40.089615 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fcf865-f402-4e26-a6e3-dde6c594361b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff810b37183c4729859c1b05edff1703', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:49:40.090236 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fcf865-f402-4e26-a6e3-dde6c594361b service cinder] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:49:40.090511 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fcf865-f402-4e26-a6e3-dde6c594361b service cinder] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:49:40.090810 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fcf865-f402-4e26-a6e3-dde6c594361b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:49:40.092565 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-b1fcf865-f402-4e26-a6e3-dde6c594361b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:49:40.107448 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fcf865-f402-4e26-a6e3-dde6c594361b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:49:40.108563 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fcf865-f402-4e26-a6e3-dde6c594361b service cinder] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:49:40.119791 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1157/2290] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:49:40 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:49:40.917219 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91981c7d-df40-4a21-bda8-8a7fc474d8d6 service swift] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:49:41.085678 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91981c7d-df40-4a21-bda8-8a7fc474d8d6 service swift] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:49:41.085678 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80870b08-a109-4af4-a2eb-ef3a98a8a72c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a856a413100443939fe9b10daa868518', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:49:41.085678 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80870b08-a109-4af4-a2eb-ef3a98a8a72c service neutron] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:49:41.085678 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80870b08-a109-4af4-a2eb-ef3a98a8a72c service neutron] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:49:41.086484 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80870b08-a109-4af4-a2eb-ef3a98a8a72c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:49:41.086484 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-80870b08-a109-4af4-a2eb-ef3a98a8a72c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:49:41.086484 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80870b08-a109-4af4-a2eb-ef3a98a8a72c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:49:41.086484 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80870b08-a109-4af4-a2eb-ef3a98a8a72c service neutron] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:49:41.086484 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1134/2291] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:49:40 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:49:43.055151 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333cd670-9ad2-495e-9ee6-ea735e5bcb18 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:49:43.056021 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333cd670-9ad2-495e-9ee6-ea735e5bcb18 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:49:43.056475 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333cd670-9ad2-495e-9ee6-ea735e5bcb18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:49:43.077620 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-333cd670-9ad2-495e-9ee6-ea735e5bcb18 None None] MFA Rules not processed for user `ae8514df55144c9086ed98ba44efbbd4`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:49:43.081176 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-333cd670-9ad2-495e-9ee6-ea735e5bcb18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:49:43.089053 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1158/2292] 10.222.0.102 () {58 vars in 972 bytes} [Mon Aug 1 15:49:43 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:49:43.108355 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80870b08-a109-4af4-a2eb-ef3a98a8a72c service neutron] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:49:43.120761 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80870b08-a109-4af4-a2eb-ef3a98a8a72c service neutron] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:49:43.126540 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6416e1-6cf7-4659-a113-b3c7ebc58a2c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90673f47354f4403aa0e12e3658441c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:49:43.127306 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6416e1-6cf7-4659-a113-b3c7ebc58a2c service swift] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:49:43.127732 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6416e1-6cf7-4659-a113-b3c7ebc58a2c service swift] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:49:43.128227 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6416e1-6cf7-4659-a113-b3c7ebc58a2c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:49:43.138210 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6416e1-6cf7-4659-a113-b3c7ebc58a2c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:49:43.139927 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6416e1-6cf7-4659-a113-b3c7ebc58a2c service swift] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:49:43.157386 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1135/2293] 10.222.0.102 () {60 vars in 1389 bytes} [Mon Aug 1 15:49:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 01 15:49:51.817056 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333cd670-9ad2-495e-9ee6-ea735e5bcb18 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:49:51.818836 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-333cd670-9ad2-495e-9ee6-ea735e5bcb18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:49:51.834564 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333cd670-9ad2-495e-9ee6-ea735e5bcb18 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:49:51.840582 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da5a881-2277-4521-9ac8-eb6a9bda14cc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77b43f1ee8cc4be3907a494abe90c1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:49:51.841238 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da5a881-2277-4521-9ac8-eb6a9bda14cc service nova] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:49:51.841517 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da5a881-2277-4521-9ac8-eb6a9bda14cc service nova] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:49:51.842239 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da5a881-2277-4521-9ac8-eb6a9bda14cc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:49:51.843654 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-5da5a881-2277-4521-9ac8-eb6a9bda14cc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:49:51.915690 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da5a881-2277-4521-9ac8-eb6a9bda14cc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:49:51.917325 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da5a881-2277-4521-9ac8-eb6a9bda14cc service nova] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:49:51.926457 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1159/2294] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:49:51 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:49:53.145525 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=12 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:49:55.248445 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6416e1-6cf7-4659-a113-b3c7ebc58a2c service swift] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:49:55.260922 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6416e1-6cf7-4659-a113-b3c7ebc58a2c service swift] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:49:55.266427 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64106c7-b726-459f-afdb-d5893a8ca5ad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77b43f1ee8cc4be3907a494abe90c1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:49:55.267031 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64106c7-b726-459f-afdb-d5893a8ca5ad service nova] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:49:55.267312 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64106c7-b726-459f-afdb-d5893a8ca5ad service nova] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:49:55.267587 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64106c7-b726-459f-afdb-d5893a8ca5ad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:49:55.269367 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-d64106c7-b726-459f-afdb-d5893a8ca5ad service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:49:55.341878 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64106c7-b726-459f-afdb-d5893a8ca5ad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:49:55.343479 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64106c7-b726-459f-afdb-d5893a8ca5ad service nova] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:49:55.352831 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1136/2295] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:49:55 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:49:57.594607 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598e2942-3d95-4d35-923d-c70c53cac2c5 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:49:57.595084 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598e2942-3d95-4d35-923d-c70c53cac2c5 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:49:57.595196 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598e2942-3d95-4d35-923d-c70c53cac2c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:49:57.614745 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-598e2942-3d95-4d35-923d-c70c53cac2c5 None None] MFA Rules not processed for user `d60a67da3f284a469d374b8f1d93ea45`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:49:57.615995 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-598e2942-3d95-4d35-923d-c70c53cac2c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:49:57.671575 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1160/2296] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:49:57 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:49:59.599639 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64106c7-b726-459f-afdb-d5893a8ca5ad service nova] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:49:59.601203 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-d64106c7-b726-459f-afdb-d5893a8ca5ad service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:49:59.616150 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64106c7-b726-459f-afdb-d5893a8ca5ad service nova] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:49:59.622318 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e038ca-a869-48c0-ad87-a4b33358a75e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77b43f1ee8cc4be3907a494abe90c1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:49:59.626207 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e038ca-a869-48c0-ad87-a4b33358a75e service nova] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:49:59.626207 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e038ca-a869-48c0-ad87-a4b33358a75e service nova] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:49:59.626207 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e038ca-a869-48c0-ad87-a4b33358a75e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:49:59.626207 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-48e038ca-a869-48c0-ad87-a4b33358a75e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:49:59.635391 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e038ca-a869-48c0-ad87-a4b33358a75e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:49:59.636994 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e038ca-a869-48c0-ad87-a4b33358a75e service nova] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:49:59.646895 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1137/2297] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:49:59 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:50:02.660285 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0f3e66-06b8-4099-9c57-5be49839fd21 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:50:02.660841 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0f3e66-06b8-4099-9c57-5be49839fd21 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:50:02.660996 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0f3e66-06b8-4099-9c57-5be49839fd21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:50:02.686366 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-af0f3e66-06b8-4099-9c57-5be49839fd21 None None] MFA Rules not processed for user `82ab36c0e0804e4d8aaff377095aade7`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:50:02.687561 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-af0f3e66-06b8-4099-9c57-5be49839fd21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:50:02.695971 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1161/2298] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:50:02 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:50:09.642147 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=34 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:50:11.256544 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e038ca-a869-48c0-ad87-a4b33358a75e service nova] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:50:11.258081 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-48e038ca-a869-48c0-ad87-a4b33358a75e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:50:11.271921 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e038ca-a869-48c0-ad87-a4b33358a75e service nova] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:50:11.275586 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6401fdfe-509b-4a0c-8221-556bf5200d69 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a856a413100443939fe9b10daa868518', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:50:11.276193 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6401fdfe-509b-4a0c-8221-556bf5200d69 service neutron] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:50:11.276470 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6401fdfe-509b-4a0c-8221-556bf5200d69 service neutron] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:50:11.276739 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6401fdfe-509b-4a0c-8221-556bf5200d69 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:50:11.278816 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-6401fdfe-509b-4a0c-8221-556bf5200d69 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:50:11.288956 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6401fdfe-509b-4a0c-8221-556bf5200d69 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:50:11.290482 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6401fdfe-509b-4a0c-8221-556bf5200d69 service neutron] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:50:11.301152 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1138/2299] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:50:11 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:50:12.681304 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=85 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:50:18.392725 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0f3e66-06b8-4099-9c57-5be49839fd21 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:50:18.406350 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0f3e66-06b8-4099-9c57-5be49839fd21 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:50:18.411828 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba84aed3-9a04-4356-bb10-c5856b6c20ac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77b43f1ee8cc4be3907a494abe90c1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:50:18.412432 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba84aed3-9a04-4356-bb10-c5856b6c20ac service nova] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:50:18.412704 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba84aed3-9a04-4356-bb10-c5856b6c20ac service nova] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:50:18.412999 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba84aed3-9a04-4356-bb10-c5856b6c20ac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:50:18.414786 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-ba84aed3-9a04-4356-bb10-c5856b6c20ac service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:50:18.427203 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba84aed3-9a04-4356-bb10-c5856b6c20ac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:50:18.429027 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba84aed3-9a04-4356-bb10-c5856b6c20ac service nova] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:50:18.440435 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1162/2300] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:50:18 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:50:21.296478 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=6 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:50:28.435595 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=6 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:50:59.183689 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6401fdfe-509b-4a0c-8221-556bf5200d69 service neutron] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:50:59.197662 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6401fdfe-509b-4a0c-8221-556bf5200d69 service neutron] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:50:59.205072 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86bc8b6-60c7-4e68-85b3-9accd7b132b7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77b43f1ee8cc4be3907a494abe90c1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:50:59.206078 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86bc8b6-60c7-4e68-85b3-9accd7b132b7 service nova] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:50:59.206548 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86bc8b6-60c7-4e68-85b3-9accd7b132b7 service nova] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:50:59.207010 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86bc8b6-60c7-4e68-85b3-9accd7b132b7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:50:59.209048 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-b86bc8b6-60c7-4e68-85b3-9accd7b132b7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:50:59.221806 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86bc8b6-60c7-4e68-85b3-9accd7b132b7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:50:59.226015 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86bc8b6-60c7-4e68-85b3-9accd7b132b7 service nova] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:50:59.234855 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1139/2301] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:50:59 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:51:03.458659 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee96fd6-d8f3-45bd-82dd-e4950240b08e None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:51:03.460611 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee96fd6-d8f3-45bd-82dd-e4950240b08e None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:51:03.460611 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee96fd6-d8f3-45bd-82dd-e4950240b08e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:51:03.477845 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-9ee96fd6-d8f3-45bd-82dd-e4950240b08e None None] MFA Rules not processed for user `5a0bf81bcf784878acabeb03ccddcd1b`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:51:03.479076 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-9ee96fd6-d8f3-45bd-82dd-e4950240b08e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:51:03.534039 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1163/2302] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:51:03 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:51:03.849163 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86bc8b6-60c7-4e68-85b3-9accd7b132b7 service nova] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:51:03.859784 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86bc8b6-60c7-4e68-85b3-9accd7b132b7 service nova] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:51:03.863414 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c373b9-6242-49a0-bcd4-2c41eff92cff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a856a413100443939fe9b10daa868518', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:51:03.864025 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c373b9-6242-49a0-bcd4-2c41eff92cff service neutron] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:51:03.864307 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c373b9-6242-49a0-bcd4-2c41eff92cff service neutron] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:51:03.864578 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c373b9-6242-49a0-bcd4-2c41eff92cff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:51:03.866458 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-62c373b9-6242-49a0-bcd4-2c41eff92cff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:51:03.878409 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c373b9-6242-49a0-bcd4-2c41eff92cff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:51:03.880015 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c373b9-6242-49a0-bcd4-2c41eff92cff service neutron] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:51:03.888461 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1140/2303] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:51:03 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:51:04.298693 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee96fd6-d8f3-45bd-82dd-e4950240b08e None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:51:04.312878 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee96fd6-d8f3-45bd-82dd-e4950240b08e None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:51:04.320149 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2165b458-5802-44f0-bc47-23e95aae45c2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b78f5749fe9c46a389c88bb9c222cc73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:51:04.320786 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2165b458-5802-44f0-bc47-23e95aae45c2 service placement] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:51:04.321163 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2165b458-5802-44f0-bc47-23e95aae45c2 service placement] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:51:04.321498 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2165b458-5802-44f0-bc47-23e95aae45c2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:51:04.323323 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-2165b458-5802-44f0-bc47-23e95aae45c2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:51:04.336495 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2165b458-5802-44f0-bc47-23e95aae45c2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:51:04.338072 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2165b458-5802-44f0-bc47-23e95aae45c2 service placement] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:51:04.349734 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1164/2304] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:51:04 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:51:13.884901 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=12 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:51:14.349673 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=31 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:51:14.664879 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c373b9-6242-49a0-bcd4-2c41eff92cff service neutron] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:51:14.678063 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c373b9-6242-49a0-bcd4-2c41eff92cff service neutron] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:51:14.683691 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482949b0-892f-4dad-8e96-1f71bf1c1bad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77b43f1ee8cc4be3907a494abe90c1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:51:14.684530 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482949b0-892f-4dad-8e96-1f71bf1c1bad service nova] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:51:14.684815 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482949b0-892f-4dad-8e96-1f71bf1c1bad service nova] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:51:14.685140 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482949b0-892f-4dad-8e96-1f71bf1c1bad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:51:14.687380 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-482949b0-892f-4dad-8e96-1f71bf1c1bad service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:51:14.700693 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482949b0-892f-4dad-8e96-1f71bf1c1bad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:51:14.702325 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482949b0-892f-4dad-8e96-1f71bf1c1bad service nova] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:51:14.713687 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1141/2305] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:51:14 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:51:24.709113 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=6 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:51:31.380863 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25b40bf-1bf4-41c1-a197-771cbb012d0f None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:51:31.381354 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25b40bf-1bf4-41c1-a197-771cbb012d0f None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:51:31.381460 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25b40bf-1bf4-41c1-a197-771cbb012d0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:51:31.400753 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-d25b40bf-1bf4-41c1-a197-771cbb012d0f None None] MFA Rules not processed for user `d33afc6f3cc746f6a28e60b0c65f6b89`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:51:31.402013 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-d25b40bf-1bf4-41c1-a197-771cbb012d0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:51:31.409816 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1165/2306] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:51:31 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:51:41.396071 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=3 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:51:45.319541 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482949b0-892f-4dad-8e96-1f71bf1c1bad service nova] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:51:45.333349 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482949b0-892f-4dad-8e96-1f71bf1c1bad service nova] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:51:45.337337 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef68bc41-0ae4-4af6-aa61-7f12438afcfb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a856a413100443939fe9b10daa868518', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:51:45.338032 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef68bc41-0ae4-4af6-aa61-7f12438afcfb service neutron] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:51:45.338530 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef68bc41-0ae4-4af6-aa61-7f12438afcfb service neutron] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:51:45.339025 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef68bc41-0ae4-4af6-aa61-7f12438afcfb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:51:45.341962 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-ef68bc41-0ae4-4af6-aa61-7f12438afcfb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:51:45.420235 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef68bc41-0ae4-4af6-aa61-7f12438afcfb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:51:45.421702 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef68bc41-0ae4-4af6-aa61-7f12438afcfb service neutron] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:51:45.431420 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1142/2307] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:51:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:51:51.211887 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25b40bf-1bf4-41c1-a197-771cbb012d0f None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:51:51.213441 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-d25b40bf-1bf4-41c1-a197-771cbb012d0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:51:51.229229 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25b40bf-1bf4-41c1-a197-771cbb012d0f None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:51:51.234801 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e398e8-addf-42ba-8305-e0b8db2caa79 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b78f5749fe9c46a389c88bb9c222cc73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:51:51.235591 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e398e8-addf-42ba-8305-e0b8db2caa79 service placement] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:51:51.236028 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e398e8-addf-42ba-8305-e0b8db2caa79 service placement] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:51:51.239628 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e398e8-addf-42ba-8305-e0b8db2caa79 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:51:51.239628 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-a1e398e8-addf-42ba-8305-e0b8db2caa79 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:51:51.260506 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e398e8-addf-42ba-8305-e0b8db2caa79 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:51:51.262170 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e398e8-addf-42ba-8305-e0b8db2caa79 service placement] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:51:51.273573 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1166/2308] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:51:51 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 15:51:51.335163 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef68bc41-0ae4-4af6-aa61-7f12438afcfb service neutron] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:51:51.337095 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-ef68bc41-0ae4-4af6-aa61-7f12438afcfb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:51:51.350372 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef68bc41-0ae4-4af6-aa61-7f12438afcfb service neutron] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:51:51.355086 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4f0df4-e0e3-4cfe-a7f7-8fff432c9ffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:51:51.355726 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4f0df4-e0e3-4cfe-a7f7-8fff432c9ffd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:51:51.356003 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4f0df4-e0e3-4cfe-a7f7-8fff432c9ffd admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:51:51.356323 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4f0df4-e0e3-4cfe-a7f7-8fff432c9ffd admin admin] PATH_INFO: `/v3/users/82ab36c0e0804e4d8aaff377095aade7` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:51:51.357501 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4f0df4-e0e3-4cfe-a7f7-8fff432c9ffd admin admin] RBAC: Authorizing `identity:delete_user(user_id=82ab36c0e0804e4d8aaff377095aade7)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:51:51.359523 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4f0df4-e0e3-4cfe-a7f7-8fff432c9ffd admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:51:51.538671 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-bf4f0df4-e0e3-4cfe-a7f7-8fff432c9ffd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '82ab36c0e0804e4d8aaff377095aade7'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:51:51.621443 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-bf4f0df4-e0e3-4cfe-a7f7-8fff432c9ffd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '82ab36c0e0804e4d8aaff377095aade7'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:51:51.637222 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-bf4f0df4-e0e3-4cfe-a7f7-8fff432c9ffd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '82ab36c0e0804e4d8aaff377095aade7'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:51:51.640567 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-bf4f0df4-e0e3-4cfe-a7f7-8fff432c9ffd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '82ab36c0e0804e4d8aaff377095aade7'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:51:51.643238 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-bf4f0df4-e0e3-4cfe-a7f7-8fff432c9ffd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '82ab36c0e0804e4d8aaff377095aade7'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:51:51.669817 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1143/2309] 10.222.0.102 () {58 vars in 1229 bytes} [Mon Aug 1 15:51:51 2022] DELETE /identity/v3/users/82ab36c0e0804e4d8aaff377095aade7 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:51:51.940218 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e398e8-addf-42ba-8305-e0b8db2caa79 service placement] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:51:51.957805 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e398e8-addf-42ba-8305-e0b8db2caa79 service placement] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:51:52.034524 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37714af7-9c8d-409f-8e1e-1999e5d742a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:51:52.034524 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37714af7-9c8d-409f-8e1e-1999e5d742a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:51:52.035024 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37714af7-9c8d-409f-8e1e-1999e5d742a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:51:52.035024 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37714af7-9c8d-409f-8e1e-1999e5d742a7 admin admin] PATH_INFO: `/v3/projects/119e3d5823e94fa38f30e8be15f4f98e` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:51:52.036299 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37714af7-9c8d-409f-8e1e-1999e5d742a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=119e3d5823e94fa38f30e8be15f4f98e)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:51:52.038315 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37714af7-9c8d-409f-8e1e-1999e5d742a7 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:51:52.218351 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-37714af7-9c8d-409f-8e1e-1999e5d742a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '119e3d5823e94fa38f30e8be15f4f98e', 'request_id': 'req-37714af7-9c8d-409f-8e1e-1999e5d742a7'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:51:52.230719 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-37714af7-9c8d-409f-8e1e-1999e5d742a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '119e3d5823e94fa38f30e8be15f4f98e', 'request_id': 'req-37714af7-9c8d-409f-8e1e-1999e5d742a7'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:51:52.313126 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-37714af7-9c8d-409f-8e1e-1999e5d742a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '119e3d5823e94fa38f30e8be15f4f98e', 'request_id': 'req-37714af7-9c8d-409f-8e1e-1999e5d742a7'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:51:52.328407 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-37714af7-9c8d-409f-8e1e-1999e5d742a7 admin admin] The token cache is being invalidate because project 119e3d5823e94fa38f30e8be15f4f98e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80352) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 15:51:52.328693 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-37714af7-9c8d-409f-8e1e-1999e5d742a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:51:52.331144 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-37714af7-9c8d-409f-8e1e-1999e5d742a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:51:52.333202 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1167/2310] 10.222.0.102 () {58 vars in 1238 bytes} [Mon Aug 1 15:51:51 2022] DELETE /identity/v3/projects/119e3d5823e94fa38f30e8be15f4f98e => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 15:51:52.338077 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdd419d-bc45-4b68-9dae-814a1b2279fc None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:51:52.338974 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdd419d-bc45-4b68-9dae-814a1b2279fc None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:51:52.339256 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdd419d-bc45-4b68-9dae-814a1b2279fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:51:52.359794 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-9bdd419d-bc45-4b68-9dae-814a1b2279fc None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:51:52.361872 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-9bdd419d-bc45-4b68-9dae-814a1b2279fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:51:52.435841 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1144/2311] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:51:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:51:52.445021 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cc20cf-1982-4097-8ba5-67240706101b None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:51:52.445316 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cc20cf-1982-4097-8ba5-67240706101b None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:51:52.445627 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cc20cf-1982-4097-8ba5-67240706101b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:51:52.467156 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-20cc20cf-1982-4097-8ba5-67240706101b None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:51:52.468394 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-20cc20cf-1982-4097-8ba5-67240706101b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:51:52.477842 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1168/2312] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:51:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:51:52.481999 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdd419d-bc45-4b68-9dae-814a1b2279fc None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:51:52.492894 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdd419d-bc45-4b68-9dae-814a1b2279fc None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:51:52.498889 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4651eb-8b41-4894-a3e9-7213d536e122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:51:52.500007 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4651eb-8b41-4894-a3e9-7213d536e122 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:51:52.500357 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4651eb-8b41-4894-a3e9-7213d536e122 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:51:52.500703 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4651eb-8b41-4894-a3e9-7213d536e122 admin admin] PATH_INFO: `/v3/domains` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:51:52.501934 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4651eb-8b41-4894-a3e9-7213d536e122 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:51:52.502306 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4651eb-8b41-4894-a3e9-7213d536e122 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:51:52.504145 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4651eb-8b41-4894-a3e9-7213d536e122 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:51:52.508149 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:51:52.526400 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1145/2313] 10.222.0.102 () {58 vars in 1158 bytes} [Mon Aug 1 15:51:52 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:51:52.531720 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cc20cf-1982-4097-8ba5-67240706101b None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:51:52.544281 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cc20cf-1982-4097-8ba5-67240706101b None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:51:52.549801 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b4e132-c866-4e0d-bbd2-4c21fb5eae42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:51:52.550430 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b4e132-c866-4e0d-bbd2-4c21fb5eae42 admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:51:52.550708 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b4e132-c866-4e0d-bbd2-4c21fb5eae42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:51:52.550985 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b4e132-c866-4e0d-bbd2-4c21fb5eae42 admin admin] PATH_INFO: `/v3/projects` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:51:52.551647 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b4e132-c866-4e0d-bbd2-4c21fb5eae42 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:51:52.553781 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b4e132-c866-4e0d-bbd2-4c21fb5eae42 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:51:52.681853 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1169/2314] 10.222.0.102 () {60 vars in 1158 bytes} [Mon Aug 1 15:51:52 2022] POST /identity/v3/projects => generated 366 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:51:52.682658 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4651eb-8b41-4894-a3e9-7213d536e122 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:51:52.695163 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4651eb-8b41-4894-a3e9-7213d536e122 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:51:52.760656 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e9bf3f-1b6d-48e4-b06b-22de5abeae86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:51:52.761633 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e9bf3f-1b6d-48e4-b06b-22de5abeae86 admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:51:52.761915 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e9bf3f-1b6d-48e4-b06b-22de5abeae86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:51:52.762192 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e9bf3f-1b6d-48e4-b06b-22de5abeae86 admin admin] PATH_INFO: `/v3/users` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:51:52.762896 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e9bf3f-1b6d-48e4-b06b-22de5abeae86 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:51:52.764870 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e9bf3f-1b6d-48e4-b06b-22de5abeae86 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:51:52.851714 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1146/2315] 10.222.0.102 () {60 vars in 1149 bytes} [Mon Aug 1 15:51:52 2022] POST /identity/v3/users => generated 284 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 15:51:52.855075 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b4e132-c866-4e0d-bbd2-4c21fb5eae42 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:51:52.866997 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b4e132-c866-4e0d-bbd2-4c21fb5eae42 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:51:52.871708 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cfb0c5-1634-495c-8d92-5c75fe3898af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:51:52.872311 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cfb0c5-1634-495c-8d92-5c75fe3898af admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:51:52.872596 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cfb0c5-1634-495c-8d92-5c75fe3898af admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:51:52.872955 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cfb0c5-1634-495c-8d92-5c75fe3898af admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:51:52.873661 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cfb0c5-1634-495c-8d92-5c75fe3898af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:51:52.875465 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cfb0c5-1634-495c-8d92-5c75fe3898af admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:51:52.885970 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1170/2316] 10.222.0.102 () {58 vars in 1127 bytes} [Mon Aug 1 15:51:52 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:51:52.890038 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e9bf3f-1b6d-48e4-b06b-22de5abeae86 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:51:52.900875 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e9bf3f-1b6d-48e4-b06b-22de5abeae86 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:51:52.906659 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824806da-b9cb-4192-a325-12037a40dec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:51:52.907811 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824806da-b9cb-4192-a325-12037a40dec0 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:51:52.908099 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824806da-b9cb-4192-a325-12037a40dec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:51:52.908391 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824806da-b9cb-4192-a325-12037a40dec0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:51:52.909227 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824806da-b9cb-4192-a325-12037a40dec0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:51:52.915042 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824806da-b9cb-4192-a325-12037a40dec0 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:51:52.922638 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1147/2317] 10.222.0.102 () {58 vars in 1127 bytes} [Mon Aug 1 15:51:52 2022] GET /identity/v3/roles => generated 1427 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:51:52.927679 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cfb0c5-1634-495c-8d92-5c75fe3898af admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:51:52.955066 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cfb0c5-1634-495c-8d92-5c75fe3898af admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:51:52.955066 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dc6954-be35-4ad8-98ec-e7d3a65f5bde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:51:52.955066 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dc6954-be35-4ad8-98ec-e7d3a65f5bde admin admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:51:52.955066 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dc6954-be35-4ad8-98ec-e7d3a65f5bde admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:51:52.956338 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dc6954-be35-4ad8-98ec-e7d3a65f5bde admin admin] PATH_INFO: `/v3/projects/f14f20530ff24a238c23d7e1df8ad200/users/0e296ad34b9947cd94d3c1f2d96281d9/roles/27f5093ac0674d799cdbd17c68482e32` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:51:52.962303 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97dc6954-be35-4ad8-98ec-e7d3a65f5bde admin admin] RBAC: Authorizing `identity:create_grant(project_id=f14f20530ff24a238c23d7e1df8ad200, user_id=0e296ad34b9947cd94d3c1f2d96281d9, role_id=27f5093ac0674d799cdbd17c68482e32)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:51:52.965790 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97dc6954-be35-4ad8-98ec-e7d3a65f5bde admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:51:53.130413 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1171/2318] 10.222.0.102 () {60 vars in 1488 bytes} [Mon Aug 1 15:51:52 2022] PUT /identity/v3/projects/f14f20530ff24a238c23d7e1df8ad200/users/0e296ad34b9947cd94d3c1f2d96281d9/roles/27f5093ac0674d799cdbd17c68482e32 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 15:51:53.141506 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacd8d92-428a-422f-9bff-b4803118a77d None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:51:53.142321 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacd8d92-428a-422f-9bff-b4803118a77d None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:51:53.142582 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacd8d92-428a-422f-9bff-b4803118a77d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:51:53.174535 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-cacd8d92-428a-422f-9bff-b4803118a77d None None] MFA Rules not processed for user `0e296ad34b9947cd94d3c1f2d96281d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:51:53.175947 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-cacd8d92-428a-422f-9bff-b4803118a77d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:51:53.258461 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1148/2319] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:51:53 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:51:53.262787 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dc6954-be35-4ad8-98ec-e7d3a65f5bde admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:51:53.278898 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:51:53.330745 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dc6954-be35-4ad8-98ec-e7d3a65f5bde admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:51:53.335862 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61243ea-9c2d-48b9-8e3a-8d5a7810913d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:51:53.341253 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61243ea-9c2d-48b9-8e3a-8d5a7810913d admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:51:53.341253 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61243ea-9c2d-48b9-8e3a-8d5a7810913d admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:51:53.341253 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61243ea-9c2d-48b9-8e3a-8d5a7810913d admin admin] PATH_INFO: `/v3/projects` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:51:53.341253 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61243ea-9c2d-48b9-8e3a-8d5a7810913d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:51:53.341253 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61243ea-9c2d-48b9-8e3a-8d5a7810913d admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:51:53.458048 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1172/2320] 10.222.0.102 () {60 vars in 1158 bytes} [Mon Aug 1 15:51:53 2022] POST /identity/v3/projects => generated 366 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:51:53.462337 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacd8d92-428a-422f-9bff-b4803118a77d None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:51:53.473922 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacd8d92-428a-422f-9bff-b4803118a77d None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:51:53.535094 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60896005-2c4b-48db-b210-d84d5f390c5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:51:53.535094 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60896005-2c4b-48db-b210-d84d5f390c5d admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:51:53.535094 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60896005-2c4b-48db-b210-d84d5f390c5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:51:53.535413 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60896005-2c4b-48db-b210-d84d5f390c5d admin admin] PATH_INFO: `/v3/users` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:51:53.536044 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60896005-2c4b-48db-b210-d84d5f390c5d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:51:53.538001 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60896005-2c4b-48db-b210-d84d5f390c5d admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:51:53.547279 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:51:53.628947 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1149/2321] 10.222.0.102 () {60 vars in 1149 bytes} [Mon Aug 1 15:51:53 2022] POST /identity/v3/users => generated 290 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:51:53.632823 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61243ea-9c2d-48b9-8e3a-8d5a7810913d admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:51:53.647913 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61243ea-9c2d-48b9-8e3a-8d5a7810913d admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:51:53.653874 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae392884-16c5-4a23-a4d3-9b15e23ccf23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:51:53.654588 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae392884-16c5-4a23-a4d3-9b15e23ccf23 admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:51:53.654863 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae392884-16c5-4a23-a4d3-9b15e23ccf23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:51:53.655330 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae392884-16c5-4a23-a4d3-9b15e23ccf23 admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:51:53.656088 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae392884-16c5-4a23-a4d3-9b15e23ccf23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:51:53.658068 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae392884-16c5-4a23-a4d3-9b15e23ccf23 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:51:53.669651 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1173/2322] 10.222.0.102 () {58 vars in 1127 bytes} [Mon Aug 1 15:51:53 2022] GET /identity/v3/roles => generated 1427 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:51:53.674044 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60896005-2c4b-48db-b210-d84d5f390c5d admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:51:53.684254 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60896005-2c4b-48db-b210-d84d5f390c5d admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:51:53.689881 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca11846-2f74-4f3a-b713-0b2069399f83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:51:53.695525 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca11846-2f74-4f3a-b713-0b2069399f83 admin admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:51:53.695525 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca11846-2f74-4f3a-b713-0b2069399f83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:51:53.695525 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca11846-2f74-4f3a-b713-0b2069399f83 admin admin] PATH_INFO: `/v3/projects/917407e0563a4389a3c8cf2931c2e212/users/06fce836ebba4c2ba6989e9c4a455e81/roles/de1374f966c04c27b579515b54334fd2` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:51:53.707077 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca11846-2f74-4f3a-b713-0b2069399f83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=917407e0563a4389a3c8cf2931c2e212, user_id=06fce836ebba4c2ba6989e9c4a455e81, role_id=de1374f966c04c27b579515b54334fd2)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:51:53.710062 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca11846-2f74-4f3a-b713-0b2069399f83 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:51:53.805328 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1150/2323] 10.222.0.102 () {60 vars in 1488 bytes} [Mon Aug 1 15:51:53 2022] PUT /identity/v3/projects/917407e0563a4389a3c8cf2931c2e212/users/06fce836ebba4c2ba6989e9c4a455e81/roles/de1374f966c04c27b579515b54334fd2 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:51:53.809391 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae392884-16c5-4a23-a4d3-9b15e23ccf23 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:51:53.820280 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae392884-16c5-4a23-a4d3-9b15e23ccf23 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:51:53.878834 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641d386f-a2d4-4e3a-a9ea-d807ada38ad0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:51:53.879475 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641d386f-a2d4-4e3a-a9ea-d807ada38ad0 admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:51:53.879751 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641d386f-a2d4-4e3a-a9ea-d807ada38ad0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:51:53.880019 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641d386f-a2d4-4e3a-a9ea-d807ada38ad0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:51:53.880885 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641d386f-a2d4-4e3a-a9ea-d807ada38ad0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:51:53.882500 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641d386f-a2d4-4e3a-a9ea-d807ada38ad0 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:51:53.898993 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1174/2324] 10.222.0.102 () {58 vars in 1127 bytes} [Mon Aug 1 15:51:53 2022] GET /identity/v3/roles => generated 1427 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:51:53.900378 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca11846-2f74-4f3a-b713-0b2069399f83 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:51:53.913865 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca11846-2f74-4f3a-b713-0b2069399f83 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:51:53.919648 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ac212d-3f90-4686-b882-42e2d887e50a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:51:53.920318 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ac212d-3f90-4686-b882-42e2d887e50a admin admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:51:53.920598 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ac212d-3f90-4686-b882-42e2d887e50a admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:51:53.920896 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ac212d-3f90-4686-b882-42e2d887e50a admin admin] PATH_INFO: `/v3/projects/917407e0563a4389a3c8cf2931c2e212/users/06fce836ebba4c2ba6989e9c4a455e81/roles/de1374f966c04c27b579515b54334fd2` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:51:53.923501 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ac212d-3f90-4686-b882-42e2d887e50a admin admin] RBAC: Authorizing `identity:create_grant(project_id=917407e0563a4389a3c8cf2931c2e212, user_id=06fce836ebba4c2ba6989e9c4a455e81, role_id=de1374f966c04c27b579515b54334fd2)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:51:53.926255 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ac212d-3f90-4686-b882-42e2d887e50a admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:51:53.936523 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1151/2325] 10.222.0.102 () {60 vars in 1488 bytes} [Mon Aug 1 15:51:53 2022] PUT /identity/v3/projects/917407e0563a4389a3c8cf2931c2e212/users/06fce836ebba4c2ba6989e9c4a455e81/roles/de1374f966c04c27b579515b54334fd2 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:51:53.948252 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db3e0e4-49c3-4dda-83ae-f6886d02229b None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:51:53.948571 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db3e0e4-49c3-4dda-83ae-f6886d02229b None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:51:53.948842 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db3e0e4-49c3-4dda-83ae-f6886d02229b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:51:53.977399 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-3db3e0e4-49c3-4dda-83ae-f6886d02229b None None] MFA Rules not processed for user `06fce836ebba4c2ba6989e9c4a455e81`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:51:53.978560 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-3db3e0e4-49c3-4dda-83ae-f6886d02229b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:51:54.047510 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1175/2326] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:51:53 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:51:54.059608 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ac212d-3f90-4686-b882-42e2d887e50a admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:51:54.061338 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-48ac212d-3f90-4686-b882-42e2d887e50a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:51:54.119335 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ac212d-3f90-4686-b882-42e2d887e50a admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:51:54.123057 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5b6321-0cd5-4627-9e05-063d9088685e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff810b37183c4729859c1b05edff1703', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:51:54.123683 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5b6321-0cd5-4627-9e05-063d9088685e service cinder] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:51:54.123968 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5b6321-0cd5-4627-9e05-063d9088685e service cinder] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:51:54.124239 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5b6321-0cd5-4627-9e05-063d9088685e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:51:54.133899 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5b6321-0cd5-4627-9e05-063d9088685e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:51:54.135327 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5b6321-0cd5-4627-9e05-063d9088685e service cinder] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:51:54.144662 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1152/2327] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:51:54 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:51:55.028415 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db3e0e4-49c3-4dda-83ae-f6886d02229b None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:51:55.038300 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:51:55.091105 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db3e0e4-49c3-4dda-83ae-f6886d02229b None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:51:55.096369 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d026821-3942-4472-ad5e-c4fb66a02445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:51:55.097044 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d026821-3942-4472-ad5e-c4fb66a02445 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:51:55.097324 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d026821-3942-4472-ad5e-c4fb66a02445 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:51:55.097596 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d026821-3942-4472-ad5e-c4fb66a02445 admin admin] PATH_INFO: `/v3/users/0e296ad34b9947cd94d3c1f2d96281d9` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:51:55.098768 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d026821-3942-4472-ad5e-c4fb66a02445 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e296ad34b9947cd94d3c1f2d96281d9)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:51:55.100731 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d026821-3942-4472-ad5e-c4fb66a02445 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:51:55.344643 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-2d026821-3942-4472-ad5e-c4fb66a02445 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e296ad34b9947cd94d3c1f2d96281d9'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:51:55.357606 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-2d026821-3942-4472-ad5e-c4fb66a02445 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e296ad34b9947cd94d3c1f2d96281d9'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:51:55.365122 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-2d026821-3942-4472-ad5e-c4fb66a02445 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e296ad34b9947cd94d3c1f2d96281d9'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:51:55.365936 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-2d026821-3942-4472-ad5e-c4fb66a02445 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e296ad34b9947cd94d3c1f2d96281d9'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:51:55.366582 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-2d026821-3942-4472-ad5e-c4fb66a02445 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e296ad34b9947cd94d3c1f2d96281d9'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:51:55.444083 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1176/2328] 10.222.0.102 () {58 vars in 1229 bytes} [Mon Aug 1 15:51:55 2022] DELETE /identity/v3/users/0e296ad34b9947cd94d3c1f2d96281d9 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:51:55.448633 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0291c5b-42df-4ef0-93f5-fbaa1ffea229 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:51:55.449213 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0291c5b-42df-4ef0-93f5-fbaa1ffea229 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:51:55.449213 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0291c5b-42df-4ef0-93f5-fbaa1ffea229 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:51:55.469993 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-b0291c5b-42df-4ef0-93f5-fbaa1ffea229 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:51:55.471240 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-b0291c5b-42df-4ef0-93f5-fbaa1ffea229 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:51:55.530303 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1153/2329] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:51:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:51:55.540226 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d026821-3942-4472-ad5e-c4fb66a02445 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:51:55.541669 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-2d026821-3942-4472-ad5e-c4fb66a02445 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:51:55.606049 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d026821-3942-4472-ad5e-c4fb66a02445 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:51:55.609607 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fbe073-50c7-42be-8fd1-7063e05376ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a856a413100443939fe9b10daa868518', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:51:55.610216 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fbe073-50c7-42be-8fd1-7063e05376ad service neutron] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:51:55.611081 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fbe073-50c7-42be-8fd1-7063e05376ad service neutron] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:51:55.611283 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fbe073-50c7-42be-8fd1-7063e05376ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:51:55.620590 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fbe073-50c7-42be-8fd1-7063e05376ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:51:55.622064 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fbe073-50c7-42be-8fd1-7063e05376ad service neutron] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:51:55.632464 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1177/2330] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:51:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:51:56.097019 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0291c5b-42df-4ef0-93f5-fbaa1ffea229 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:51:56.098473 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-b0291c5b-42df-4ef0-93f5-fbaa1ffea229 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:51:56.110644 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0291c5b-42df-4ef0-93f5-fbaa1ffea229 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:51:56.115524 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a52b835-25a8-495c-b6de-7101add170c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:51:56.116177 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a52b835-25a8-495c-b6de-7101add170c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:51:56.116454 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a52b835-25a8-495c-b6de-7101add170c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:51:56.116728 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a52b835-25a8-495c-b6de-7101add170c3 admin admin] PATH_INFO: `/v3/projects/f14f20530ff24a238c23d7e1df8ad200` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:51:56.118181 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a52b835-25a8-495c-b6de-7101add170c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f14f20530ff24a238c23d7e1df8ad200)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:51:56.119861 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a52b835-25a8-495c-b6de-7101add170c3 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:51:56.232932 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-9a52b835-25a8-495c-b6de-7101add170c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f14f20530ff24a238c23d7e1df8ad200', 'request_id': 'req-9a52b835-25a8-495c-b6de-7101add170c3'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:51:56.235433 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:INSERT=5,keystone:SELECT=91,keystone:DELETE=4 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:51:56.326046 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-9a52b835-25a8-495c-b6de-7101add170c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f14f20530ff24a238c23d7e1df8ad200', 'request_id': 'req-9a52b835-25a8-495c-b6de-7101add170c3'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:51:56.333421 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-9a52b835-25a8-495c-b6de-7101add170c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f14f20530ff24a238c23d7e1df8ad200', 'request_id': 'req-9a52b835-25a8-495c-b6de-7101add170c3'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:51:56.344392 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-9a52b835-25a8-495c-b6de-7101add170c3 admin admin] The token cache is being invalidate because project f14f20530ff24a238c23d7e1df8ad200 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80353) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 15:51:56.345330 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-9a52b835-25a8-495c-b6de-7101add170c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:51:56.345979 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-9a52b835-25a8-495c-b6de-7101add170c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:51:56.347657 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1154/2331] 10.222.0.102 () {58 vars in 1238 bytes} [Mon Aug 1 15:51:56 2022] DELETE /identity/v3/projects/f14f20530ff24a238c23d7e1df8ad200 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:51:56.351761 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fbe073-50c7-42be-8fd1-7063e05376ad service neutron] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:51:56.361607 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fbe073-50c7-42be-8fd1-7063e05376ad service neutron] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:51:56.390796 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:51:56.419375 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78003ed-cf02-432e-8923-602850a0507b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:51:56.420084 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78003ed-cf02-432e-8923-602850a0507b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:51:56.420362 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78003ed-cf02-432e-8923-602850a0507b admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:51:56.420633 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78003ed-cf02-432e-8923-602850a0507b admin admin] PATH_INFO: `/v3/users/06fce836ebba4c2ba6989e9c4a455e81` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:51:56.421815 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78003ed-cf02-432e-8923-602850a0507b admin admin] RBAC: Authorizing `identity:delete_user(user_id=06fce836ebba4c2ba6989e9c4a455e81)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:51:56.423781 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78003ed-cf02-432e-8923-602850a0507b admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:51:56.646553 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-a78003ed-cf02-432e-8923-602850a0507b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06fce836ebba4c2ba6989e9c4a455e81'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:51:56.658569 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-a78003ed-cf02-432e-8923-602850a0507b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06fce836ebba4c2ba6989e9c4a455e81'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:51:56.665454 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-a78003ed-cf02-432e-8923-602850a0507b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06fce836ebba4c2ba6989e9c4a455e81'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:51:56.666121 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-a78003ed-cf02-432e-8923-602850a0507b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06fce836ebba4c2ba6989e9c4a455e81'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:51:56.666727 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-a78003ed-cf02-432e-8923-602850a0507b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06fce836ebba4c2ba6989e9c4a455e81'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:51:56.737011 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1178/2332] 10.222.0.102 () {58 vars in 1229 bytes} [Mon Aug 1 15:51:56 2022] DELETE /identity/v3/users/06fce836ebba4c2ba6989e9c4a455e81 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 15:51:57.276613 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a52b835-25a8-495c-b6de-7101add170c3 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:51:57.279032 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-9a52b835-25a8-495c-b6de-7101add170c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:51:57.294858 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a52b835-25a8-495c-b6de-7101add170c3 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:51:57.372640 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5d0bfb-ca84-4711-9358-3fdb49ca1b88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:51:57.373338 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5d0bfb-ca84-4711-9358-3fdb49ca1b88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:51:57.373615 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5d0bfb-ca84-4711-9358-3fdb49ca1b88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:51:57.373885 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5d0bfb-ca84-4711-9358-3fdb49ca1b88 admin admin] PATH_INFO: `/v3/projects/917407e0563a4389a3c8cf2931c2e212` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:51:57.375078 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5d0bfb-ca84-4711-9358-3fdb49ca1b88 admin admin] RBAC: Authorizing `identity:delete_project(project_id=917407e0563a4389a3c8cf2931c2e212)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:51:57.377209 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5d0bfb-ca84-4711-9358-3fdb49ca1b88 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:51:57.497092 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-5d5d0bfb-ca84-4711-9358-3fdb49ca1b88 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '917407e0563a4389a3c8cf2931c2e212', 'request_id': 'req-5d5d0bfb-ca84-4711-9358-3fdb49ca1b88'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:51:57.557813 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-5d5d0bfb-ca84-4711-9358-3fdb49ca1b88 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '917407e0563a4389a3c8cf2931c2e212', 'request_id': 'req-5d5d0bfb-ca84-4711-9358-3fdb49ca1b88'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:51:57.565291 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-5d5d0bfb-ca84-4711-9358-3fdb49ca1b88 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '917407e0563a4389a3c8cf2931c2e212', 'request_id': 'req-5d5d0bfb-ca84-4711-9358-3fdb49ca1b88'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:51:57.576491 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-5d5d0bfb-ca84-4711-9358-3fdb49ca1b88 admin admin] The token cache is being invalidate because project 917407e0563a4389a3c8cf2931c2e212 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80353) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 15:51:57.576776 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-5d5d0bfb-ca84-4711-9358-3fdb49ca1b88 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:51:57.577501 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-5d5d0bfb-ca84-4711-9358-3fdb49ca1b88 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:51:57.579521 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1155/2333] 10.222.0.102 () {58 vars in 1238 bytes} [Mon Aug 1 15:51:57 2022] DELETE /identity/v3/projects/917407e0563a4389a3c8cf2931c2e212 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:51:57.585354 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b35457-0fd3-4065-a7c2-0d0109e5ed91 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:51:57.585831 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b35457-0fd3-4065-a7c2-0d0109e5ed91 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:51:57.585936 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b35457-0fd3-4065-a7c2-0d0109e5ed91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:51:57.607720 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-29b35457-0fd3-4065-a7c2-0d0109e5ed91 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:51:57.609018 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-29b35457-0fd3-4065-a7c2-0d0109e5ed91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:51:57.673140 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1179/2334] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:51:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:51:57.681291 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73759eeb-c94c-4ecc-af57-4a342bd70edc None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:51:57.681597 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73759eeb-c94c-4ecc-af57-4a342bd70edc None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:51:57.681960 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73759eeb-c94c-4ecc-af57-4a342bd70edc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:51:57.702221 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-73759eeb-c94c-4ecc-af57-4a342bd70edc None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:51:57.703348 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-73759eeb-c94c-4ecc-af57-4a342bd70edc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:51:57.712053 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1156/2335] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:51:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:51:57.723596 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b35457-0fd3-4065-a7c2-0d0109e5ed91 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:51:57.734491 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b35457-0fd3-4065-a7c2-0d0109e5ed91 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:51:57.742877 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca81552-09df-46e5-aec9-54f9ed921ae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:51:57.742877 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca81552-09df-46e5-aec9-54f9ed921ae1 admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:51:57.742877 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca81552-09df-46e5-aec9-54f9ed921ae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:51:57.742877 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca81552-09df-46e5-aec9-54f9ed921ae1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:51:57.743356 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca81552-09df-46e5-aec9-54f9ed921ae1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:51:57.743356 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca81552-09df-46e5-aec9-54f9ed921ae1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:51:57.743501 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca81552-09df-46e5-aec9-54f9ed921ae1 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:51:57.755700 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1180/2336] 10.222.0.102 () {58 vars in 1158 bytes} [Mon Aug 1 15:51:57 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:51:57.760250 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73759eeb-c94c-4ecc-af57-4a342bd70edc None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:51:57.770580 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73759eeb-c94c-4ecc-af57-4a342bd70edc None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:51:57.775334 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311f4e23-b021-49b2-969a-8ae99b102f38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:51:57.775948 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311f4e23-b021-49b2-969a-8ae99b102f38 admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:51:57.776227 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311f4e23-b021-49b2-969a-8ae99b102f38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:51:57.776501 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311f4e23-b021-49b2-969a-8ae99b102f38 admin admin] PATH_INFO: `/v3/projects` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:51:57.777341 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311f4e23-b021-49b2-969a-8ae99b102f38 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:51:57.779246 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311f4e23-b021-49b2-969a-8ae99b102f38 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:51:57.935117 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1157/2337] 10.222.0.102 () {60 vars in 1158 bytes} [Mon Aug 1 15:51:57 2022] POST /identity/v3/projects => generated 378 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:51:57.936469 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca81552-09df-46e5-aec9-54f9ed921ae1 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:51:57.948492 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca81552-09df-46e5-aec9-54f9ed921ae1 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:51:57.985632 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:51:58.010278 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93a7f66-2e4b-42e7-9559-a652b8296833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:51:58.010946 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93a7f66-2e4b-42e7-9559-a652b8296833 admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:51:58.011235 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93a7f66-2e4b-42e7-9559-a652b8296833 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:51:58.011506 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93a7f66-2e4b-42e7-9559-a652b8296833 admin admin] PATH_INFO: `/v3/users` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:51:58.012298 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93a7f66-2e4b-42e7-9559-a652b8296833 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:51:58.014225 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93a7f66-2e4b-42e7-9559-a652b8296833 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:51:58.101010 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1181/2338] 10.222.0.102 () {60 vars in 1149 bytes} [Mon Aug 1 15:51:57 2022] POST /identity/v3/users => generated 290 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:51:58.104980 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311f4e23-b021-49b2-969a-8ae99b102f38 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:51:58.115743 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311f4e23-b021-49b2-969a-8ae99b102f38 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:51:58.121036 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856b4d8f-f9ce-4d51-8f68-f8bfa8438fdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:51:58.121660 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856b4d8f-f9ce-4d51-8f68-f8bfa8438fdc admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:51:58.121944 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856b4d8f-f9ce-4d51-8f68-f8bfa8438fdc admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:51:58.122427 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856b4d8f-f9ce-4d51-8f68-f8bfa8438fdc admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:51:58.123292 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856b4d8f-f9ce-4d51-8f68-f8bfa8438fdc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:51:58.124937 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856b4d8f-f9ce-4d51-8f68-f8bfa8438fdc admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:51:58.139121 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1158/2339] 10.222.0.102 () {58 vars in 1127 bytes} [Mon Aug 1 15:51:58 2022] GET /identity/v3/roles => generated 1427 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 15:51:58.140367 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93a7f66-2e4b-42e7-9559-a652b8296833 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:51:58.151215 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93a7f66-2e4b-42e7-9559-a652b8296833 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:51:58.156021 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44017874-9ffe-4341-9361-475489b633c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:51:58.156624 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44017874-9ffe-4341-9361-475489b633c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:51:58.156940 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44017874-9ffe-4341-9361-475489b633c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:51:58.157250 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44017874-9ffe-4341-9361-475489b633c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:51:58.157944 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44017874-9ffe-4341-9361-475489b633c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:51:58.159551 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44017874-9ffe-4341-9361-475489b633c6 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:51:58.169890 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1182/2340] 10.222.0.102 () {58 vars in 1127 bytes} [Mon Aug 1 15:51:58 2022] GET /identity/v3/roles => generated 1427 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:51:58.174059 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856b4d8f-f9ce-4d51-8f68-f8bfa8438fdc admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:51:58.184415 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856b4d8f-f9ce-4d51-8f68-f8bfa8438fdc admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:51:58.190087 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e1406b-e515-4920-9277-a0949ac4feb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:51:58.190742 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e1406b-e515-4920-9277-a0949ac4feb9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:51:58.191140 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e1406b-e515-4920-9277-a0949ac4feb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:51:58.191425 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e1406b-e515-4920-9277-a0949ac4feb9 admin admin] PATH_INFO: `/v3/projects/88a750ba32b749559bdb69d87380b59a/users/7bb1f98e925c499e885354f42a20b2f2/roles/27f5093ac0674d799cdbd17c68482e32` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:51:58.207093 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e1406b-e515-4920-9277-a0949ac4feb9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=88a750ba32b749559bdb69d87380b59a, user_id=7bb1f98e925c499e885354f42a20b2f2, role_id=27f5093ac0674d799cdbd17c68482e32)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:51:58.210144 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e1406b-e515-4920-9277-a0949ac4feb9 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:51:58.336461 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1159/2341] 10.222.0.102 () {60 vars in 1488 bytes} [Mon Aug 1 15:51:58 2022] PUT /identity/v3/projects/88a750ba32b749559bdb69d87380b59a/users/7bb1f98e925c499e885354f42a20b2f2/roles/27f5093ac0674d799cdbd17c68482e32 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 15:51:58.354836 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961fb0f9-d7ce-4f0b-bbc5-bfe8d434c6cf None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:51:58.355122 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961fb0f9-d7ce-4f0b-bbc5-bfe8d434c6cf None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:51:58.355493 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961fb0f9-d7ce-4f0b-bbc5-bfe8d434c6cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:51:58.387974 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-961fb0f9-d7ce-4f0b-bbc5-bfe8d434c6cf None None] MFA Rules not processed for user `7bb1f98e925c499e885354f42a20b2f2`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:51:58.389211 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-961fb0f9-d7ce-4f0b-bbc5-bfe8d434c6cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:51:58.470386 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1183/2342] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:51:58 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:51:58.474931 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e1406b-e515-4920-9277-a0949ac4feb9 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:51:58.484163 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:DELETE=10,keystone:SELECT=87,keystone:INSERT=3 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:51:58.540150 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e1406b-e515-4920-9277-a0949ac4feb9 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:51:58.545119 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de92d890-f7d3-46b9-87d7-caa778f5b306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:51:58.545786 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de92d890-f7d3-46b9-87d7-caa778f5b306 admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:51:58.546071 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de92d890-f7d3-46b9-87d7-caa778f5b306 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:51:58.546394 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de92d890-f7d3-46b9-87d7-caa778f5b306 admin admin] PATH_INFO: `/v3/projects` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:51:58.547022 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de92d890-f7d3-46b9-87d7-caa778f5b306 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:51:58.549576 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de92d890-f7d3-46b9-87d7-caa778f5b306 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:51:58.641435 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1160/2343] 10.222.0.102 () {60 vars in 1158 bytes} [Mon Aug 1 15:51:58 2022] POST /identity/v3/projects => generated 378 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:51:58.645492 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961fb0f9-d7ce-4f0b-bbc5-bfe8d434c6cf None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:51:58.656454 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961fb0f9-d7ce-4f0b-bbc5-bfe8d434c6cf None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:51:58.712798 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbb04c6-76df-4266-bb4b-26a4bf3ec323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:51:58.713456 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbb04c6-76df-4266-bb4b-26a4bf3ec323 admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:51:58.713734 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbb04c6-76df-4266-bb4b-26a4bf3ec323 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:51:58.714005 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbb04c6-76df-4266-bb4b-26a4bf3ec323 admin admin] PATH_INFO: `/v3/users` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:51:58.714653 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbb04c6-76df-4266-bb4b-26a4bf3ec323 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:51:58.716569 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbb04c6-76df-4266-bb4b-26a4bf3ec323 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:51:58.812293 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1184/2344] 10.222.0.102 () {60 vars in 1149 bytes} [Mon Aug 1 15:51:58 2022] POST /identity/v3/users => generated 296 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:51:58.816619 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de92d890-f7d3-46b9-87d7-caa778f5b306 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:51:58.827039 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de92d890-f7d3-46b9-87d7-caa778f5b306 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:51:58.831734 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1444c21-9971-4da1-a4a3-3565697acc48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:51:58.832342 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1444c21-9971-4da1-a4a3-3565697acc48 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:51:58.832623 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1444c21-9971-4da1-a4a3-3565697acc48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:51:58.832925 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1444c21-9971-4da1-a4a3-3565697acc48 admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:51:58.833629 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1444c21-9971-4da1-a4a3-3565697acc48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:51:58.835230 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1444c21-9971-4da1-a4a3-3565697acc48 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:51:58.847014 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1161/2345] 10.222.0.102 () {58 vars in 1127 bytes} [Mon Aug 1 15:51:58 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:51:58.851225 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbb04c6-76df-4266-bb4b-26a4bf3ec323 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:51:58.861970 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbb04c6-76df-4266-bb4b-26a4bf3ec323 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:51:58.866573 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619b41f7-3b23-4ab4-bc05-003f8deca546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:51:58.867253 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619b41f7-3b23-4ab4-bc05-003f8deca546 admin admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:51:58.867528 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619b41f7-3b23-4ab4-bc05-003f8deca546 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:51:58.867796 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619b41f7-3b23-4ab4-bc05-003f8deca546 admin admin] PATH_INFO: `/v3/projects/ca7f6a8c85f54eff9960570ca0282d2f/users/985fc19e049a440aab9c093835ab797a/roles/de1374f966c04c27b579515b54334fd2` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:51:58.882975 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619b41f7-3b23-4ab4-bc05-003f8deca546 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca7f6a8c85f54eff9960570ca0282d2f, user_id=985fc19e049a440aab9c093835ab797a, role_id=de1374f966c04c27b579515b54334fd2)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:51:58.885683 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619b41f7-3b23-4ab4-bc05-003f8deca546 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:51:58.952125 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1185/2346] 10.222.0.102 () {60 vars in 1488 bytes} [Mon Aug 1 15:51:58 2022] PUT /identity/v3/projects/ca7f6a8c85f54eff9960570ca0282d2f/users/985fc19e049a440aab9c093835ab797a/roles/de1374f966c04c27b579515b54334fd2 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:51:58.956191 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1444c21-9971-4da1-a4a3-3565697acc48 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:51:58.966243 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1444c21-9971-4da1-a4a3-3565697acc48 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:51:59.021831 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ee8d88-5d69-4fdc-a187-16420c0e3618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:51:59.022442 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ee8d88-5d69-4fdc-a187-16420c0e3618 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:51:59.022752 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ee8d88-5d69-4fdc-a187-16420c0e3618 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:51:59.023027 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ee8d88-5d69-4fdc-a187-16420c0e3618 admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:51:59.023717 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ee8d88-5d69-4fdc-a187-16420c0e3618 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:51:59.025496 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ee8d88-5d69-4fdc-a187-16420c0e3618 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:51:59.035979 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1162/2347] 10.222.0.102 () {58 vars in 1127 bytes} [Mon Aug 1 15:51:58 2022] GET /identity/v3/roles => generated 1427 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:51:59.040170 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619b41f7-3b23-4ab4-bc05-003f8deca546 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:51:59.051081 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619b41f7-3b23-4ab4-bc05-003f8deca546 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:51:59.055717 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ab23fc-c568-47b8-8b1e-9f0e336560de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:51:59.056361 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ab23fc-c568-47b8-8b1e-9f0e336560de admin admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:51:59.056637 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ab23fc-c568-47b8-8b1e-9f0e336560de admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:51:59.056948 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ab23fc-c568-47b8-8b1e-9f0e336560de admin admin] PATH_INFO: `/v3/projects/ca7f6a8c85f54eff9960570ca0282d2f/users/985fc19e049a440aab9c093835ab797a/roles/de1374f966c04c27b579515b54334fd2` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:51:59.058872 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ab23fc-c568-47b8-8b1e-9f0e336560de admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca7f6a8c85f54eff9960570ca0282d2f, user_id=985fc19e049a440aab9c093835ab797a, role_id=de1374f966c04c27b579515b54334fd2)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:51:59.061570 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ab23fc-c568-47b8-8b1e-9f0e336560de admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:51:59.067304 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:51:59.072370 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1186/2348] 10.222.0.102 () {60 vars in 1488 bytes} [Mon Aug 1 15:51:59 2022] PUT /identity/v3/projects/ca7f6a8c85f54eff9960570ca0282d2f/users/985fc19e049a440aab9c093835ab797a/roles/de1374f966c04c27b579515b54334fd2 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:51:59.085679 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18e35dd-757e-437f-b5d9-d80b5ace406f None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:51:59.085998 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18e35dd-757e-437f-b5d9-d80b5ace406f None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:51:59.086278 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18e35dd-757e-437f-b5d9-d80b5ace406f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:51:59.114699 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-d18e35dd-757e-437f-b5d9-d80b5ace406f None None] MFA Rules not processed for user `985fc19e049a440aab9c093835ab797a`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:51:59.116008 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-d18e35dd-757e-437f-b5d9-d80b5ace406f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:51:59.184386 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1163/2349] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:51:59 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:51:59.196005 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ab23fc-c568-47b8-8b1e-9f0e336560de admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:51:59.197748 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-77ab23fc-c568-47b8-8b1e-9f0e336560de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:51:59.254615 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ab23fc-c568-47b8-8b1e-9f0e336560de admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:51:59.258250 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d43bbe3-2fc0-47c3-b8b3-88059a61dd0e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff810b37183c4729859c1b05edff1703', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:51:59.258850 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d43bbe3-2fc0-47c3-b8b3-88059a61dd0e service cinder] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:51:59.259126 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d43bbe3-2fc0-47c3-b8b3-88059a61dd0e service cinder] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:51:59.259394 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d43bbe3-2fc0-47c3-b8b3-88059a61dd0e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:51:59.317114 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d43bbe3-2fc0-47c3-b8b3-88059a61dd0e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:51:59.318611 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d43bbe3-2fc0-47c3-b8b3-88059a61dd0e service cinder] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:51:59.327502 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1187/2350] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:51:59 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:52:00.767238 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ab140d-1b16-42d7-85a5-06035bc770f2 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:52:00.767238 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ab140d-1b16-42d7-85a5-06035bc770f2 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:52:00.767238 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ab140d-1b16-42d7-85a5-06035bc770f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:52:00.767238 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:52:00.771675 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-65ab140d-1b16-42d7-85a5-06035bc770f2 None None] MFA Rules not processed for user `ae8514df55144c9086ed98ba44efbbd4`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:52:00.773035 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-65ab140d-1b16-42d7-85a5-06035bc770f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:52:00.833070 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1164/2351] 10.222.0.102 () {58 vars in 972 bytes} [Mon Aug 1 15:52:00 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 15:52:01.013029 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d43bbe3-2fc0-47c3-b8b3-88059a61dd0e service cinder] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:52:01.014974 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-8d43bbe3-2fc0-47c3-b8b3-88059a61dd0e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:52:01.089072 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d43bbe3-2fc0-47c3-b8b3-88059a61dd0e service cinder] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:52:01.095537 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd4dd68-f9b0-4829-bcec-c8ecdceb737c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90673f47354f4403aa0e12e3658441c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:52:01.096182 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd4dd68-f9b0-4829-bcec-c8ecdceb737c service swift] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:52:01.096463 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd4dd68-f9b0-4829-bcec-c8ecdceb737c service swift] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:52:01.096734 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd4dd68-f9b0-4829-bcec-c8ecdceb737c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:52:01.105529 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd4dd68-f9b0-4829-bcec-c8ecdceb737c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:52:01.107119 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd4dd68-f9b0-4829-bcec-c8ecdceb737c service swift] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:52:01.115807 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1188/2352] 10.222.0.102 () {60 vars in 1389 bytes} [Mon Aug 1 15:52:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 01 15:52:02.074305 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ab140d-1b16-42d7-85a5-06035bc770f2 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:52:02.086482 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ab140d-1b16-42d7-85a5-06035bc770f2 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:52:02.090399 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77d31d2-25e2-4dc1-9a23-3a5296f03c68 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff810b37183c4729859c1b05edff1703', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:52:02.091434 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77d31d2-25e2-4dc1-9a23-3a5296f03c68 service cinder] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:52:02.091865 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77d31d2-25e2-4dc1-9a23-3a5296f03c68 service cinder] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:52:02.092331 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77d31d2-25e2-4dc1-9a23-3a5296f03c68 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:52:02.103830 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77d31d2-25e2-4dc1-9a23-3a5296f03c68 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:52:02.105447 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77d31d2-25e2-4dc1-9a23-3a5296f03c68 service cinder] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:52:02.133845 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1165/2353] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:52:02 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:52:06.947009 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32582386-11d3-4d9f-a8b2-340339ef6056 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:52:06.947584 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32582386-11d3-4d9f-a8b2-340339ef6056 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:52:06.947584 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32582386-11d3-4d9f-a8b2-340339ef6056 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:52:06.966344 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-32582386-11d3-4d9f-a8b2-340339ef6056 None None] MFA Rules not processed for user `d60a67da3f284a469d374b8f1d93ea45`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:52:06.967726 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-32582386-11d3-4d9f-a8b2-340339ef6056 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:52:07.010241 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:52:07.027264 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1189/2354] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:52:06 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:52:07.627764 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77d31d2-25e2-4dc1-9a23-3a5296f03c68 service cinder] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:52:07.697797 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77d31d2-25e2-4dc1-9a23-3a5296f03c68 service cinder] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:52:07.704531 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ac1279-4cc9-4ea2-a397-d943fd6bfa83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:52:07.705398 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ac1279-4cc9-4ea2-a397-d943fd6bfa83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:52:07.705834 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ac1279-4cc9-4ea2-a397-d943fd6bfa83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:52:07.706260 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ac1279-4cc9-4ea2-a397-d943fd6bfa83 admin admin] PATH_INFO: `/v3/users/7bb1f98e925c499e885354f42a20b2f2` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:52:07.707632 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ac1279-4cc9-4ea2-a397-d943fd6bfa83 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7bb1f98e925c499e885354f42a20b2f2)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:52:07.709896 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ac1279-4cc9-4ea2-a397-d943fd6bfa83 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:52:07.877721 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-68ac1279-4cc9-4ea2-a397-d943fd6bfa83 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7bb1f98e925c499e885354f42a20b2f2'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:52:08.016925 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-68ac1279-4cc9-4ea2-a397-d943fd6bfa83 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7bb1f98e925c499e885354f42a20b2f2'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:52:08.038481 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-68ac1279-4cc9-4ea2-a397-d943fd6bfa83 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7bb1f98e925c499e885354f42a20b2f2'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:52:08.039499 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-68ac1279-4cc9-4ea2-a397-d943fd6bfa83 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7bb1f98e925c499e885354f42a20b2f2'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:52:08.040690 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-68ac1279-4cc9-4ea2-a397-d943fd6bfa83 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7bb1f98e925c499e885354f42a20b2f2'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:52:08.058991 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1166/2355] 10.222.0.102 () {58 vars in 1229 bytes} [Mon Aug 1 15:52:07 2022] DELETE /identity/v3/users/7bb1f98e925c499e885354f42a20b2f2 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:52:08.064469 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d56210d-66e6-456b-9abd-e5182a19ecfa None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:52:08.064921 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d56210d-66e6-456b-9abd-e5182a19ecfa None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:52:08.070851 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d56210d-66e6-456b-9abd-e5182a19ecfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:52:08.097066 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-7d56210d-66e6-456b-9abd-e5182a19ecfa None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:52:08.098537 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-7d56210d-66e6-456b-9abd-e5182a19ecfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:52:08.187340 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1190/2356] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:52:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 15:52:08.198013 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ac1279-4cc9-4ea2-a397-d943fd6bfa83 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:52:08.199518 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-68ac1279-4cc9-4ea2-a397-d943fd6bfa83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:52:08.216873 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:52:08.277198 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ac1279-4cc9-4ea2-a397-d943fd6bfa83 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:52:08.282539 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cf9253-93e2-4aef-8aa4-af753084b818 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a856a413100443939fe9b10daa868518', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:52:08.283184 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cf9253-93e2-4aef-8aa4-af753084b818 service neutron] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:52:08.283490 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cf9253-93e2-4aef-8aa4-af753084b818 service neutron] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:52:08.283752 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cf9253-93e2-4aef-8aa4-af753084b818 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:52:08.298533 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cf9253-93e2-4aef-8aa4-af753084b818 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:52:08.299860 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cf9253-93e2-4aef-8aa4-af753084b818 service neutron] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:52:08.321910 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1167/2357] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:52:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:52:08.761608 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d56210d-66e6-456b-9abd-e5182a19ecfa None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:52:08.767010 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-7d56210d-66e6-456b-9abd-e5182a19ecfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:52:08.780810 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d56210d-66e6-456b-9abd-e5182a19ecfa None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:52:08.787111 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ae8b25-03da-4371-950d-f6d7dd1fa266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:52:08.787947 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ae8b25-03da-4371-950d-f6d7dd1fa266 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:52:08.788295 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ae8b25-03da-4371-950d-f6d7dd1fa266 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:52:08.788662 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ae8b25-03da-4371-950d-f6d7dd1fa266 admin admin] PATH_INFO: `/v3/projects/88a750ba32b749559bdb69d87380b59a` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:52:08.789849 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ae8b25-03da-4371-950d-f6d7dd1fa266 admin admin] RBAC: Authorizing `identity:delete_project(project_id=88a750ba32b749559bdb69d87380b59a)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:52:08.791709 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ae8b25-03da-4371-950d-f6d7dd1fa266 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:52:08.949003 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-f0ae8b25-03da-4371-950d-f6d7dd1fa266 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88a750ba32b749559bdb69d87380b59a', 'request_id': 'req-f0ae8b25-03da-4371-950d-f6d7dd1fa266'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:52:08.956010 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-f0ae8b25-03da-4371-950d-f6d7dd1fa266 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88a750ba32b749559bdb69d87380b59a', 'request_id': 'req-f0ae8b25-03da-4371-950d-f6d7dd1fa266'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:52:09.095676 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-f0ae8b25-03da-4371-950d-f6d7dd1fa266 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88a750ba32b749559bdb69d87380b59a', 'request_id': 'req-f0ae8b25-03da-4371-950d-f6d7dd1fa266'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:52:09.110996 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-f0ae8b25-03da-4371-950d-f6d7dd1fa266 admin admin] The token cache is being invalidate because project 88a750ba32b749559bdb69d87380b59a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80352) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 15:52:09.111284 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-f0ae8b25-03da-4371-950d-f6d7dd1fa266 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:52:09.112039 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-f0ae8b25-03da-4371-950d-f6d7dd1fa266 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:52:09.113632 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1191/2358] 10.222.0.102 () {58 vars in 1238 bytes} [Mon Aug 1 15:52:08 2022] DELETE /identity/v3/projects/88a750ba32b749559bdb69d87380b59a => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:52:09.117692 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cf9253-93e2-4aef-8aa4-af753084b818 service neutron] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:52:09.127424 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cf9253-93e2-4aef-8aa4-af753084b818 service neutron] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:52:09.192735 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e45da6f-52ca-4bca-a19c-f2ba0eee67dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:52:09.193538 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e45da6f-52ca-4bca-a19c-f2ba0eee67dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:52:09.194062 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e45da6f-52ca-4bca-a19c-f2ba0eee67dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:52:09.194449 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e45da6f-52ca-4bca-a19c-f2ba0eee67dc admin admin] PATH_INFO: `/v3/users/985fc19e049a440aab9c093835ab797a` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:52:09.195847 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e45da6f-52ca-4bca-a19c-f2ba0eee67dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=985fc19e049a440aab9c093835ab797a)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:52:09.198303 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e45da6f-52ca-4bca-a19c-f2ba0eee67dc admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:52:09.422329 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-3e45da6f-52ca-4bca-a19c-f2ba0eee67dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '985fc19e049a440aab9c093835ab797a'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:52:09.496881 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-3e45da6f-52ca-4bca-a19c-f2ba0eee67dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '985fc19e049a440aab9c093835ab797a'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:52:09.512698 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-3e45da6f-52ca-4bca-a19c-f2ba0eee67dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '985fc19e049a440aab9c093835ab797a'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:52:09.513883 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-3e45da6f-52ca-4bca-a19c-f2ba0eee67dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '985fc19e049a440aab9c093835ab797a'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:52:09.514681 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-3e45da6f-52ca-4bca-a19c-f2ba0eee67dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '985fc19e049a440aab9c093835ab797a'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:52:09.535782 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1168/2359] 10.222.0.102 () {58 vars in 1229 bytes} [Mon Aug 1 15:52:09 2022] DELETE /identity/v3/users/985fc19e049a440aab9c093835ab797a => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:52:10.120587 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ae8b25-03da-4371-950d-f6d7dd1fa266 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:52:10.122916 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-f0ae8b25-03da-4371-950d-f6d7dd1fa266 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:52:10.148358 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ae8b25-03da-4371-950d-f6d7dd1fa266 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:52:10.239367 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c52124-5ec5-455e-af3f-9206f85b7ce3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:52:10.239947 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c52124-5ec5-455e-af3f-9206f85b7ce3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:52:10.240218 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c52124-5ec5-455e-af3f-9206f85b7ce3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:52:10.240542 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c52124-5ec5-455e-af3f-9206f85b7ce3 admin admin] PATH_INFO: `/v3/projects/ca7f6a8c85f54eff9960570ca0282d2f` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:52:10.241890 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c52124-5ec5-455e-af3f-9206f85b7ce3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca7f6a8c85f54eff9960570ca0282d2f)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:52:10.243851 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c52124-5ec5-455e-af3f-9206f85b7ce3 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:52:10.256248 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:52:10.339993 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309709fd-ba64-4737-94de-03d2f303bc55 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:52:10.340475 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309709fd-ba64-4737-94de-03d2f303bc55 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:52:10.340685 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309709fd-ba64-4737-94de-03d2f303bc55 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:52:10.345881 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1169/2360] 10.222.0.102 () {54 vars in 926 bytes} [Mon Aug 1 15:52:10 2022] GET /identity => generated 271 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 15:52:10.352887 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5caa2ca-eac0-4b5c-bac5-51ed28d6abf0 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:52:10.360683 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5caa2ca-eac0-4b5c-bac5-51ed28d6abf0 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:52:10.360683 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5caa2ca-eac0-4b5c-bac5-51ed28d6abf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:52:10.410952 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-e5caa2ca-eac0-4b5c-bac5-51ed28d6abf0 None None] MFA Rules not processed for user `b78f5749fe9c46a389c88bb9c222cc73`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:52:10.412911 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-e5caa2ca-eac0-4b5c-bac5-51ed28d6abf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:52:10.447739 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-48c52124-5ec5-455e-af3f-9206f85b7ce3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca7f6a8c85f54eff9960570ca0282d2f', 'request_id': 'req-48c52124-5ec5-455e-af3f-9206f85b7ce3'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:52:10.453385 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:52:10.456678 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-48c52124-5ec5-455e-af3f-9206f85b7ce3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca7f6a8c85f54eff9960570ca0282d2f', 'request_id': 'req-48c52124-5ec5-455e-af3f-9206f85b7ce3'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:52:10.495136 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1170/2361] 10.222.0.102 () {58 vars in 1023 bytes} [Mon Aug 1 15:52:10 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:52:10.508654 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5caa2ca-eac0-4b5c-bac5-51ed28d6abf0 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:52:10.510571 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-e5caa2ca-eac0-4b5c-bac5-51ed28d6abf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:52:10.524113 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5caa2ca-eac0-4b5c-bac5-51ed28d6abf0 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:52:10.589374 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57397b3d-5d82-4e09-9ef3-07cc59452696 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b78f5749fe9c46a389c88bb9c222cc73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:52:10.590136 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57397b3d-5d82-4e09-9ef3-07cc59452696 service placement] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:52:10.594450 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57397b3d-5d82-4e09-9ef3-07cc59452696 service placement] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:52:10.594450 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57397b3d-5d82-4e09-9ef3-07cc59452696 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:52:10.601646 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57397b3d-5d82-4e09-9ef3-07cc59452696 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:52:10.603351 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57397b3d-5d82-4e09-9ef3-07cc59452696 service placement] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:52:10.614650 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1171/2362] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:52:10 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 15:52:10.615499 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57397b3d-5d82-4e09-9ef3-07cc59452696 service placement] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:52:10.616974 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-57397b3d-5d82-4e09-9ef3-07cc59452696 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:52:10.623643 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-48c52124-5ec5-455e-af3f-9206f85b7ce3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca7f6a8c85f54eff9960570ca0282d2f', 'request_id': 'req-48c52124-5ec5-455e-af3f-9206f85b7ce3'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:52:10.640245 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-48c52124-5ec5-455e-af3f-9206f85b7ce3 admin admin] The token cache is being invalidate because project ca7f6a8c85f54eff9960570ca0282d2f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80352) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 15:52:10.640519 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-48c52124-5ec5-455e-af3f-9206f85b7ce3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:52:10.641501 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-48c52124-5ec5-455e-af3f-9206f85b7ce3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:52:10.643827 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1192/2363] 10.222.0.102 () {58 vars in 1238 bytes} [Mon Aug 1 15:52:10 2022] DELETE /identity/v3/projects/ca7f6a8c85f54eff9960570ca0282d2f => generated 0 bytes in 524 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:52:10.648589 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da911ae-e0a3-4d89-bf99-8b55716e99eb None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:52:10.649193 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da911ae-e0a3-4d89-bf99-8b55716e99eb None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:52:10.649664 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da911ae-e0a3-4d89-bf99-8b55716e99eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:52:10.673237 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-2da911ae-e0a3-4d89-bf99-8b55716e99eb None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:52:10.674901 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-2da911ae-e0a3-4d89-bf99-8b55716e99eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:52:10.713671 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57397b3d-5d82-4e09-9ef3-07cc59452696 service placement] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:52:10.718645 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9f77e2-d630-4bb3-9050-5b466fd3633f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:52:10.719845 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9f77e2-d630-4bb3-9050-5b466fd3633f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:52:10.720130 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9f77e2-d630-4bb3-9050-5b466fd3633f admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:52:10.720405 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9f77e2-d630-4bb3-9050-5b466fd3633f admin admin] PATH_INFO: `/v3/users/693b4234e0b24e61a2e67ebe4f286a12` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:52:10.721773 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9f77e2-d630-4bb3-9050-5b466fd3633f admin admin] RBAC: Authorizing `identity:delete_user(user_id=693b4234e0b24e61a2e67ebe4f286a12)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:52:10.723725 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9f77e2-d630-4bb3-9050-5b466fd3633f admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:52:10.747951 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1193/2364] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:52:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:52:10.757404 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a254b9db-3344-48b7-9a8c-c8e8a8dc9ef1 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:52:10.757726 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a254b9db-3344-48b7-9a8c-c8e8a8dc9ef1 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:52:10.758021 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a254b9db-3344-48b7-9a8c-c8e8a8dc9ef1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:52:10.777401 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-a254b9db-3344-48b7-9a8c-c8e8a8dc9ef1 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:52:10.778587 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-a254b9db-3344-48b7-9a8c-c8e8a8dc9ef1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:52:10.787034 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1194/2365] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:52:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 15:52:10.791128 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a254b9db-3344-48b7-9a8c-c8e8a8dc9ef1 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:52:10.800559 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a254b9db-3344-48b7-9a8c-c8e8a8dc9ef1 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:52:10.805368 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962c9cec-b238-42bc-a802-af415fe91e10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:52:10.805958 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962c9cec-b238-42bc-a802-af415fe91e10 admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:52:10.806226 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962c9cec-b238-42bc-a802-af415fe91e10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:52:10.806491 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962c9cec-b238-42bc-a802-af415fe91e10 admin admin] PATH_INFO: `/v3/domains` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:52:10.807165 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962c9cec-b238-42bc-a802-af415fe91e10 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:52:10.807458 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962c9cec-b238-42bc-a802-af415fe91e10 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:52:10.809161 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962c9cec-b238-42bc-a802-af415fe91e10 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:52:10.821438 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1195/2366] 10.222.0.102 () {58 vars in 1158 bytes} [Mon Aug 1 15:52:10 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:52:10.825591 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962c9cec-b238-42bc-a802-af415fe91e10 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:52:10.835326 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962c9cec-b238-42bc-a802-af415fe91e10 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:52:10.843822 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46328bf3-64e9-48ec-b48b-4e1abe5dfcf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:52:10.850661 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46328bf3-64e9-48ec-b48b-4e1abe5dfcf8 admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:52:10.850661 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46328bf3-64e9-48ec-b48b-4e1abe5dfcf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:52:10.850661 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46328bf3-64e9-48ec-b48b-4e1abe5dfcf8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:52:10.850661 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46328bf3-64e9-48ec-b48b-4e1abe5dfcf8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:52:10.850661 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46328bf3-64e9-48ec-b48b-4e1abe5dfcf8 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:52:10.923353 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-fa9f77e2-d630-4bb3-9050-5b466fd3633f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '693b4234e0b24e61a2e67ebe4f286a12'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:52:10.939332 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1196/2367] 10.222.0.102 () {60 vars in 1158 bytes} [Mon Aug 1 15:52:10 2022] POST /identity/v3/projects => generated 376 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 15:52:10.943409 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46328bf3-64e9-48ec-b48b-4e1abe5dfcf8 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:52:11.013266 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46328bf3-64e9-48ec-b48b-4e1abe5dfcf8 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:52:11.017065 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-fa9f77e2-d630-4bb3-9050-5b466fd3633f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '693b4234e0b24e61a2e67ebe4f286a12'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:52:11.021344 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25797f19-357c-46d4-b4cd-3d9db18466fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:52:11.022161 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25797f19-357c-46d4-b4cd-3d9db18466fa admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:52:11.026779 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25797f19-357c-46d4-b4cd-3d9db18466fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:52:11.026779 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25797f19-357c-46d4-b4cd-3d9db18466fa admin admin] PATH_INFO: `/v3/users` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:52:11.026779 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25797f19-357c-46d4-b4cd-3d9db18466fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:52:11.026779 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25797f19-357c-46d4-b4cd-3d9db18466fa admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:52:11.032963 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-fa9f77e2-d630-4bb3-9050-5b466fd3633f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '693b4234e0b24e61a2e67ebe4f286a12'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:52:11.033741 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-fa9f77e2-d630-4bb3-9050-5b466fd3633f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '693b4234e0b24e61a2e67ebe4f286a12'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:52:11.034531 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-fa9f77e2-d630-4bb3-9050-5b466fd3633f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '693b4234e0b24e61a2e67ebe4f286a12'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:52:11.049471 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1172/2368] 10.222.0.102 () {58 vars in 1229 bytes} [Mon Aug 1 15:52:10 2022] DELETE /identity/v3/users/693b4234e0b24e61a2e67ebe4f286a12 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:52:11.109252 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1197/2369] 10.222.0.102 () {60 vars in 1149 bytes} [Mon Aug 1 15:52:10 2022] POST /identity/v3/users => generated 289 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:52:11.116121 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9f77e2-d630-4bb3-9050-5b466fd3633f admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:52:11.122201 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-fa9f77e2-d630-4bb3-9050-5b466fd3633f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:52:11.180891 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:52:11.193059 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9f77e2-d630-4bb3-9050-5b466fd3633f admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:52:11.198350 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958033f2-8e60-4afe-b62d-8053220e2e99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:52:11.198996 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958033f2-8e60-4afe-b62d-8053220e2e99 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:52:11.199464 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958033f2-8e60-4afe-b62d-8053220e2e99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:52:11.199744 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958033f2-8e60-4afe-b62d-8053220e2e99 admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:52:11.200492 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958033f2-8e60-4afe-b62d-8053220e2e99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:52:11.202309 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958033f2-8e60-4afe-b62d-8053220e2e99 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:52:11.212651 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1173/2370] 10.222.0.102 () {58 vars in 1127 bytes} [Mon Aug 1 15:52:11 2022] GET /identity/v3/roles => generated 1427 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:52:11.216757 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25797f19-357c-46d4-b4cd-3d9db18466fa admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:52:11.227892 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25797f19-357c-46d4-b4cd-3d9db18466fa admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:52:11.233363 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea5d150-bf10-4623-84de-8355e3bf1277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:52:11.233984 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea5d150-bf10-4623-84de-8355e3bf1277 admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:52:11.234262 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea5d150-bf10-4623-84de-8355e3bf1277 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:52:11.234534 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea5d150-bf10-4623-84de-8355e3bf1277 admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:52:11.235844 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea5d150-bf10-4623-84de-8355e3bf1277 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:52:11.237486 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea5d150-bf10-4623-84de-8355e3bf1277 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:52:11.248086 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1198/2371] 10.222.0.102 () {58 vars in 1127 bytes} [Mon Aug 1 15:52:11 2022] GET /identity/v3/roles => generated 1427 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:52:11.252759 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958033f2-8e60-4afe-b62d-8053220e2e99 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:52:11.263167 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958033f2-8e60-4afe-b62d-8053220e2e99 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:52:11.278436 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad2c043-df0e-43bf-94b6-d4d066cf6a6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:52:11.281793 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad2c043-df0e-43bf-94b6-d4d066cf6a6e admin admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:52:11.281793 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad2c043-df0e-43bf-94b6-d4d066cf6a6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:52:11.281793 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad2c043-df0e-43bf-94b6-d4d066cf6a6e admin admin] PATH_INFO: `/v3/projects/6283ca8e0c534c7eb9934512003c4de7/users/0cd9e02e5f1947d39edc976ad50461f7/roles/27f5093ac0674d799cdbd17c68482e32` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:52:11.302296 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad2c043-df0e-43bf-94b6-d4d066cf6a6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=6283ca8e0c534c7eb9934512003c4de7, user_id=0cd9e02e5f1947d39edc976ad50461f7, role_id=27f5093ac0674d799cdbd17c68482e32)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:52:11.304597 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad2c043-df0e-43bf-94b6-d4d066cf6a6e admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:52:11.342276 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea5d150-bf10-4623-84de-8355e3bf1277 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:52:11.344384 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-cea5d150-bf10-4623-84de-8355e3bf1277 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:52:11.359043 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea5d150-bf10-4623-84de-8355e3bf1277 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:52:11.365626 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a0f410-d4a0-473c-bf4b-5182f9895a96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:52:11.366401 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a0f410-d4a0-473c-bf4b-5182f9895a96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:52:11.366746 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a0f410-d4a0-473c-bf4b-5182f9895a96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:52:11.367030 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a0f410-d4a0-473c-bf4b-5182f9895a96 admin admin] PATH_INFO: `/v3/projects/a35e023a0c8141f8b60b8fc3ceae3bbf` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:52:11.368230 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a0f410-d4a0-473c-bf4b-5182f9895a96 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a35e023a0c8141f8b60b8fc3ceae3bbf)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:52:11.370209 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a0f410-d4a0-473c-bf4b-5182f9895a96 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:52:11.384895 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1174/2372] 10.222.0.102 () {60 vars in 1488 bytes} [Mon Aug 1 15:52:11 2022] PUT /identity/v3/projects/6283ca8e0c534c7eb9934512003c4de7/users/0cd9e02e5f1947d39edc976ad50461f7/roles/27f5093ac0674d799cdbd17c68482e32 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:52:11.394022 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3acae9-fe83-4899-bc77-f86650e219a9 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:52:11.394330 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3acae9-fe83-4899-bc77-f86650e219a9 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:52:11.395434 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3acae9-fe83-4899-bc77-f86650e219a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:52:11.427418 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-2b3acae9-fe83-4899-bc77-f86650e219a9 None None] MFA Rules not processed for user `0cd9e02e5f1947d39edc976ad50461f7`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:52:11.429306 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-2b3acae9-fe83-4899-bc77-f86650e219a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:52:11.512035 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1175/2373] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:52:11 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 15:52:11.525464 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3acae9-fe83-4899-bc77-f86650e219a9 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:52:11.528095 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-2b3acae9-fe83-4899-bc77-f86650e219a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:52:11.535568 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-c5a0f410-d4a0-473c-bf4b-5182f9895a96 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a35e023a0c8141f8b60b8fc3ceae3bbf', 'request_id': 'req-c5a0f410-d4a0-473c-bf4b-5182f9895a96'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:52:11.556525 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-c5a0f410-d4a0-473c-bf4b-5182f9895a96 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a35e023a0c8141f8b60b8fc3ceae3bbf', 'request_id': 'req-c5a0f410-d4a0-473c-bf4b-5182f9895a96'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:52:11.627528 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3acae9-fe83-4899-bc77-f86650e219a9 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:52:11.654156 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:52:11.692117 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3803ef-a95a-498d-8320-496a860b8abe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff810b37183c4729859c1b05edff1703', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:52:11.692870 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3803ef-a95a-498d-8320-496a860b8abe service cinder] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:52:11.693425 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3803ef-a95a-498d-8320-496a860b8abe service cinder] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:52:11.710795 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3803ef-a95a-498d-8320-496a860b8abe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:52:11.710956 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-c5a0f410-d4a0-473c-bf4b-5182f9895a96 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a35e023a0c8141f8b60b8fc3ceae3bbf', 'request_id': 'req-c5a0f410-d4a0-473c-bf4b-5182f9895a96'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:52:11.711615 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-c5a0f410-d4a0-473c-bf4b-5182f9895a96 admin admin] The token cache is being invalidate because project a35e023a0c8141f8b60b8fc3ceae3bbf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80352) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 15:52:11.712128 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-c5a0f410-d4a0-473c-bf4b-5182f9895a96 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:52:11.713403 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-c5a0f410-d4a0-473c-bf4b-5182f9895a96 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:52:11.719585 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1199/2374] 10.222.0.102 () {58 vars in 1238 bytes} [Mon Aug 1 15:52:11 2022] DELETE /identity/v3/projects/a35e023a0c8141f8b60b8fc3ceae3bbf => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 15:52:11.721005 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a0f410-d4a0-473c-bf4b-5182f9895a96 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:52:11.722563 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-c5a0f410-d4a0-473c-bf4b-5182f9895a96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:52:11.757628 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3803ef-a95a-498d-8320-496a860b8abe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:52:11.759072 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3803ef-a95a-498d-8320-496a860b8abe service cinder] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:52:11.770055 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1176/2375] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:52:11 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:52:11.806728 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a0f410-d4a0-473c-bf4b-5182f9895a96 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:52:11.815221 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba15efd-c59a-49a5-b459-c4ed327c33f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:52:11.824736 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba15efd-c59a-49a5-b459-c4ed327c33f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:52:11.824736 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba15efd-c59a-49a5-b459-c4ed327c33f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:52:11.824736 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba15efd-c59a-49a5-b459-c4ed327c33f8 admin admin] PATH_INFO: `/v3/users/68f28a2547fa4da2b63f541ed56ebdaa` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:52:11.824736 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba15efd-c59a-49a5-b459-c4ed327c33f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=68f28a2547fa4da2b63f541ed56ebdaa)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:52:11.824736 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba15efd-c59a-49a5-b459-c4ed327c33f8 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:52:12.139174 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-5ba15efd-c59a-49a5-b459-c4ed327c33f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68f28a2547fa4da2b63f541ed56ebdaa'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:52:12.152114 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-5ba15efd-c59a-49a5-b459-c4ed327c33f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68f28a2547fa4da2b63f541ed56ebdaa'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:52:12.159644 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-5ba15efd-c59a-49a5-b459-c4ed327c33f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68f28a2547fa4da2b63f541ed56ebdaa'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:52:12.160402 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-5ba15efd-c59a-49a5-b459-c4ed327c33f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68f28a2547fa4da2b63f541ed56ebdaa'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:52:12.161051 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-5ba15efd-c59a-49a5-b459-c4ed327c33f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68f28a2547fa4da2b63f541ed56ebdaa'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:52:12.301550 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:INSERT=4,keystone:SELECT=80,keystone:DELETE=16 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:52:12.308257 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1200/2376] 10.222.0.102 () {58 vars in 1229 bytes} [Mon Aug 1 15:52:11 2022] DELETE /identity/v3/users/68f28a2547fa4da2b63f541ed56ebdaa => generated 0 bytes in 588 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:52:12.579235 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3803ef-a95a-498d-8320-496a860b8abe service cinder] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:52:12.596325 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3803ef-a95a-498d-8320-496a860b8abe service cinder] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:52:12.677819 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111703bf-9b4b-4b73-8b10-848a65f916dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:52:12.677819 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111703bf-9b4b-4b73-8b10-848a65f916dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:52:12.677819 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111703bf-9b4b-4b73-8b10-848a65f916dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:52:12.677819 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111703bf-9b4b-4b73-8b10-848a65f916dd admin admin] PATH_INFO: `/v3/projects/b92228d8cf094066a59975816f2f8d90` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:52:12.679586 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111703bf-9b4b-4b73-8b10-848a65f916dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=b92228d8cf094066a59975816f2f8d90)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:52:12.681052 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111703bf-9b4b-4b73-8b10-848a65f916dd admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:52:12.800909 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-111703bf-9b4b-4b73-8b10-848a65f916dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b92228d8cf094066a59975816f2f8d90', 'request_id': 'req-111703bf-9b4b-4b73-8b10-848a65f916dd'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:52:12.878505 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-111703bf-9b4b-4b73-8b10-848a65f916dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b92228d8cf094066a59975816f2f8d90', 'request_id': 'req-111703bf-9b4b-4b73-8b10-848a65f916dd'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:52:12.886328 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-111703bf-9b4b-4b73-8b10-848a65f916dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b92228d8cf094066a59975816f2f8d90', 'request_id': 'req-111703bf-9b4b-4b73-8b10-848a65f916dd'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:52:12.897903 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-111703bf-9b4b-4b73-8b10-848a65f916dd admin admin] The token cache is being invalidate because project b92228d8cf094066a59975816f2f8d90 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80353) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 15:52:12.898190 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-111703bf-9b4b-4b73-8b10-848a65f916dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:52:12.898848 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-111703bf-9b4b-4b73-8b10-848a65f916dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:52:12.909670 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1177/2377] 10.222.0.102 () {58 vars in 1238 bytes} [Mon Aug 1 15:52:12 2022] DELETE /identity/v3/projects/b92228d8cf094066a59975816f2f8d90 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:52:13.015018 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:52:14.071720 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:52:17.275379 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba15efd-c59a-49a5-b459-c4ed327c33f8 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:52:17.276802 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-5ba15efd-c59a-49a5-b459-c4ed327c33f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:52:17.290563 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba15efd-c59a-49a5-b459-c4ed327c33f8 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:52:17.347440 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67025a66-8986-4928-81b9-4ab17b5fcd0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:52:17.348073 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67025a66-8986-4928-81b9-4ab17b5fcd0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:52:17.348355 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67025a66-8986-4928-81b9-4ab17b5fcd0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:52:17.348631 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67025a66-8986-4928-81b9-4ab17b5fcd0f admin admin] PATH_INFO: `/v3/users/0cd9e02e5f1947d39edc976ad50461f7` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:52:17.349821 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67025a66-8986-4928-81b9-4ab17b5fcd0f admin admin] RBAC: Authorizing `identity:delete_user(user_id=0cd9e02e5f1947d39edc976ad50461f7)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:52:17.351752 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67025a66-8986-4928-81b9-4ab17b5fcd0f admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:52:17.626284 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-67025a66-8986-4928-81b9-4ab17b5fcd0f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0cd9e02e5f1947d39edc976ad50461f7'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:52:17.638826 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-67025a66-8986-4928-81b9-4ab17b5fcd0f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0cd9e02e5f1947d39edc976ad50461f7'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:52:17.646293 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-67025a66-8986-4928-81b9-4ab17b5fcd0f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0cd9e02e5f1947d39edc976ad50461f7'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:52:17.646980 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-67025a66-8986-4928-81b9-4ab17b5fcd0f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0cd9e02e5f1947d39edc976ad50461f7'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:52:17.647579 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-67025a66-8986-4928-81b9-4ab17b5fcd0f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0cd9e02e5f1947d39edc976ad50461f7'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:52:17.780881 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1201/2378] 10.222.0.102 () {58 vars in 1229 bytes} [Mon Aug 1 15:52:17 2022] DELETE /identity/v3/users/0cd9e02e5f1947d39edc976ad50461f7 => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:52:17.786444 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca433437-911c-4ab8-b022-83c4851b7e62 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:52:17.786915 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca433437-911c-4ab8-b022-83c4851b7e62 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:52:17.787052 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca433437-911c-4ab8-b022-83c4851b7e62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:52:17.806975 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-ca433437-911c-4ab8-b022-83c4851b7e62 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:52:17.808217 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-ca433437-911c-4ab8-b022-83c4851b7e62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:52:17.874727 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1178/2379] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:52:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:52:17.885321 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67025a66-8986-4928-81b9-4ab17b5fcd0f admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:52:17.886777 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-67025a66-8986-4928-81b9-4ab17b5fcd0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:52:17.945825 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67025a66-8986-4928-81b9-4ab17b5fcd0f admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:52:17.949382 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b133b8-40f1-426e-afce-dc8428436b87 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a856a413100443939fe9b10daa868518', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:52:17.949989 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b133b8-40f1-426e-afce-dc8428436b87 service neutron] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:52:17.950264 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b133b8-40f1-426e-afce-dc8428436b87 service neutron] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:52:17.950534 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b133b8-40f1-426e-afce-dc8428436b87 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:52:17.960018 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b133b8-40f1-426e-afce-dc8428436b87 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:52:17.961483 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b133b8-40f1-426e-afce-dc8428436b87 service neutron] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:52:17.971332 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1202/2380] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:52:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:52:18.387598 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca433437-911c-4ab8-b022-83c4851b7e62 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:52:18.389065 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-ca433437-911c-4ab8-b022-83c4851b7e62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:52:18.401572 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca433437-911c-4ab8-b022-83c4851b7e62 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:52:18.406284 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96edde9-26bf-4a8c-af90-8e30c60a1d44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:52:18.407458 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96edde9-26bf-4a8c-af90-8e30c60a1d44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:52:18.413036 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96edde9-26bf-4a8c-af90-8e30c60a1d44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:52:18.413036 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96edde9-26bf-4a8c-af90-8e30c60a1d44 admin admin] PATH_INFO: `/v3/projects/6283ca8e0c534c7eb9934512003c4de7` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:52:18.413036 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96edde9-26bf-4a8c-af90-8e30c60a1d44 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6283ca8e0c534c7eb9934512003c4de7)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:52:18.413036 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96edde9-26bf-4a8c-af90-8e30c60a1d44 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:52:18.540521 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-c96edde9-26bf-4a8c-af90-8e30c60a1d44 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6283ca8e0c534c7eb9934512003c4de7', 'request_id': 'req-c96edde9-26bf-4a8c-af90-8e30c60a1d44'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:52:18.610538 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-c96edde9-26bf-4a8c-af90-8e30c60a1d44 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6283ca8e0c534c7eb9934512003c4de7', 'request_id': 'req-c96edde9-26bf-4a8c-af90-8e30c60a1d44'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:52:18.617280 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-c96edde9-26bf-4a8c-af90-8e30c60a1d44 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6283ca8e0c534c7eb9934512003c4de7', 'request_id': 'req-c96edde9-26bf-4a8c-af90-8e30c60a1d44'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:52:18.628365 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-c96edde9-26bf-4a8c-af90-8e30c60a1d44 admin admin] The token cache is being invalidate because project 6283ca8e0c534c7eb9934512003c4de7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80353) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 15:52:18.628652 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-c96edde9-26bf-4a8c-af90-8e30c60a1d44 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:52:18.629322 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-c96edde9-26bf-4a8c-af90-8e30c60a1d44 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:52:18.630845 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1179/2381] 10.222.0.102 () {58 vars in 1238 bytes} [Mon Aug 1 15:52:18 2022] DELETE /identity/v3/projects/6283ca8e0c534c7eb9934512003c4de7 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:52:18.636548 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4101f1-0bf5-4324-9243-1bac1c639b93 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:52:18.641645 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4101f1-0bf5-4324-9243-1bac1c639b93 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:52:18.641645 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4101f1-0bf5-4324-9243-1bac1c639b93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:52:18.645658 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:52:18.658428 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-ed4101f1-0bf5-4324-9243-1bac1c639b93 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:52:18.659776 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-ed4101f1-0bf5-4324-9243-1bac1c639b93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:52:18.721697 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1203/2382] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:52:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:52:18.729563 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad92dc93-e42e-4fc2-a201-89128a8dd75c None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:52:18.729853 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad92dc93-e42e-4fc2-a201-89128a8dd75c None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:52:18.730131 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad92dc93-e42e-4fc2-a201-89128a8dd75c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:52:18.749501 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-ad92dc93-e42e-4fc2-a201-89128a8dd75c None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:52:18.750854 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-ad92dc93-e42e-4fc2-a201-89128a8dd75c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:52:18.758805 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1180/2383] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:52:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:52:18.762934 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4101f1-0bf5-4324-9243-1bac1c639b93 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:52:18.773271 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4101f1-0bf5-4324-9243-1bac1c639b93 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:52:18.778000 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2adc694-6a58-4413-a969-f57928b2f462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:52:18.778600 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2adc694-6a58-4413-a969-f57928b2f462 admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:52:18.778879 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2adc694-6a58-4413-a969-f57928b2f462 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:52:18.779156 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2adc694-6a58-4413-a969-f57928b2f462 admin admin] PATH_INFO: `/v3/domains` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:52:18.779834 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2adc694-6a58-4413-a969-f57928b2f462 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:52:18.780136 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2adc694-6a58-4413-a969-f57928b2f462 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:52:18.782471 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2adc694-6a58-4413-a969-f57928b2f462 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:52:18.796973 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1204/2384] 10.222.0.102 () {58 vars in 1158 bytes} [Mon Aug 1 15:52:18 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:52:18.798569 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad92dc93-e42e-4fc2-a201-89128a8dd75c None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:52:18.807975 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad92dc93-e42e-4fc2-a201-89128a8dd75c None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:52:18.812826 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fa0eac-8b08-4358-b4f9-f93e04ad88ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:52:18.813731 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fa0eac-8b08-4358-b4f9-f93e04ad88ff admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:52:18.814010 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fa0eac-8b08-4358-b4f9-f93e04ad88ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:52:18.814284 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fa0eac-8b08-4358-b4f9-f93e04ad88ff admin admin] PATH_INFO: `/v3/projects` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:52:18.815015 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fa0eac-8b08-4358-b4f9-f93e04ad88ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:52:18.817363 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fa0eac-8b08-4358-b4f9-f93e04ad88ff admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:52:18.922898 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1181/2385] 10.222.0.102 () {60 vars in 1158 bytes} [Mon Aug 1 15:52:18 2022] POST /identity/v3/projects => generated 368 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:52:18.927176 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2adc694-6a58-4413-a969-f57928b2f462 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:52:18.939940 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2adc694-6a58-4413-a969-f57928b2f462 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:52:19.002031 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46962908-16f0-40b3-b87e-8d98a0f3afd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:52:19.002968 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46962908-16f0-40b3-b87e-8d98a0f3afd0 admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:52:19.003837 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46962908-16f0-40b3-b87e-8d98a0f3afd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:52:19.004250 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46962908-16f0-40b3-b87e-8d98a0f3afd0 admin admin] PATH_INFO: `/v3/users` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:52:19.005261 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46962908-16f0-40b3-b87e-8d98a0f3afd0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:52:19.007436 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46962908-16f0-40b3-b87e-8d98a0f3afd0 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:52:19.134791 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1205/2386] 10.222.0.102 () {60 vars in 1149 bytes} [Mon Aug 1 15:52:18 2022] POST /identity/v3/users => generated 285 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:52:19.138929 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fa0eac-8b08-4358-b4f9-f93e04ad88ff admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:52:19.150205 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fa0eac-8b08-4358-b4f9-f93e04ad88ff admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:52:19.154788 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc93c9fc-7ad8-4898-87f2-a1c21c2e80b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:52:19.155393 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc93c9fc-7ad8-4898-87f2-a1c21c2e80b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:52:19.155768 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc93c9fc-7ad8-4898-87f2-a1c21c2e80b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:52:19.155979 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc93c9fc-7ad8-4898-87f2-a1c21c2e80b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:52:19.161281 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc93c9fc-7ad8-4898-87f2-a1c21c2e80b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:52:19.161281 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc93c9fc-7ad8-4898-87f2-a1c21c2e80b0 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:52:19.168665 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1182/2387] 10.222.0.102 () {58 vars in 1127 bytes} [Mon Aug 1 15:52:19 2022] GET /identity/v3/roles => generated 1427 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:52:19.173006 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46962908-16f0-40b3-b87e-8d98a0f3afd0 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:52:19.183060 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46962908-16f0-40b3-b87e-8d98a0f3afd0 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:52:19.188676 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6748d9bf-9572-48e2-9a56-6cbc12fae7a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:52:19.189338 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6748d9bf-9572-48e2-9a56-6cbc12fae7a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:52:19.189773 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6748d9bf-9572-48e2-9a56-6cbc12fae7a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:52:19.190048 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6748d9bf-9572-48e2-9a56-6cbc12fae7a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:52:19.190743 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6748d9bf-9572-48e2-9a56-6cbc12fae7a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:52:19.192394 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6748d9bf-9572-48e2-9a56-6cbc12fae7a1 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:52:19.203259 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1206/2388] 10.222.0.102 () {58 vars in 1127 bytes} [Mon Aug 1 15:52:19 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:52:19.208199 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc93c9fc-7ad8-4898-87f2-a1c21c2e80b0 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:52:19.218261 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc93c9fc-7ad8-4898-87f2-a1c21c2e80b0 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:52:19.222802 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bfccd5-f627-4224-a1bf-bee373be2f92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:52:19.223449 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bfccd5-f627-4224-a1bf-bee373be2f92 admin admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:52:19.223726 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bfccd5-f627-4224-a1bf-bee373be2f92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:52:19.223996 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bfccd5-f627-4224-a1bf-bee373be2f92 admin admin] PATH_INFO: `/v3/projects/35b6533f63fe461bbe8679b0ce8eba26/users/0ac1d52c48ed458d906da52e84814c68/roles/27f5093ac0674d799cdbd17c68482e32` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:52:19.238699 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bfccd5-f627-4224-a1bf-bee373be2f92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=35b6533f63fe461bbe8679b0ce8eba26, user_id=0ac1d52c48ed458d906da52e84814c68, role_id=27f5093ac0674d799cdbd17c68482e32)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:52:19.241517 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bfccd5-f627-4224-a1bf-bee373be2f92 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:52:19.290414 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1183/2389] 10.222.0.102 () {60 vars in 1488 bytes} [Mon Aug 1 15:52:19 2022] PUT /identity/v3/projects/35b6533f63fe461bbe8679b0ce8eba26/users/0ac1d52c48ed458d906da52e84814c68/roles/27f5093ac0674d799cdbd17c68482e32 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:52:19.301920 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8375ee87-92b6-4c95-84f4-d5fad06d29ce None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:52:19.302229 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8375ee87-92b6-4c95-84f4-d5fad06d29ce None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:52:19.302501 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8375ee87-92b6-4c95-84f4-d5fad06d29ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:52:19.338593 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-8375ee87-92b6-4c95-84f4-d5fad06d29ce None None] MFA Rules not processed for user `0ac1d52c48ed458d906da52e84814c68`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:52:19.339804 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-8375ee87-92b6-4c95-84f4-d5fad06d29ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:52:19.412414 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:52:19.418064 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1207/2390] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:52:19 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:52:19.430619 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bfccd5-f627-4224-a1bf-bee373be2f92 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:52:19.432302 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-c7bfccd5-f627-4224-a1bf-bee373be2f92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:52:19.437730 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=88,keystone:DELETE=9,keystone:INSERT=3 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:52:19.490643 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bfccd5-f627-4224-a1bf-bee373be2f92 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:52:19.494188 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b465cb04-7bf7-4d9a-9e92-4d8b27ec7cb3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '613da2657ae34558b355cac53c8bf29a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:52:19.494800 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b465cb04-7bf7-4d9a-9e92-4d8b27ec7cb3 service glance] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:52:19.495079 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b465cb04-7bf7-4d9a-9e92-4d8b27ec7cb3 service glance] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:52:19.498814 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b465cb04-7bf7-4d9a-9e92-4d8b27ec7cb3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:52:19.504326 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b465cb04-7bf7-4d9a-9e92-4d8b27ec7cb3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:52:19.505794 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b465cb04-7bf7-4d9a-9e92-4d8b27ec7cb3 service glance] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:52:19.514678 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1184/2391] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:52:19 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:52:29.516728 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:52:29.573975 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=25 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:52:49.638799 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8375ee87-92b6-4c95-84f4-d5fad06d29ce None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:52:49.640273 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-8375ee87-92b6-4c95-84f4-d5fad06d29ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:52:49.799465 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8375ee87-92b6-4c95-84f4-d5fad06d29ce None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:52:49.806267 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434771b0-735c-4c8d-813a-2ff523e8b025 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77b43f1ee8cc4be3907a494abe90c1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:52:49.806878 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434771b0-735c-4c8d-813a-2ff523e8b025 service nova] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:52:49.807184 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434771b0-735c-4c8d-813a-2ff523e8b025 service nova] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:52:49.807459 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434771b0-735c-4c8d-813a-2ff523e8b025 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:52:49.809397 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-434771b0-735c-4c8d-813a-2ff523e8b025 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:52:49.869271 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434771b0-735c-4c8d-813a-2ff523e8b025 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:52:49.870855 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434771b0-735c-4c8d-813a-2ff523e8b025 service nova] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:52:49.880025 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1208/2392] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:52:49 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:52:57.000205 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b465cb04-7bf7-4d9a-9e92-4d8b27ec7cb3 service glance] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:52:57.112220 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b465cb04-7bf7-4d9a-9e92-4d8b27ec7cb3 service glance] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:52:57.117582 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c841d3fc-b841-4e25-84a0-b8099c91a18e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:52:57.128129 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c841d3fc-b841-4e25-84a0-b8099c91a18e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:52:57.128129 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c841d3fc-b841-4e25-84a0-b8099c91a18e admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:52:57.128129 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c841d3fc-b841-4e25-84a0-b8099c91a18e admin admin] PATH_INFO: `/v3/users/0ac1d52c48ed458d906da52e84814c68` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:52:57.128129 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c841d3fc-b841-4e25-84a0-b8099c91a18e admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ac1d52c48ed458d906da52e84814c68)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:52:57.128129 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c841d3fc-b841-4e25-84a0-b8099c91a18e admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:52:57.297232 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-c841d3fc-b841-4e25-84a0-b8099c91a18e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ac1d52c48ed458d906da52e84814c68'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:52:57.367045 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-c841d3fc-b841-4e25-84a0-b8099c91a18e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ac1d52c48ed458d906da52e84814c68'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:52:57.379729 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-c841d3fc-b841-4e25-84a0-b8099c91a18e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ac1d52c48ed458d906da52e84814c68'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:52:57.380468 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-c841d3fc-b841-4e25-84a0-b8099c91a18e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ac1d52c48ed458d906da52e84814c68'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:52:57.381138 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-c841d3fc-b841-4e25-84a0-b8099c91a18e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ac1d52c48ed458d906da52e84814c68'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:52:57.393789 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1185/2393] 10.222.0.102 () {58 vars in 1229 bytes} [Mon Aug 1 15:52:56 2022] DELETE /identity/v3/users/0ac1d52c48ed458d906da52e84814c68 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:52:57.398478 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b468f09f-cc6c-4f08-bbe5-db8ba6c148d0 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:52:57.398959 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b468f09f-cc6c-4f08-bbe5-db8ba6c148d0 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:52:57.399064 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b468f09f-cc6c-4f08-bbe5-db8ba6c148d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:52:57.432055 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:52:57.439944 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-b468f09f-cc6c-4f08-bbe5-db8ba6c148d0 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:52:57.441193 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-b468f09f-cc6c-4f08-bbe5-db8ba6c148d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:52:57.500754 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1209/2394] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:52:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:52:57.510399 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c841d3fc-b841-4e25-84a0-b8099c91a18e admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:52:57.511820 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-c841d3fc-b841-4e25-84a0-b8099c91a18e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:52:57.558481 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:52:57.589162 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c841d3fc-b841-4e25-84a0-b8099c91a18e admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:52:57.592828 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b7affa-2a55-48ca-8938-9221d9f3a1cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a856a413100443939fe9b10daa868518', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:52:57.593473 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b7affa-2a55-48ca-8938-9221d9f3a1cf service neutron] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:52:57.593756 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b7affa-2a55-48ca-8938-9221d9f3a1cf service neutron] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:52:57.594028 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b7affa-2a55-48ca-8938-9221d9f3a1cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:52:57.604221 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b7affa-2a55-48ca-8938-9221d9f3a1cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:52:57.605677 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b7affa-2a55-48ca-8938-9221d9f3a1cf service neutron] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:52:57.615273 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1186/2395] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:52:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:52:58.107919 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b468f09f-cc6c-4f08-bbe5-db8ba6c148d0 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:52:58.109544 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-b468f09f-cc6c-4f08-bbe5-db8ba6c148d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:52:58.128748 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b468f09f-cc6c-4f08-bbe5-db8ba6c148d0 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:52:58.129138 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2aa6d70-bc4b-4421-9c3d-3a79ef8c8df0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:52:58.129793 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aa6d70-bc4b-4421-9c3d-3a79ef8c8df0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:52:58.130075 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aa6d70-bc4b-4421-9c3d-3a79ef8c8df0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:52:58.130349 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aa6d70-bc4b-4421-9c3d-3a79ef8c8df0 admin admin] PATH_INFO: `/v3/projects/35b6533f63fe461bbe8679b0ce8eba26` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:52:58.131524 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2aa6d70-bc4b-4421-9c3d-3a79ef8c8df0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=35b6533f63fe461bbe8679b0ce8eba26)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:52:58.133589 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2aa6d70-bc4b-4421-9c3d-3a79ef8c8df0 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:52:58.241850 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-b2aa6d70-bc4b-4421-9c3d-3a79ef8c8df0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35b6533f63fe461bbe8679b0ce8eba26', 'request_id': 'req-b2aa6d70-bc4b-4421-9c3d-3a79ef8c8df0'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:52:58.248006 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-b2aa6d70-bc4b-4421-9c3d-3a79ef8c8df0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35b6533f63fe461bbe8679b0ce8eba26', 'request_id': 'req-b2aa6d70-bc4b-4421-9c3d-3a79ef8c8df0'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:52:58.341069 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-b2aa6d70-bc4b-4421-9c3d-3a79ef8c8df0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35b6533f63fe461bbe8679b0ce8eba26', 'request_id': 'req-b2aa6d70-bc4b-4421-9c3d-3a79ef8c8df0'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:52:58.353237 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-b2aa6d70-bc4b-4421-9c3d-3a79ef8c8df0 admin admin] The token cache is being invalidate because project 35b6533f63fe461bbe8679b0ce8eba26 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80352) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 15:52:58.353525 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-b2aa6d70-bc4b-4421-9c3d-3a79ef8c8df0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:52:58.354168 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-b2aa6d70-bc4b-4421-9c3d-3a79ef8c8df0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:52:58.355725 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1210/2396] 10.222.0.102 () {58 vars in 1238 bytes} [Mon Aug 1 15:52:58 2022] DELETE /identity/v3/projects/35b6533f63fe461bbe8679b0ce8eba26 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:52:58.360624 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda4724e-ba56-4f69-878f-fc02e00569a1 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:52:58.361194 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda4724e-ba56-4f69-878f-fc02e00569a1 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:52:58.361298 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda4724e-ba56-4f69-878f-fc02e00569a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:52:58.411074 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-cda4724e-ba56-4f69-878f-fc02e00569a1 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:52:58.413072 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-cda4724e-ba56-4f69-878f-fc02e00569a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:52:58.472054 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1187/2397] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:52:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:52:58.480310 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2129f8e5-3660-48aa-9a36-2a7b3275542e None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:52:58.480777 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2129f8e5-3660-48aa-9a36-2a7b3275542e None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:52:58.480934 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2129f8e5-3660-48aa-9a36-2a7b3275542e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:52:58.501020 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-2129f8e5-3660-48aa-9a36-2a7b3275542e None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:52:58.501541 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-2129f8e5-3660-48aa-9a36-2a7b3275542e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:52:58.514601 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1211/2398] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:52:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:52:58.519100 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda4724e-ba56-4f69-878f-fc02e00569a1 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:52:58.529375 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda4724e-ba56-4f69-878f-fc02e00569a1 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:52:58.533968 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe83091-db03-4b31-922c-c161686301c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:52:58.534577 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe83091-db03-4b31-922c-c161686301c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:52:58.534858 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe83091-db03-4b31-922c-c161686301c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:52:58.535133 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe83091-db03-4b31-922c-c161686301c3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:52:58.535826 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe83091-db03-4b31-922c-c161686301c3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:52:58.536133 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe83091-db03-4b31-922c-c161686301c3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:52:58.538422 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe83091-db03-4b31-922c-c161686301c3 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:52:58.549839 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1188/2399] 10.222.0.102 () {58 vars in 1158 bytes} [Mon Aug 1 15:52:58 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:52:58.554004 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2129f8e5-3660-48aa-9a36-2a7b3275542e None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:52:58.563586 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2129f8e5-3660-48aa-9a36-2a7b3275542e None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:52:58.568737 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cfdedd-ac71-4fd4-98e4-6ea89ce679f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:52:58.569447 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cfdedd-ac71-4fd4-98e4-6ea89ce679f5 admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:52:58.569724 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cfdedd-ac71-4fd4-98e4-6ea89ce679f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:52:58.569992 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cfdedd-ac71-4fd4-98e4-6ea89ce679f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:52:58.570646 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cfdedd-ac71-4fd4-98e4-6ea89ce679f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:52:58.572541 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cfdedd-ac71-4fd4-98e4-6ea89ce679f5 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:52:58.690414 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1212/2400] 10.222.0.102 () {60 vars in 1158 bytes} [Mon Aug 1 15:52:58 2022] POST /identity/v3/projects => generated 366 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:52:58.695145 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe83091-db03-4b31-922c-c161686301c3 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:52:58.705298 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe83091-db03-4b31-922c-c161686301c3 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:52:58.761855 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b80880-f064-4f03-86a3-414edbd65292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:52:58.762404 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b80880-f064-4f03-86a3-414edbd65292 admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:52:58.762686 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b80880-f064-4f03-86a3-414edbd65292 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:52:58.762960 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b80880-f064-4f03-86a3-414edbd65292 admin admin] PATH_INFO: `/v3/users` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:52:58.763726 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b80880-f064-4f03-86a3-414edbd65292 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:52:58.765683 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b80880-f064-4f03-86a3-414edbd65292 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:52:58.879179 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1189/2401] 10.222.0.102 () {60 vars in 1149 bytes} [Mon Aug 1 15:52:58 2022] POST /identity/v3/users => generated 284 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:52:58.888402 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cfdedd-ac71-4fd4-98e4-6ea89ce679f5 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:52:58.899592 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cfdedd-ac71-4fd4-98e4-6ea89ce679f5 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:52:58.904296 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f17332-85e1-4f3d-a4f7-8847904fbd2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:52:58.904926 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f17332-85e1-4f3d-a4f7-8847904fbd2c admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:52:58.905204 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f17332-85e1-4f3d-a4f7-8847904fbd2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:52:58.905471 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f17332-85e1-4f3d-a4f7-8847904fbd2c admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:52:58.906149 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f17332-85e1-4f3d-a4f7-8847904fbd2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:52:58.907736 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f17332-85e1-4f3d-a4f7-8847904fbd2c admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:52:58.917657 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1213/2402] 10.222.0.102 () {58 vars in 1127 bytes} [Mon Aug 1 15:52:58 2022] GET /identity/v3/roles => generated 1427 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:52:58.921819 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b80880-f064-4f03-86a3-414edbd65292 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:52:58.933973 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b80880-f064-4f03-86a3-414edbd65292 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:52:58.938909 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf2741e-c7ca-4634-b3eb-d273fc24c7e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:52:58.939524 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf2741e-c7ca-4634-b3eb-d273fc24c7e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:52:58.939809 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf2741e-c7ca-4634-b3eb-d273fc24c7e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:52:58.940087 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf2741e-c7ca-4634-b3eb-d273fc24c7e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:52:58.940784 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf2741e-c7ca-4634-b3eb-d273fc24c7e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:52:58.942520 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf2741e-c7ca-4634-b3eb-d273fc24c7e8 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:52:58.954342 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1190/2403] 10.222.0.102 () {58 vars in 1127 bytes} [Mon Aug 1 15:52:58 2022] GET /identity/v3/roles => generated 1427 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:52:58.958448 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f17332-85e1-4f3d-a4f7-8847904fbd2c admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:52:58.968394 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f17332-85e1-4f3d-a4f7-8847904fbd2c admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:52:58.973126 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78534207-cdba-4875-af4b-be0d92487115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:52:58.973811 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78534207-cdba-4875-af4b-be0d92487115 admin admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:52:58.974090 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78534207-cdba-4875-af4b-be0d92487115 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:52:58.974363 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78534207-cdba-4875-af4b-be0d92487115 admin admin] PATH_INFO: `/v3/projects/dbeaac52eefb4b43a2e0b9f7ba0c74b3/users/fdb316b294a44e659ff92bacf009f829/roles/27f5093ac0674d799cdbd17c68482e32` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:52:58.988762 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78534207-cdba-4875-af4b-be0d92487115 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dbeaac52eefb4b43a2e0b9f7ba0c74b3, user_id=fdb316b294a44e659ff92bacf009f829, role_id=27f5093ac0674d799cdbd17c68482e32)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:52:58.991954 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78534207-cdba-4875-af4b-be0d92487115 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:52:59.076312 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1214/2404] 10.222.0.102 () {60 vars in 1488 bytes} [Mon Aug 1 15:52:58 2022] PUT /identity/v3/projects/dbeaac52eefb4b43a2e0b9f7ba0c74b3/users/fdb316b294a44e659ff92bacf009f829/roles/27f5093ac0674d799cdbd17c68482e32 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:52:59.142864 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c0b8f7-a0e4-4d31-ad8a-182d6649b071 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:52:59.143146 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c0b8f7-a0e4-4d31-ad8a-182d6649b071 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:52:59.143418 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c0b8f7-a0e4-4d31-ad8a-182d6649b071 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:52:59.162739 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:52:59.171040 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-f3c0b8f7-a0e4-4d31-ad8a-182d6649b071 None None] MFA Rules not processed for user `fdb316b294a44e659ff92bacf009f829`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:52:59.174730 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-f3c0b8f7-a0e4-4d31-ad8a-182d6649b071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:52:59.239062 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1191/2405] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:52:59 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:52:59.250864 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78534207-cdba-4875-af4b-be0d92487115 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:52:59.252562 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-78534207-cdba-4875-af4b-be0d92487115 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:52:59.279498 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:52:59.332824 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78534207-cdba-4875-af4b-be0d92487115 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:52:59.336462 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666373a7-8bd3-45db-a150-cb631500a0c5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff810b37183c4729859c1b05edff1703', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:52:59.337100 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666373a7-8bd3-45db-a150-cb631500a0c5 service cinder] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:52:59.337380 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666373a7-8bd3-45db-a150-cb631500a0c5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:52:59.337653 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666373a7-8bd3-45db-a150-cb631500a0c5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:52:59.345973 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666373a7-8bd3-45db-a150-cb631500a0c5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:52:59.347394 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666373a7-8bd3-45db-a150-cb631500a0c5 service cinder] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:52:59.356776 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1215/2406] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:52:59 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:53:09.236158 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=28 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:53:09.420701 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=24 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:53:11.692162 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696fbf37-5581-4c69-9d63-4f85add1a4c8 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:53:11.692689 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696fbf37-5581-4c69-9d63-4f85add1a4c8 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:53:11.692962 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696fbf37-5581-4c69-9d63-4f85add1a4c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:53:11.724082 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-696fbf37-5581-4c69-9d63-4f85add1a4c8 None None] MFA Rules not processed for user `ae8514df55144c9086ed98ba44efbbd4`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:53:11.725340 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-696fbf37-5581-4c69-9d63-4f85add1a4c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:53:11.784185 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1192/2407] 10.222.0.102 () {58 vars in 1014 bytes} [Mon Aug 1 15:53:11 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:53:11.985845 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666373a7-8bd3-45db-a150-cb631500a0c5 service cinder] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:53:11.987014 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-666373a7-8bd3-45db-a150-cb631500a0c5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:53:12.057969 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666373a7-8bd3-45db-a150-cb631500a0c5 service cinder] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:53:12.063426 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ff4761-b838-49e2-8d7f-bbaac300de32 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90673f47354f4403aa0e12e3658441c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:53:12.064025 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ff4761-b838-49e2-8d7f-bbaac300de32 service swift] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:53:12.064359 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ff4761-b838-49e2-8d7f-bbaac300de32 service swift] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:53:12.064627 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ff4761-b838-49e2-8d7f-bbaac300de32 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:53:12.072687 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ff4761-b838-49e2-8d7f-bbaac300de32 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:53:12.074340 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ff4761-b838-49e2-8d7f-bbaac300de32 service swift] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:53:12.082483 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1216/2408] 10.222.0.102 () {60 vars in 1389 bytes} [Mon Aug 1 15:53:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 01 15:53:21.777427 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=29 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:53:22.080891 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=32 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:53:26.793587 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696fbf37-5581-4c69-9d63-4f85add1a4c8 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:53:26.795021 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-696fbf37-5581-4c69-9d63-4f85add1a4c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:53:26.907709 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696fbf37-5581-4c69-9d63-4f85add1a4c8 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:53:26.912977 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4c3514-8c02-4f5b-bb16-85c11212b5c0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b78f5749fe9c46a389c88bb9c222cc73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:53:26.913667 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4c3514-8c02-4f5b-bb16-85c11212b5c0 service placement] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:53:26.913947 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4c3514-8c02-4f5b-bb16-85c11212b5c0 service placement] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:53:26.914222 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4c3514-8c02-4f5b-bb16-85c11212b5c0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:53:26.916061 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-0b4c3514-8c02-4f5b-bb16-85c11212b5c0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:53:26.928633 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4c3514-8c02-4f5b-bb16-85c11212b5c0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:53:26.930276 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4c3514-8c02-4f5b-bb16-85c11212b5c0 service placement] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:53:26.941286 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1193/2409] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:53:26 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:53:30.719246 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0587ba1-250c-481e-881c-3dd2901de000 None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:53:30.719862 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0587ba1-250c-481e-881c-3dd2901de000 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:53:30.719862 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0587ba1-250c-481e-881c-3dd2901de000 None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:53:30.721613 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1217/2410] 10.222.0.102 () {54 vars in 926 bytes} [Mon Aug 1 15:53:30 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 15:53:30.727402 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97199d94-ed72-4dc4-9984-348165d38247 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:53:30.727900 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97199d94-ed72-4dc4-9984-348165d38247 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:53:30.728105 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97199d94-ed72-4dc4-9984-348165d38247 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:53:30.750987 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-97199d94-ed72-4dc4-9984-348165d38247 None None] MFA Rules not processed for user `77b43f1ee8cc4be3907a494abe90c1cc`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:53:30.752222 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-97199d94-ed72-4dc4-9984-348165d38247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:53:30.824337 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1194/2411] 10.222.0.102 () {58 vars in 1023 bytes} [Mon Aug 1 15:53:30 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:53:30.835636 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0587ba1-250c-481e-881c-3dd2901de000 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:53:30.837336 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-d0587ba1-250c-481e-881c-3dd2901de000 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:53:30.895976 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0587ba1-250c-481e-881c-3dd2901de000 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:53:30.899528 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ba8f4a-f616-41f1-9498-946012c41c2a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '613da2657ae34558b355cac53c8bf29a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:53:30.900130 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ba8f4a-f616-41f1-9498-946012c41c2a service glance] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:53:30.900408 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ba8f4a-f616-41f1-9498-946012c41c2a service glance] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:53:30.900683 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ba8f4a-f616-41f1-9498-946012c41c2a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:53:30.910644 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ba8f4a-f616-41f1-9498-946012c41c2a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:53:30.912063 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ba8f4a-f616-41f1-9498-946012c41c2a service glance] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:53:30.923186 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1218/2412] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:53:30 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:53:31.129665 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc68bd8-1977-49a8-8af3-ad5004130a8e None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:53:31.129869 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc68bd8-1977-49a8-8af3-ad5004130a8e None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:53:31.130138 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc68bd8-1977-49a8-8af3-ad5004130a8e None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:53:31.131517 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1195/2413] 10.222.0.102 () {54 vars in 926 bytes} [Mon Aug 1 15:53:31 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 15:53:31.136288 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5a0485-b6e5-4f99-a44e-7722937d19b2 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:53:31.136571 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5a0485-b6e5-4f99-a44e-7722937d19b2 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:53:31.136862 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5a0485-b6e5-4f99-a44e-7722937d19b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:53:31.157752 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-4f5a0485-b6e5-4f99-a44e-7722937d19b2 None None] MFA Rules not processed for user `a856a413100443939fe9b10daa868518`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:53:31.159439 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-4f5a0485-b6e5-4f99-a44e-7722937d19b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:53:31.210269 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1219/2414] 10.222.0.102 () {58 vars in 1023 bytes} [Mon Aug 1 15:53:31 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:53:31.222907 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc68bd8-1977-49a8-8af3-ad5004130a8e None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:53:31.224630 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-6cc68bd8-1977-49a8-8af3-ad5004130a8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:53:31.240020 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc68bd8-1977-49a8-8af3-ad5004130a8e None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:53:31.243983 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345fbc8b-3465-4ff3-b4d2-538900c9d850 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a856a413100443939fe9b10daa868518', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:53:31.244605 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345fbc8b-3465-4ff3-b4d2-538900c9d850 service neutron] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:53:31.244907 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345fbc8b-3465-4ff3-b4d2-538900c9d850 service neutron] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:53:31.245203 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345fbc8b-3465-4ff3-b4d2-538900c9d850 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:53:31.253067 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345fbc8b-3465-4ff3-b4d2-538900c9d850 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:53:31.254498 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345fbc8b-3465-4ff3-b4d2-538900c9d850 service neutron] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:53:31.262361 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1196/2415] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:53:31 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:53:31.348094 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7b850e-a6c6-4a0f-a9fa-83d1227b6476 None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:53:31.348378 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7b850e-a6c6-4a0f-a9fa-83d1227b6476 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:53:31.348678 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7b850e-a6c6-4a0f-a9fa-83d1227b6476 None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:53:31.350080 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1220/2416] 10.222.0.102 () {54 vars in 926 bytes} [Mon Aug 1 15:53:31 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 15:53:31.356778 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774f7237-387e-40af-8a90-dea96cc135b2 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:53:31.357094 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774f7237-387e-40af-8a90-dea96cc135b2 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:53:31.357411 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774f7237-387e-40af-8a90-dea96cc135b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:53:31.379799 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-774f7237-387e-40af-8a90-dea96cc135b2 None None] MFA Rules not processed for user `77b43f1ee8cc4be3907a494abe90c1cc`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:53:31.381192 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-774f7237-387e-40af-8a90-dea96cc135b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:53:31.391866 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1197/2417] 10.222.0.102 () {58 vars in 1023 bytes} [Mon Aug 1 15:53:31 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:53:31.403339 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7b850e-a6c6-4a0f-a9fa-83d1227b6476 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:53:31.415396 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7b850e-a6c6-4a0f-a9fa-83d1227b6476 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:53:31.419478 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ca30a4-a3da-4780-a2d9-df04138adfea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a856a413100443939fe9b10daa868518', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:53:31.420202 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ca30a4-a3da-4780-a2d9-df04138adfea service neutron] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:53:31.420561 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ca30a4-a3da-4780-a2d9-df04138adfea service neutron] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:53:31.420928 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ca30a4-a3da-4780-a2d9-df04138adfea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:53:31.432230 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ca30a4-a3da-4780-a2d9-df04138adfea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:53:31.433695 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ca30a4-a3da-4780-a2d9-df04138adfea service neutron] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:53:31.444988 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1221/2418] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:53:31 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:53:35.713678 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bd533c-33a8-486d-aa99-3744487a2d2b None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:53:35.714177 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bd533c-33a8-486d-aa99-3744487a2d2b None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:53:35.714365 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bd533c-33a8-486d-aa99-3744487a2d2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:53:35.734189 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-26bd533c-33a8-486d-aa99-3744487a2d2b None None] MFA Rules not processed for user `ae8514df55144c9086ed98ba44efbbd4`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:53:35.735545 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-26bd533c-33a8-486d-aa99-3744487a2d2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:53:35.742933 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1198/2419] 10.222.0.102 () {58 vars in 1014 bytes} [Mon Aug 1 15:53:35 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:53:35.757991 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ca30a4-a3da-4780-a2d9-df04138adfea service neutron] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:53:35.769775 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ca30a4-a3da-4780-a2d9-df04138adfea service neutron] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:53:35.777343 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58908b6-030c-4e7e-9104-9dd9ca740d1e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90673f47354f4403aa0e12e3658441c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:53:35.778021 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58908b6-030c-4e7e-9104-9dd9ca740d1e service swift] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:53:35.778365 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58908b6-030c-4e7e-9104-9dd9ca740d1e service swift] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:53:35.778719 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58908b6-030c-4e7e-9104-9dd9ca740d1e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:53:35.787227 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58908b6-030c-4e7e-9104-9dd9ca740d1e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:53:35.788920 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58908b6-030c-4e7e-9104-9dd9ca740d1e service swift] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:53:35.798086 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1222/2420] 10.222.0.102 () {60 vars in 1389 bytes} [Mon Aug 1 15:53:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 01 15:53:45.728800 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=84 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:53:45.794547 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=61 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:53:46.077221 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bd533c-33a8-486d-aa99-3744487a2d2b None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:53:46.142261 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bd533c-33a8-486d-aa99-3744487a2d2b None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:53:46.147061 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6536f3-7138-46a3-b29e-4582d1eb49b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:53:46.147708 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6536f3-7138-46a3-b29e-4582d1eb49b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:53:46.147990 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6536f3-7138-46a3-b29e-4582d1eb49b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:53:46.148264 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6536f3-7138-46a3-b29e-4582d1eb49b8 admin admin] PATH_INFO: `/v3/users/fdb316b294a44e659ff92bacf009f829` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:53:46.149484 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6536f3-7138-46a3-b29e-4582d1eb49b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fdb316b294a44e659ff92bacf009f829)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:53:46.155882 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6536f3-7138-46a3-b29e-4582d1eb49b8 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:53:46.352923 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-6c6536f3-7138-46a3-b29e-4582d1eb49b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fdb316b294a44e659ff92bacf009f829'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:53:46.424677 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-6c6536f3-7138-46a3-b29e-4582d1eb49b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fdb316b294a44e659ff92bacf009f829'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:53:46.437549 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-6c6536f3-7138-46a3-b29e-4582d1eb49b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fdb316b294a44e659ff92bacf009f829'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:53:46.438261 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-6c6536f3-7138-46a3-b29e-4582d1eb49b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fdb316b294a44e659ff92bacf009f829'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:53:46.438927 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-6c6536f3-7138-46a3-b29e-4582d1eb49b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fdb316b294a44e659ff92bacf009f829'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:53:46.451818 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1199/2421] 10.222.0.102 () {58 vars in 1229 bytes} [Mon Aug 1 15:53:46 2022] DELETE /identity/v3/users/fdb316b294a44e659ff92bacf009f829 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:53:46.456262 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7616ddf1-cec8-4c95-8fe0-d75614031b67 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:53:46.456544 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7616ddf1-cec8-4c95-8fe0-d75614031b67 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:53:46.456818 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7616ddf1-cec8-4c95-8fe0-d75614031b67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:53:46.476229 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-7616ddf1-cec8-4c95-8fe0-d75614031b67 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:53:46.481297 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-7616ddf1-cec8-4c95-8fe0-d75614031b67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:53:46.535791 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1223/2422] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:53:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:53:46.545592 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6536f3-7138-46a3-b29e-4582d1eb49b8 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:53:46.546990 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-6c6536f3-7138-46a3-b29e-4582d1eb49b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:53:46.603974 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6536f3-7138-46a3-b29e-4582d1eb49b8 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:53:46.607703 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ed7a27-84a7-40cf-8fb5-514d7a566318 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a856a413100443939fe9b10daa868518', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:53:46.608308 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ed7a27-84a7-40cf-8fb5-514d7a566318 service neutron] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:53:46.608588 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ed7a27-84a7-40cf-8fb5-514d7a566318 service neutron] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:53:46.608869 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ed7a27-84a7-40cf-8fb5-514d7a566318 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:53:46.617926 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ed7a27-84a7-40cf-8fb5-514d7a566318 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:53:46.619390 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ed7a27-84a7-40cf-8fb5-514d7a566318 service neutron] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:53:46.628965 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1200/2423] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:53:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:53:47.018518 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7616ddf1-cec8-4c95-8fe0-d75614031b67 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:53:47.020024 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-7616ddf1-cec8-4c95-8fe0-d75614031b67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:53:47.032048 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7616ddf1-cec8-4c95-8fe0-d75614031b67 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:53:47.038601 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9016a57-4113-4167-8234-9f6d0a6a822b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:53:47.039620 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9016a57-4113-4167-8234-9f6d0a6a822b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:53:47.040071 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9016a57-4113-4167-8234-9f6d0a6a822b admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:53:47.040536 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9016a57-4113-4167-8234-9f6d0a6a822b admin admin] PATH_INFO: `/v3/projects/dbeaac52eefb4b43a2e0b9f7ba0c74b3` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:53:47.042334 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9016a57-4113-4167-8234-9f6d0a6a822b admin admin] RBAC: Authorizing `identity:delete_project(project_id=dbeaac52eefb4b43a2e0b9f7ba0c74b3)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:53:47.046031 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9016a57-4113-4167-8234-9f6d0a6a822b admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:53:47.166115 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-c9016a57-4113-4167-8234-9f6d0a6a822b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dbeaac52eefb4b43a2e0b9f7ba0c74b3', 'request_id': 'req-c9016a57-4113-4167-8234-9f6d0a6a822b'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:53:47.172417 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-c9016a57-4113-4167-8234-9f6d0a6a822b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dbeaac52eefb4b43a2e0b9f7ba0c74b3', 'request_id': 'req-c9016a57-4113-4167-8234-9f6d0a6a822b'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:53:47.229881 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-c9016a57-4113-4167-8234-9f6d0a6a822b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dbeaac52eefb4b43a2e0b9f7ba0c74b3', 'request_id': 'req-c9016a57-4113-4167-8234-9f6d0a6a822b'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:53:47.240381 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-c9016a57-4113-4167-8234-9f6d0a6a822b admin admin] The token cache is being invalidate because project dbeaac52eefb4b43a2e0b9f7ba0c74b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80352) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 15:53:47.240661 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-c9016a57-4113-4167-8234-9f6d0a6a822b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:53:47.241296 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-c9016a57-4113-4167-8234-9f6d0a6a822b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:53:47.242799 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1224/2424] 10.222.0.102 () {58 vars in 1238 bytes} [Mon Aug 1 15:53:47 2022] DELETE /identity/v3/projects/dbeaac52eefb4b43a2e0b9f7ba0c74b3 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:53:47.248249 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a561bf-297d-4ae1-9f8b-f05be368d204 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:53:47.248727 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a561bf-297d-4ae1-9f8b-f05be368d204 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:53:47.248830 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a561bf-297d-4ae1-9f8b-f05be368d204 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:53:47.268120 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-30a561bf-297d-4ae1-9f8b-f05be368d204 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:53:47.269280 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-30a561bf-297d-4ae1-9f8b-f05be368d204 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:53:47.285619 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:53:47.329133 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1201/2425] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:53:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:53:47.336985 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c1ea06-964d-4420-a6c7-0dc124459f27 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:53:47.337271 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c1ea06-964d-4420-a6c7-0dc124459f27 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:53:47.337567 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c1ea06-964d-4420-a6c7-0dc124459f27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:53:47.357716 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-03c1ea06-964d-4420-a6c7-0dc124459f27 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:53:47.358935 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-03c1ea06-964d-4420-a6c7-0dc124459f27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:53:47.367059 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1225/2426] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:53:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:53:47.371894 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a561bf-297d-4ae1-9f8b-f05be368d204 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:53:47.381470 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a561bf-297d-4ae1-9f8b-f05be368d204 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:53:47.386130 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49149a03-1c5e-4d82-ba73-0600d6adbb7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:53:47.386745 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49149a03-1c5e-4d82-ba73-0600d6adbb7d admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:53:47.387025 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49149a03-1c5e-4d82-ba73-0600d6adbb7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:53:47.387299 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49149a03-1c5e-4d82-ba73-0600d6adbb7d admin admin] PATH_INFO: `/v3/domains` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:53:47.388000 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49149a03-1c5e-4d82-ba73-0600d6adbb7d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:53:47.388302 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49149a03-1c5e-4d82-ba73-0600d6adbb7d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:53:47.389939 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49149a03-1c5e-4d82-ba73-0600d6adbb7d admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:53:47.401767 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1202/2427] 10.222.0.102 () {58 vars in 1158 bytes} [Mon Aug 1 15:53:47 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:53:47.406214 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c1ea06-964d-4420-a6c7-0dc124459f27 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:53:47.416066 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c1ea06-964d-4420-a6c7-0dc124459f27 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:53:47.425008 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a9a93e-c888-4081-8fc6-a78ce6ca7f42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:53:47.425631 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a9a93e-c888-4081-8fc6-a78ce6ca7f42 admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:53:47.425907 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a9a93e-c888-4081-8fc6-a78ce6ca7f42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:53:47.426177 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a9a93e-c888-4081-8fc6-a78ce6ca7f42 admin admin] PATH_INFO: `/v3/projects` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:53:47.426841 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a9a93e-c888-4081-8fc6-a78ce6ca7f42 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:53:47.428752 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a9a93e-c888-4081-8fc6-a78ce6ca7f42 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:53:47.567581 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1226/2428] 10.222.0.102 () {60 vars in 1158 bytes} [Mon Aug 1 15:53:47 2022] POST /identity/v3/projects => generated 380 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:53:47.571738 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49149a03-1c5e-4d82-ba73-0600d6adbb7d admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:53:47.581927 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49149a03-1c5e-4d82-ba73-0600d6adbb7d admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:53:47.638139 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d14f46-81e9-4f62-be0e-ce9e88997402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:53:47.638750 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d14f46-81e9-4f62-be0e-ce9e88997402 admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:53:47.639051 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d14f46-81e9-4f62-be0e-ce9e88997402 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:53:47.639321 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d14f46-81e9-4f62-be0e-ce9e88997402 admin admin] PATH_INFO: `/v3/users` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:53:47.639982 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d14f46-81e9-4f62-be0e-ce9e88997402 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:53:47.642013 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d14f46-81e9-4f62-be0e-ce9e88997402 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:53:47.750766 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1203/2429] 10.222.0.102 () {60 vars in 1149 bytes} [Mon Aug 1 15:53:47 2022] POST /identity/v3/users => generated 291 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:53:47.754901 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a9a93e-c888-4081-8fc6-a78ce6ca7f42 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:53:47.766269 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a9a93e-c888-4081-8fc6-a78ce6ca7f42 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:53:47.771105 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16801b8d-7ae0-4f95-8f5b-75727cf7d5af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:53:47.771826 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16801b8d-7ae0-4f95-8f5b-75727cf7d5af admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:53:47.772258 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16801b8d-7ae0-4f95-8f5b-75727cf7d5af admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:53:47.772647 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16801b8d-7ae0-4f95-8f5b-75727cf7d5af admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:53:47.773462 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16801b8d-7ae0-4f95-8f5b-75727cf7d5af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:53:47.775554 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16801b8d-7ae0-4f95-8f5b-75727cf7d5af admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:53:47.791295 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1227/2430] 10.222.0.102 () {58 vars in 1127 bytes} [Mon Aug 1 15:53:47 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:53:47.793525 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d14f46-81e9-4f62-be0e-ce9e88997402 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:53:47.804954 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d14f46-81e9-4f62-be0e-ce9e88997402 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:53:47.809976 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d604bc-3a3b-47b5-b124-342efe972d06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:53:47.810596 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d604bc-3a3b-47b5-b124-342efe972d06 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:53:47.811157 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d604bc-3a3b-47b5-b124-342efe972d06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:53:47.811436 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d604bc-3a3b-47b5-b124-342efe972d06 admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:53:47.812136 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d604bc-3a3b-47b5-b124-342efe972d06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:53:47.815582 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d604bc-3a3b-47b5-b124-342efe972d06 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:53:47.825517 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1204/2431] 10.222.0.102 () {58 vars in 1127 bytes} [Mon Aug 1 15:53:47 2022] GET /identity/v3/roles => generated 1427 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:53:47.829640 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16801b8d-7ae0-4f95-8f5b-75727cf7d5af admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:53:47.840545 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16801b8d-7ae0-4f95-8f5b-75727cf7d5af admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:53:47.845266 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a12d53-6485-486b-84df-07a04e5e8493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:53:47.851945 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a12d53-6485-486b-84df-07a04e5e8493 admin admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:53:47.851945 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a12d53-6485-486b-84df-07a04e5e8493 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:53:47.851945 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a12d53-6485-486b-84df-07a04e5e8493 admin admin] PATH_INFO: `/v3/projects/09d821cdd63f4fdcafad2f1781a9bf5e/users/1a12e93026eb42849e473fe8d82e2a5e/roles/27f5093ac0674d799cdbd17c68482e32` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:53:47.861862 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a12d53-6485-486b-84df-07a04e5e8493 admin admin] RBAC: Authorizing `identity:create_grant(project_id=09d821cdd63f4fdcafad2f1781a9bf5e, user_id=1a12e93026eb42849e473fe8d82e2a5e, role_id=27f5093ac0674d799cdbd17c68482e32)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:53:47.864534 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a12d53-6485-486b-84df-07a04e5e8493 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:53:47.977597 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1228/2432] 10.222.0.102 () {60 vars in 1488 bytes} [Mon Aug 1 15:53:47 2022] PUT /identity/v3/projects/09d821cdd63f4fdcafad2f1781a9bf5e/users/1a12e93026eb42849e473fe8d82e2a5e/roles/27f5093ac0674d799cdbd17c68482e32 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:53:47.982946 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b295fdff-88c7-4c81-8fad-87a9135efd38 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:53:47.983234 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b295fdff-88c7-4c81-8fad-87a9135efd38 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:53:47.983513 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b295fdff-88c7-4c81-8fad-87a9135efd38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:53:48.002271 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-b295fdff-88c7-4c81-8fad-87a9135efd38 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:53:48.007727 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-b295fdff-88c7-4c81-8fad-87a9135efd38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:53:48.062540 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1205/2433] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:53:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:53:48.072550 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a12d53-6485-486b-84df-07a04e5e8493 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:53:48.074385 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-67a12d53-6485-486b-84df-07a04e5e8493 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:53:48.097318 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:53:48.140365 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a12d53-6485-486b-84df-07a04e5e8493 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:53:48.145637 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e219947d-d357-4da2-9f64-1a6e23f10602 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a856a413100443939fe9b10daa868518', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:53:48.146515 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e219947d-d357-4da2-9f64-1a6e23f10602 service neutron] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:53:48.146979 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e219947d-d357-4da2-9f64-1a6e23f10602 service neutron] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:53:48.147380 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e219947d-d357-4da2-9f64-1a6e23f10602 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:53:48.160907 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e219947d-d357-4da2-9f64-1a6e23f10602 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:53:48.162373 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e219947d-d357-4da2-9f64-1a6e23f10602 service neutron] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:53:48.174527 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1229/2434] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:53:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:53:49.364127 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928189a5-ed62-4a61-aba7-8560e1ee9b29 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:53:49.364637 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928189a5-ed62-4a61-aba7-8560e1ee9b29 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:53:49.364732 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928189a5-ed62-4a61-aba7-8560e1ee9b29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:53:49.393201 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-928189a5-ed62-4a61-aba7-8560e1ee9b29 None None] MFA Rules not processed for user `1a12e93026eb42849e473fe8d82e2a5e`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:53:49.394432 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-928189a5-ed62-4a61-aba7-8560e1ee9b29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:53:49.412632 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:53:49.463392 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1206/2435] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:53:49 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:53:49.474322 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e219947d-d357-4da2-9f64-1a6e23f10602 service neutron] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:53:49.475789 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-e219947d-d357-4da2-9f64-1a6e23f10602 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:53:49.534301 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e219947d-d357-4da2-9f64-1a6e23f10602 service neutron] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:53:49.538235 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9048d2a-38d9-448b-8fde-dbc6c95130e6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff810b37183c4729859c1b05edff1703', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:53:49.538840 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9048d2a-38d9-448b-8fde-dbc6c95130e6 service cinder] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:53:49.539114 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9048d2a-38d9-448b-8fde-dbc6c95130e6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:53:49.539380 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9048d2a-38d9-448b-8fde-dbc6c95130e6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:53:49.547956 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9048d2a-38d9-448b-8fde-dbc6c95130e6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:53:49.549738 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9048d2a-38d9-448b-8fde-dbc6c95130e6 service cinder] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:53:49.561072 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1230/2436] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:53:49 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:53:52.129113 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfbde34-f25e-49c2-95ba-77f68649b2cc None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:53:52.129630 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfbde34-f25e-49c2-95ba-77f68649b2cc None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:53:52.129727 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfbde34-f25e-49c2-95ba-77f68649b2cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:53:52.148753 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-4dfbde34-f25e-49c2-95ba-77f68649b2cc None None] MFA Rules not processed for user `1a12e93026eb42849e473fe8d82e2a5e`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:53:52.150080 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-4dfbde34-f25e-49c2-95ba-77f68649b2cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:53:52.158124 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1207/2437] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:53:52 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:53:56.125713 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bba55a-ad5b-4388-ac35-b52e53afebb4 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:53:56.126179 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bba55a-ad5b-4388-ac35-b52e53afebb4 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:53:56.126288 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bba55a-ad5b-4388-ac35-b52e53afebb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:53:56.147168 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-99bba55a-ad5b-4388-ac35-b52e53afebb4 None None] MFA Rules not processed for user `ae8514df55144c9086ed98ba44efbbd4`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:53:56.148600 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-99bba55a-ad5b-4388-ac35-b52e53afebb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:53:56.210895 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1231/2438] 10.222.0.102 () {58 vars in 972 bytes} [Mon Aug 1 15:53:56 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:53:56.229221 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfbde34-f25e-49c2-95ba-77f68649b2cc None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:53:56.231118 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-4dfbde34-f25e-49c2-95ba-77f68649b2cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:53:56.300192 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfbde34-f25e-49c2-95ba-77f68649b2cc None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:53:56.305363 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9af0807-a773-42e6-b438-af6025d5197d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90673f47354f4403aa0e12e3658441c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:53:56.305984 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9af0807-a773-42e6-b438-af6025d5197d service swift] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:53:56.306262 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9af0807-a773-42e6-b438-af6025d5197d service swift] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:53:56.306564 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9af0807-a773-42e6-b438-af6025d5197d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:53:56.315524 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9af0807-a773-42e6-b438-af6025d5197d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:53:56.317126 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9af0807-a773-42e6-b438-af6025d5197d service swift] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:53:56.325641 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1208/2439] 10.222.0.102 () {60 vars in 1389 bytes} [Mon Aug 1 15:53:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 01 15:54:06.202077 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=68 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:54:06.321866 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=54 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:54:06.353697 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bba55a-ad5b-4388-ac35-b52e53afebb4 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:54:06.364061 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bba55a-ad5b-4388-ac35-b52e53afebb4 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:54:06.368071 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0274b7-127d-46b6-9667-c5e02cca68b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a856a413100443939fe9b10daa868518', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:54:06.368640 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0274b7-127d-46b6-9667-c5e02cca68b4 service neutron] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:06.368950 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0274b7-127d-46b6-9667-c5e02cca68b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:06.369226 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0274b7-127d-46b6-9667-c5e02cca68b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:06.371027 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-5b0274b7-127d-46b6-9667-c5e02cca68b4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:54:06.383083 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0274b7-127d-46b6-9667-c5e02cca68b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:54:06.384505 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0274b7-127d-46b6-9667-c5e02cca68b4 service neutron] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:54:06.394227 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1232/2440] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:54:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:54:10.220250 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9af0807-a773-42e6-b438-af6025d5197d service swift] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:54:10.221778 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-e9af0807-a773-42e6-b438-af6025d5197d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:54:10.236258 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9af0807-a773-42e6-b438-af6025d5197d service swift] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:54:10.240781 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ecdb1b-4135-42a6-ab89-b90a24f9b1d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:54:10.241440 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ecdb1b-4135-42a6-ab89-b90a24f9b1d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:10.241744 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ecdb1b-4135-42a6-ab89-b90a24f9b1d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:10.241997 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ecdb1b-4135-42a6-ab89-b90a24f9b1d3 admin admin] PATH_INFO: `/v3/users/d33afc6f3cc746f6a28e60b0c65f6b89` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:10.243185 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ecdb1b-4135-42a6-ab89-b90a24f9b1d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d33afc6f3cc746f6a28e60b0c65f6b89)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:54:10.245160 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ecdb1b-4135-42a6-ab89-b90a24f9b1d3 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:54:10.410594 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-f7ecdb1b-4135-42a6-ab89-b90a24f9b1d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd33afc6f3cc746f6a28e60b0c65f6b89'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:54:10.492623 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-f7ecdb1b-4135-42a6-ab89-b90a24f9b1d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd33afc6f3cc746f6a28e60b0c65f6b89'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:54:10.511980 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-f7ecdb1b-4135-42a6-ab89-b90a24f9b1d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd33afc6f3cc746f6a28e60b0c65f6b89'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:54:10.512713 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-f7ecdb1b-4135-42a6-ab89-b90a24f9b1d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd33afc6f3cc746f6a28e60b0c65f6b89'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:54:10.513539 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-f7ecdb1b-4135-42a6-ab89-b90a24f9b1d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd33afc6f3cc746f6a28e60b0c65f6b89'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:54:10.525729 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1209/2441] 10.222.0.102 () {58 vars in 1229 bytes} [Mon Aug 1 15:54:10 2022] DELETE /identity/v3/users/d33afc6f3cc746f6a28e60b0c65f6b89 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:54:10.778557 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0274b7-127d-46b6-9667-c5e02cca68b4 service neutron] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:54:10.789902 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0274b7-127d-46b6-9667-c5e02cca68b4 service neutron] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:54:10.860553 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb32f612-c500-457d-b46d-0e5a10565657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:54:10.861300 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb32f612-c500-457d-b46d-0e5a10565657 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:10.861501 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb32f612-c500-457d-b46d-0e5a10565657 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:10.861782 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb32f612-c500-457d-b46d-0e5a10565657 admin admin] PATH_INFO: `/v3/projects/8bee9977e6834ec18339617ed81abfdd` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:10.863109 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb32f612-c500-457d-b46d-0e5a10565657 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8bee9977e6834ec18339617ed81abfdd)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:54:10.864881 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb32f612-c500-457d-b46d-0e5a10565657 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:54:10.999704 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-bb32f612-c500-457d-b46d-0e5a10565657 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8bee9977e6834ec18339617ed81abfdd', 'request_id': 'req-bb32f612-c500-457d-b46d-0e5a10565657'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:54:11.006089 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-bb32f612-c500-457d-b46d-0e5a10565657 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8bee9977e6834ec18339617ed81abfdd', 'request_id': 'req-bb32f612-c500-457d-b46d-0e5a10565657'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:54:11.087380 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-bb32f612-c500-457d-b46d-0e5a10565657 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8bee9977e6834ec18339617ed81abfdd', 'request_id': 'req-bb32f612-c500-457d-b46d-0e5a10565657'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:54:11.099425 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-bb32f612-c500-457d-b46d-0e5a10565657 admin admin] The token cache is being invalidate because project 8bee9977e6834ec18339617ed81abfdd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80352) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 15:54:11.099703 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-bb32f612-c500-457d-b46d-0e5a10565657 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:54:11.100364 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-bb32f612-c500-457d-b46d-0e5a10565657 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:54:11.101909 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1233/2442] 10.222.0.102 () {58 vars in 1238 bytes} [Mon Aug 1 15:54:10 2022] DELETE /identity/v3/projects/8bee9977e6834ec18339617ed81abfdd => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:54:11.107748 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4fa4fa-a7cc-437b-a5a6-4b490c9abc72 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:11.108141 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4fa4fa-a7cc-437b-a5a6-4b490c9abc72 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:11.108415 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4fa4fa-a7cc-437b-a5a6-4b490c9abc72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:11.129593 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-9f4fa4fa-a7cc-437b-a5a6-4b490c9abc72 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:54:11.130902 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-9f4fa4fa-a7cc-437b-a5a6-4b490c9abc72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:54:11.193020 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1210/2443] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:54:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 15:54:11.202264 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a82f2a-0121-4e91-853e-abbb9a161954 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:11.202549 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a82f2a-0121-4e91-853e-abbb9a161954 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:11.202825 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a82f2a-0121-4e91-853e-abbb9a161954 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:11.223858 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-e3a82f2a-0121-4e91-853e-abbb9a161954 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:54:11.225194 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-e3a82f2a-0121-4e91-853e-abbb9a161954 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:54:11.233232 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1234/2444] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:54:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 15:54:11.237666 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4fa4fa-a7cc-437b-a5a6-4b490c9abc72 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:54:11.250870 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4fa4fa-a7cc-437b-a5a6-4b490c9abc72 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:54:11.255760 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffb97b8-6e70-41f0-ac9b-e79aeef33750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:54:11.256419 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffb97b8-6e70-41f0-ac9b-e79aeef33750 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:11.256703 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffb97b8-6e70-41f0-ac9b-e79aeef33750 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:11.257005 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffb97b8-6e70-41f0-ac9b-e79aeef33750 admin admin] PATH_INFO: `/v3/domains` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:11.257707 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffb97b8-6e70-41f0-ac9b-e79aeef33750 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:54:11.258013 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffb97b8-6e70-41f0-ac9b-e79aeef33750 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:54:11.259622 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffb97b8-6e70-41f0-ac9b-e79aeef33750 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:54:11.273769 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1211/2445] 10.222.0.102 () {58 vars in 1158 bytes} [Mon Aug 1 15:54:11 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:54:11.277548 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a82f2a-0121-4e91-853e-abbb9a161954 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:54:11.287369 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a82f2a-0121-4e91-853e-abbb9a161954 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:54:11.292134 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fb649c-b255-48a4-b4ff-9ab7c7327644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:54:11.292817 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fb649c-b255-48a4-b4ff-9ab7c7327644 admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:11.293136 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fb649c-b255-48a4-b4ff-9ab7c7327644 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:11.293411 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fb649c-b255-48a4-b4ff-9ab7c7327644 admin admin] PATH_INFO: `/v3/projects` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:11.294102 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fb649c-b255-48a4-b4ff-9ab7c7327644 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:54:11.296019 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fb649c-b255-48a4-b4ff-9ab7c7327644 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:54:11.380470 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1235/2446] 10.222.0.102 () {60 vars in 1158 bytes} [Mon Aug 1 15:54:11 2022] POST /identity/v3/projects => generated 406 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:54:11.384619 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffb97b8-6e70-41f0-ac9b-e79aeef33750 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:54:11.395786 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffb97b8-6e70-41f0-ac9b-e79aeef33750 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:54:11.460765 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3673af-92a0-45bb-99ee-398e59ea46cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:54:11.461437 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3673af-92a0-45bb-99ee-398e59ea46cf admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:11.461720 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3673af-92a0-45bb-99ee-398e59ea46cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:11.461994 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3673af-92a0-45bb-99ee-398e59ea46cf admin admin] PATH_INFO: `/v3/users` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:11.462670 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3673af-92a0-45bb-99ee-398e59ea46cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:54:11.465309 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3673af-92a0-45bb-99ee-398e59ea46cf admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:54:11.473243 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:54:11.550327 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1212/2447] 10.222.0.102 () {60 vars in 1149 bytes} [Mon Aug 1 15:54:11 2022] POST /identity/v3/users => generated 304 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:54:11.554315 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fb649c-b255-48a4-b4ff-9ab7c7327644 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:54:11.565783 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fb649c-b255-48a4-b4ff-9ab7c7327644 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:54:11.570674 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cb69c6-35d0-49b2-a3fc-33a8331d82e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:54:11.571347 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cb69c6-35d0-49b2-a3fc-33a8331d82e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:11.578821 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cb69c6-35d0-49b2-a3fc-33a8331d82e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:11.578821 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cb69c6-35d0-49b2-a3fc-33a8331d82e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:11.578821 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cb69c6-35d0-49b2-a3fc-33a8331d82e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:54:11.578821 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cb69c6-35d0-49b2-a3fc-33a8331d82e8 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:54:11.585182 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1236/2448] 10.222.0.102 () {58 vars in 1127 bytes} [Mon Aug 1 15:54:11 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:54:11.589363 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3673af-92a0-45bb-99ee-398e59ea46cf admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:54:11.599604 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3673af-92a0-45bb-99ee-398e59ea46cf admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:54:11.604454 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f7507a-bf17-4dba-bb87-4ed96adac512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:54:11.619080 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f7507a-bf17-4dba-bb87-4ed96adac512 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:11.619080 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f7507a-bf17-4dba-bb87-4ed96adac512 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:11.619080 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f7507a-bf17-4dba-bb87-4ed96adac512 admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:11.619080 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f7507a-bf17-4dba-bb87-4ed96adac512 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:54:11.619080 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f7507a-bf17-4dba-bb87-4ed96adac512 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:54:11.619080 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1213/2449] 10.222.0.102 () {58 vars in 1127 bytes} [Mon Aug 1 15:54:11 2022] GET /identity/v3/roles => generated 1427 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:54:11.624129 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cb69c6-35d0-49b2-a3fc-33a8331d82e8 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:54:11.634625 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cb69c6-35d0-49b2-a3fc-33a8331d82e8 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:54:11.639952 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162cc2cd-549d-41a4-8d1a-cc492a8eba94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:54:11.640625 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162cc2cd-549d-41a4-8d1a-cc492a8eba94 admin admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:11.640932 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162cc2cd-549d-41a4-8d1a-cc492a8eba94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:11.641209 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162cc2cd-549d-41a4-8d1a-cc492a8eba94 admin admin] PATH_INFO: `/v3/projects/6525256db45c420c966d78e50c997058/users/fd5a11cb670f4f18b4467ed134a7cb85/roles/27f5093ac0674d799cdbd17c68482e32` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:11.655957 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162cc2cd-549d-41a4-8d1a-cc492a8eba94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6525256db45c420c966d78e50c997058, user_id=fd5a11cb670f4f18b4467ed134a7cb85, role_id=27f5093ac0674d799cdbd17c68482e32)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:54:11.658759 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162cc2cd-549d-41a4-8d1a-cc492a8eba94 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:54:11.730810 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1237/2450] 10.222.0.102 () {60 vars in 1488 bytes} [Mon Aug 1 15:54:11 2022] PUT /identity/v3/projects/6525256db45c420c966d78e50c997058/users/fd5a11cb670f4f18b4467ed134a7cb85/roles/27f5093ac0674d799cdbd17c68482e32 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:54:11.742422 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e067a271-ac3f-49fd-8344-e6c27e6fc723 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:11.742710 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e067a271-ac3f-49fd-8344-e6c27e6fc723 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:11.742988 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e067a271-ac3f-49fd-8344-e6c27e6fc723 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:11.772604 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-e067a271-ac3f-49fd-8344-e6c27e6fc723 None None] MFA Rules not processed for user `fd5a11cb670f4f18b4467ed134a7cb85`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:54:11.773871 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-e067a271-ac3f-49fd-8344-e6c27e6fc723 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:54:11.838784 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1214/2451] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:54:11 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:54:11.843301 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162cc2cd-549d-41a4-8d1a-cc492a8eba94 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:54:11.858072 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:54:11.911500 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162cc2cd-549d-41a4-8d1a-cc492a8eba94 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:54:11.917226 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf7771b-e8e9-40a4-953c-6c6ff6ade1b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:54:11.917812 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf7771b-e8e9-40a4-953c-6c6ff6ade1b5 admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:11.918306 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf7771b-e8e9-40a4-953c-6c6ff6ade1b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:11.918747 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf7771b-e8e9-40a4-953c-6c6ff6ade1b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:11.919803 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf7771b-e8e9-40a4-953c-6c6ff6ade1b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:54:11.921810 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf7771b-e8e9-40a4-953c-6c6ff6ade1b5 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:54:12.005026 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1238/2452] 10.222.0.102 () {60 vars in 1158 bytes} [Mon Aug 1 15:54:11 2022] POST /identity/v3/projects => generated 406 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:54:12.010295 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e067a271-ac3f-49fd-8344-e6c27e6fc723 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:54:12.022124 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e067a271-ac3f-49fd-8344-e6c27e6fc723 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:54:12.085854 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2622ab8-f005-4b11-b4c7-f863a067837c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:54:12.086544 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2622ab8-f005-4b11-b4c7-f863a067837c admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:12.086826 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2622ab8-f005-4b11-b4c7-f863a067837c admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:12.087099 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2622ab8-f005-4b11-b4c7-f863a067837c admin admin] PATH_INFO: `/v3/users` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:12.087795 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2622ab8-f005-4b11-b4c7-f863a067837c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:54:12.089784 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2622ab8-f005-4b11-b4c7-f863a067837c admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:54:12.191013 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1215/2453] 10.222.0.102 () {60 vars in 1149 bytes} [Mon Aug 1 15:54:12 2022] POST /identity/v3/users => generated 310 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:54:12.195092 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf7771b-e8e9-40a4-953c-6c6ff6ade1b5 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:54:12.206023 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf7771b-e8e9-40a4-953c-6c6ff6ade1b5 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:54:12.210806 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c79500c-abc6-40ef-b928-553e4e4a8db1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:54:12.211426 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c79500c-abc6-40ef-b928-553e4e4a8db1 admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:12.211706 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c79500c-abc6-40ef-b928-553e4e4a8db1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:12.211975 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c79500c-abc6-40ef-b928-553e4e4a8db1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:12.212732 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c79500c-abc6-40ef-b928-553e4e4a8db1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:54:12.214927 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c79500c-abc6-40ef-b928-553e4e4a8db1 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:54:12.225853 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1239/2454] 10.222.0.102 () {58 vars in 1127 bytes} [Mon Aug 1 15:54:12 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:54:12.230694 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2622ab8-f005-4b11-b4c7-f863a067837c admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:54:12.241346 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2622ab8-f005-4b11-b4c7-f863a067837c admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:54:12.246368 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8be6ae0-857a-459d-ac72-f01106068ed8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:54:12.247048 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8be6ae0-857a-459d-ac72-f01106068ed8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:12.247333 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8be6ae0-857a-459d-ac72-f01106068ed8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:12.247610 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8be6ae0-857a-459d-ac72-f01106068ed8 admin admin] PATH_INFO: `/v3/projects/30aed3736f234c96b5fb0fec5934c8fa/users/bff92c970286400287335efc577b1319/roles/de1374f966c04c27b579515b54334fd2` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:12.262498 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8be6ae0-857a-459d-ac72-f01106068ed8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=30aed3736f234c96b5fb0fec5934c8fa, user_id=bff92c970286400287335efc577b1319, role_id=de1374f966c04c27b579515b54334fd2)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:54:12.265392 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8be6ae0-857a-459d-ac72-f01106068ed8 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:54:12.345797 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1216/2455] 10.222.0.102 () {60 vars in 1488 bytes} [Mon Aug 1 15:54:12 2022] PUT /identity/v3/projects/30aed3736f234c96b5fb0fec5934c8fa/users/bff92c970286400287335efc577b1319/roles/de1374f966c04c27b579515b54334fd2 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 15:54:12.349907 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c79500c-abc6-40ef-b928-553e4e4a8db1 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:54:12.360963 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c79500c-abc6-40ef-b928-553e4e4a8db1 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:54:12.429640 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e472cd-fb90-4a18-8263-abb2f28c7eab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:54:12.430281 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e472cd-fb90-4a18-8263-abb2f28c7eab admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:12.430567 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e472cd-fb90-4a18-8263-abb2f28c7eab admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:12.430843 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e472cd-fb90-4a18-8263-abb2f28c7eab admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:12.431551 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e472cd-fb90-4a18-8263-abb2f28c7eab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:54:12.433372 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e472cd-fb90-4a18-8263-abb2f28c7eab admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:54:12.449450 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1240/2456] 10.222.0.102 () {58 vars in 1127 bytes} [Mon Aug 1 15:54:12 2022] GET /identity/v3/roles => generated 1427 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:54:12.449734 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8be6ae0-857a-459d-ac72-f01106068ed8 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:54:12.459927 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8be6ae0-857a-459d-ac72-f01106068ed8 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:54:12.465348 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab13c558-2029-4bbb-9ba9-9b70c2abed38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:54:12.466019 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab13c558-2029-4bbb-9ba9-9b70c2abed38 admin admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:12.466335 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab13c558-2029-4bbb-9ba9-9b70c2abed38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:12.466612 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab13c558-2029-4bbb-9ba9-9b70c2abed38 admin admin] PATH_INFO: `/v3/projects/30aed3736f234c96b5fb0fec5934c8fa/users/bff92c970286400287335efc577b1319/roles/de1374f966c04c27b579515b54334fd2` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:12.468631 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab13c558-2029-4bbb-9ba9-9b70c2abed38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=30aed3736f234c96b5fb0fec5934c8fa, user_id=bff92c970286400287335efc577b1319, role_id=de1374f966c04c27b579515b54334fd2)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:54:12.471389 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab13c558-2029-4bbb-9ba9-9b70c2abed38 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:54:12.485622 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1217/2457] 10.222.0.102 () {60 vars in 1488 bytes} [Mon Aug 1 15:54:12 2022] PUT /identity/v3/projects/30aed3736f234c96b5fb0fec5934c8fa/users/bff92c970286400287335efc577b1319/roles/de1374f966c04c27b579515b54334fd2 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:54:12.496279 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe27c68-1560-47d0-9f61-74f7a0faff6e None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:12.496572 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe27c68-1560-47d0-9f61-74f7a0faff6e None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:12.496944 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe27c68-1560-47d0-9f61-74f7a0faff6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:12.529878 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-ffe27c68-1560-47d0-9f61-74f7a0faff6e None None] MFA Rules not processed for user `bff92c970286400287335efc577b1319`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:54:12.531146 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-ffe27c68-1560-47d0-9f61-74f7a0faff6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:54:12.608140 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1241/2458] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:54:12 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:54:12.619968 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab13c558-2029-4bbb-9ba9-9b70c2abed38 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:54:12.621738 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-ab13c558-2029-4bbb-9ba9-9b70c2abed38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:54:12.645224 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:INSERT=8,keystone:SELECT=92 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:54:12.681316 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab13c558-2029-4bbb-9ba9-9b70c2abed38 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:54:12.685970 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bec3148-a4be-4c53-a1bc-0c2d56ef78cc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff810b37183c4729859c1b05edff1703', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:54:12.686572 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bec3148-a4be-4c53-a1bc-0c2d56ef78cc service cinder] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:12.686854 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bec3148-a4be-4c53-a1bc-0c2d56ef78cc service cinder] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:12.687183 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bec3148-a4be-4c53-a1bc-0c2d56ef78cc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:12.697501 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bec3148-a4be-4c53-a1bc-0c2d56ef78cc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:54:12.699519 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bec3148-a4be-4c53-a1bc-0c2d56ef78cc service cinder] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:54:12.709060 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1218/2459] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:54:12 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:54:12.861354 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe27c68-1560-47d0-9f61-74f7a0faff6e None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:54:12.874066 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:54:12.929922 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe27c68-1560-47d0-9f61-74f7a0faff6e None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:54:12.934539 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed00db2-65cf-4f7e-9d1d-2720550033cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:54:12.935424 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed00db2-65cf-4f7e-9d1d-2720550033cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:12.935712 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed00db2-65cf-4f7e-9d1d-2720550033cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:12.935988 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed00db2-65cf-4f7e-9d1d-2720550033cc admin admin] PATH_INFO: `/v3/users/fd5a11cb670f4f18b4467ed134a7cb85` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:12.937212 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed00db2-65cf-4f7e-9d1d-2720550033cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd5a11cb670f4f18b4467ed134a7cb85)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:54:12.939223 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed00db2-65cf-4f7e-9d1d-2720550033cc admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:54:13.094156 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-bed00db2-65cf-4f7e-9d1d-2720550033cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd5a11cb670f4f18b4467ed134a7cb85'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:54:13.106620 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-bed00db2-65cf-4f7e-9d1d-2720550033cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd5a11cb670f4f18b4467ed134a7cb85'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:54:13.114111 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-bed00db2-65cf-4f7e-9d1d-2720550033cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd5a11cb670f4f18b4467ed134a7cb85'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:54:13.114858 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-bed00db2-65cf-4f7e-9d1d-2720550033cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd5a11cb670f4f18b4467ed134a7cb85'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:54:13.115470 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-bed00db2-65cf-4f7e-9d1d-2720550033cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd5a11cb670f4f18b4467ed134a7cb85'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:54:13.199857 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1242/2460] 10.222.0.102 () {58 vars in 1229 bytes} [Mon Aug 1 15:54:12 2022] DELETE /identity/v3/users/fd5a11cb670f4f18b4467ed134a7cb85 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:54:13.204541 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f7be32-adb6-4a79-a06f-aab55291f6a5 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:13.204830 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f7be32-adb6-4a79-a06f-aab55291f6a5 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:13.205140 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f7be32-adb6-4a79-a06f-aab55291f6a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:13.227429 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-42f7be32-adb6-4a79-a06f-aab55291f6a5 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:54:13.229724 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-42f7be32-adb6-4a79-a06f-aab55291f6a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:54:13.289036 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1219/2461] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:54:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:54:13.298833 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed00db2-65cf-4f7e-9d1d-2720550033cc admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:54:13.300240 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-bed00db2-65cf-4f7e-9d1d-2720550033cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:54:13.361177 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed00db2-65cf-4f7e-9d1d-2720550033cc admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:54:13.364706 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf90881-b534-478b-a954-1d3ac78f7b99 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a856a413100443939fe9b10daa868518', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:54:13.365360 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf90881-b534-478b-a954-1d3ac78f7b99 service neutron] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:13.365635 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf90881-b534-478b-a954-1d3ac78f7b99 service neutron] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:13.365900 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf90881-b534-478b-a954-1d3ac78f7b99 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:13.376314 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf90881-b534-478b-a954-1d3ac78f7b99 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:54:13.377301 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf90881-b534-478b-a954-1d3ac78f7b99 service neutron] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:54:13.387232 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1243/2462] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:54:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:54:13.806272 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f7be32-adb6-4a79-a06f-aab55291f6a5 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:54:13.807851 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-42f7be32-adb6-4a79-a06f-aab55291f6a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:54:13.820919 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f7be32-adb6-4a79-a06f-aab55291f6a5 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:54:13.826186 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172167cc-6035-40fe-ab7b-59f4b001880b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:54:13.827523 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172167cc-6035-40fe-ab7b-59f4b001880b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:13.827907 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172167cc-6035-40fe-ab7b-59f4b001880b admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:13.829020 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172167cc-6035-40fe-ab7b-59f4b001880b admin admin] PATH_INFO: `/v3/projects/6525256db45c420c966d78e50c997058` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:13.830956 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172167cc-6035-40fe-ab7b-59f4b001880b admin admin] RBAC: Authorizing `identity:delete_project(project_id=6525256db45c420c966d78e50c997058)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:54:13.837842 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172167cc-6035-40fe-ab7b-59f4b001880b admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:54:13.939312 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-172167cc-6035-40fe-ab7b-59f4b001880b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6525256db45c420c966d78e50c997058', 'request_id': 'req-172167cc-6035-40fe-ab7b-59f4b001880b'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:54:13.992980 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-172167cc-6035-40fe-ab7b-59f4b001880b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6525256db45c420c966d78e50c997058', 'request_id': 'req-172167cc-6035-40fe-ab7b-59f4b001880b'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:54:14.000108 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-172167cc-6035-40fe-ab7b-59f4b001880b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6525256db45c420c966d78e50c997058', 'request_id': 'req-172167cc-6035-40fe-ab7b-59f4b001880b'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:54:14.010975 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-172167cc-6035-40fe-ab7b-59f4b001880b admin admin] The token cache is being invalidate because project 6525256db45c420c966d78e50c997058 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80353) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 15:54:14.011261 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-172167cc-6035-40fe-ab7b-59f4b001880b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:54:14.011900 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-172167cc-6035-40fe-ab7b-59f4b001880b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:54:14.013842 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1220/2463] 10.222.0.102 () {58 vars in 1238 bytes} [Mon Aug 1 15:54:13 2022] DELETE /identity/v3/projects/6525256db45c420c966d78e50c997058 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:54:14.017681 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf90881-b534-478b-a954-1d3ac78f7b99 service neutron] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:54:14.028006 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf90881-b534-478b-a954-1d3ac78f7b99 service neutron] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:54:14.057912 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:54:14.086365 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ebef60-80ea-4702-919b-21413cdf03eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:54:14.087010 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ebef60-80ea-4702-919b-21413cdf03eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:14.087284 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ebef60-80ea-4702-919b-21413cdf03eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:14.087551 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ebef60-80ea-4702-919b-21413cdf03eb admin admin] PATH_INFO: `/v3/users/bff92c970286400287335efc577b1319` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:14.088769 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ebef60-80ea-4702-919b-21413cdf03eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=bff92c970286400287335efc577b1319)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:54:14.091714 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ebef60-80ea-4702-919b-21413cdf03eb admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:54:14.264483 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-c6ebef60-80ea-4702-919b-21413cdf03eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bff92c970286400287335efc577b1319'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:54:14.277990 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-c6ebef60-80ea-4702-919b-21413cdf03eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bff92c970286400287335efc577b1319'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:54:14.284834 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-c6ebef60-80ea-4702-919b-21413cdf03eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bff92c970286400287335efc577b1319'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:54:14.285580 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-c6ebef60-80ea-4702-919b-21413cdf03eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bff92c970286400287335efc577b1319'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:54:14.286182 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-c6ebef60-80ea-4702-919b-21413cdf03eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bff92c970286400287335efc577b1319'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:54:14.381981 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1244/2464] 10.222.0.102 () {58 vars in 1229 bytes} [Mon Aug 1 15:54:14 2022] DELETE /identity/v3/users/bff92c970286400287335efc577b1319 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:54:14.918932 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172167cc-6035-40fe-ab7b-59f4b001880b admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:54:14.921974 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-172167cc-6035-40fe-ab7b-59f4b001880b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:54:14.952343 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172167cc-6035-40fe-ab7b-59f4b001880b admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:54:15.008451 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:54:15.022373 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b76398-f98e-4210-9509-3f626c544d68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:54:15.023033 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b76398-f98e-4210-9509-3f626c544d68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:15.023317 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b76398-f98e-4210-9509-3f626c544d68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:15.023588 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b76398-f98e-4210-9509-3f626c544d68 admin admin] PATH_INFO: `/v3/projects/30aed3736f234c96b5fb0fec5934c8fa` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:15.024873 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b76398-f98e-4210-9509-3f626c544d68 admin admin] RBAC: Authorizing `identity:delete_project(project_id=30aed3736f234c96b5fb0fec5934c8fa)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:54:15.026874 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b76398-f98e-4210-9509-3f626c544d68 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:54:15.140015 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-71b76398-f98e-4210-9509-3f626c544d68 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30aed3736f234c96b5fb0fec5934c8fa', 'request_id': 'req-71b76398-f98e-4210-9509-3f626c544d68'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:54:15.204660 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-71b76398-f98e-4210-9509-3f626c544d68 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30aed3736f234c96b5fb0fec5934c8fa', 'request_id': 'req-71b76398-f98e-4210-9509-3f626c544d68'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:54:15.213309 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-71b76398-f98e-4210-9509-3f626c544d68 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30aed3736f234c96b5fb0fec5934c8fa', 'request_id': 'req-71b76398-f98e-4210-9509-3f626c544d68'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:54:15.225651 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-71b76398-f98e-4210-9509-3f626c544d68 admin admin] The token cache is being invalidate because project 30aed3736f234c96b5fb0fec5934c8fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80353) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 15:54:15.225950 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-71b76398-f98e-4210-9509-3f626c544d68 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:54:15.226627 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-71b76398-f98e-4210-9509-3f626c544d68 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:54:15.228192 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1221/2465] 10.222.0.102 () {58 vars in 1238 bytes} [Mon Aug 1 15:54:14 2022] DELETE /identity/v3/projects/30aed3736f234c96b5fb0fec5934c8fa => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 15:54:15.233973 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a09b23-a12f-40b2-946e-115b51585d65 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:15.234459 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a09b23-a12f-40b2-946e-115b51585d65 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:15.234561 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a09b23-a12f-40b2-946e-115b51585d65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:15.254931 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-c5a09b23-a12f-40b2-946e-115b51585d65 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:54:15.256149 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-c5a09b23-a12f-40b2-946e-115b51585d65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:54:15.319956 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1245/2466] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:54:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:54:15.329527 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef40b44-c0c0-4848-a901-b68c88cd01ba None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:15.329819 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef40b44-c0c0-4848-a901-b68c88cd01ba None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:15.330098 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef40b44-c0c0-4848-a901-b68c88cd01ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:15.353623 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-cef40b44-c0c0-4848-a901-b68c88cd01ba None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:54:15.354790 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-cef40b44-c0c0-4848-a901-b68c88cd01ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:54:15.363817 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1222/2467] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:54:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:54:15.369605 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a09b23-a12f-40b2-946e-115b51585d65 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:54:15.378762 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a09b23-a12f-40b2-946e-115b51585d65 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:54:15.383779 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89650f66-1be3-4c62-97a0-8b7f059c0ed0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:54:15.384410 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89650f66-1be3-4c62-97a0-8b7f059c0ed0 admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:15.384690 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89650f66-1be3-4c62-97a0-8b7f059c0ed0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:15.385000 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89650f66-1be3-4c62-97a0-8b7f059c0ed0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:15.385714 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89650f66-1be3-4c62-97a0-8b7f059c0ed0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:54:15.386260 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89650f66-1be3-4c62-97a0-8b7f059c0ed0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:54:15.387749 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89650f66-1be3-4c62-97a0-8b7f059c0ed0 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:54:15.402470 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1246/2468] 10.222.0.102 () {58 vars in 1158 bytes} [Mon Aug 1 15:54:15 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:54:15.406577 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef40b44-c0c0-4848-a901-b68c88cd01ba None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:54:15.416723 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef40b44-c0c0-4848-a901-b68c88cd01ba None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:54:15.423125 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d707cd-5444-4dab-9fce-f722d3e65881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:54:15.423774 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d707cd-5444-4dab-9fce-f722d3e65881 admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:15.424056 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d707cd-5444-4dab-9fce-f722d3e65881 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:15.424444 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d707cd-5444-4dab-9fce-f722d3e65881 admin admin] PATH_INFO: `/v3/projects` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:15.425206 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d707cd-5444-4dab-9fce-f722d3e65881 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:54:15.427249 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d707cd-5444-4dab-9fce-f722d3e65881 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:54:15.518420 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1223/2469] 10.222.0.102 () {60 vars in 1158 bytes} [Mon Aug 1 15:54:15 2022] POST /identity/v3/projects => generated 366 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:54:15.519999 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89650f66-1be3-4c62-97a0-8b7f059c0ed0 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:54:15.531056 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89650f66-1be3-4c62-97a0-8b7f059c0ed0 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:54:15.570136 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:54:15.597878 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fef410-239b-4a19-a502-7bcf55ecf7ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:54:15.598615 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fef410-239b-4a19-a502-7bcf55ecf7ec admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:15.598897 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fef410-239b-4a19-a502-7bcf55ecf7ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:15.599162 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fef410-239b-4a19-a502-7bcf55ecf7ec admin admin] PATH_INFO: `/v3/users` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:15.599855 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fef410-239b-4a19-a502-7bcf55ecf7ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:54:15.602016 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fef410-239b-4a19-a502-7bcf55ecf7ec admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:54:15.760600 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1247/2470] 10.222.0.102 () {60 vars in 1149 bytes} [Mon Aug 1 15:54:15 2022] POST /identity/v3/users => generated 284 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:54:15.765044 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d707cd-5444-4dab-9fce-f722d3e65881 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:54:15.775742 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d707cd-5444-4dab-9fce-f722d3e65881 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:54:15.781216 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cb964d-48dd-475f-b20c-2f5b47fcf38b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:54:15.785993 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cb964d-48dd-475f-b20c-2f5b47fcf38b admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:15.785993 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cb964d-48dd-475f-b20c-2f5b47fcf38b admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:15.785993 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cb964d-48dd-475f-b20c-2f5b47fcf38b admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:15.785993 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cb964d-48dd-475f-b20c-2f5b47fcf38b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:54:15.785993 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cb964d-48dd-475f-b20c-2f5b47fcf38b admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:54:15.799318 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1224/2471] 10.222.0.102 () {58 vars in 1127 bytes} [Mon Aug 1 15:54:15 2022] GET /identity/v3/roles => generated 1427 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:54:15.803771 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fef410-239b-4a19-a502-7bcf55ecf7ec admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:54:15.818954 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fef410-239b-4a19-a502-7bcf55ecf7ec admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:54:15.825275 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993e7341-1f24-45ee-8bd3-5582e2cb21d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:54:15.831874 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993e7341-1f24-45ee-8bd3-5582e2cb21d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:15.831874 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993e7341-1f24-45ee-8bd3-5582e2cb21d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:15.831874 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993e7341-1f24-45ee-8bd3-5582e2cb21d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:15.831874 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993e7341-1f24-45ee-8bd3-5582e2cb21d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:54:15.831874 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993e7341-1f24-45ee-8bd3-5582e2cb21d9 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:54:15.845502 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1248/2472] 10.222.0.102 () {58 vars in 1127 bytes} [Mon Aug 1 15:54:15 2022] GET /identity/v3/roles => generated 1427 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:54:15.850684 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cb964d-48dd-475f-b20c-2f5b47fcf38b admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:54:15.863349 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cb964d-48dd-475f-b20c-2f5b47fcf38b admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:54:15.877578 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348373e8-6de3-4d97-ab0f-34aa99909a10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:54:15.878281 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348373e8-6de3-4d97-ab0f-34aa99909a10 admin admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:15.878630 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348373e8-6de3-4d97-ab0f-34aa99909a10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:15.879015 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348373e8-6de3-4d97-ab0f-34aa99909a10 admin admin] PATH_INFO: `/v3/projects/308915c6a421474aa71c19f129d608c0/users/e36fb4712b4549fba48fd3f64c26c4eb/roles/27f5093ac0674d799cdbd17c68482e32` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:15.901370 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348373e8-6de3-4d97-ab0f-34aa99909a10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=308915c6a421474aa71c19f129d608c0, user_id=e36fb4712b4549fba48fd3f64c26c4eb, role_id=27f5093ac0674d799cdbd17c68482e32)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:54:15.904543 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348373e8-6de3-4d97-ab0f-34aa99909a10 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:54:16.035661 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1225/2473] 10.222.0.102 () {60 vars in 1488 bytes} [Mon Aug 1 15:54:15 2022] PUT /identity/v3/projects/308915c6a421474aa71c19f129d608c0/users/e36fb4712b4549fba48fd3f64c26c4eb/roles/27f5093ac0674d799cdbd17c68482e32 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:54:16.049495 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968a094c-8367-4583-b940-f5cc546ab856 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:16.049785 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968a094c-8367-4583-b940-f5cc546ab856 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:16.050061 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968a094c-8367-4583-b940-f5cc546ab856 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:16.087342 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-968a094c-8367-4583-b940-f5cc546ab856 None None] MFA Rules not processed for user `e36fb4712b4549fba48fd3f64c26c4eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:54:16.088688 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-968a094c-8367-4583-b940-f5cc546ab856 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:54:16.197501 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1249/2474] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:54:16 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:54:16.202192 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348373e8-6de3-4d97-ab0f-34aa99909a10 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:54:16.316365 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348373e8-6de3-4d97-ab0f-34aa99909a10 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:54:16.321389 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e0cba0-40f8-42c3-b5c7-e67887dbfcdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:54:16.322029 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e0cba0-40f8-42c3-b5c7-e67887dbfcdb admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:16.322312 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e0cba0-40f8-42c3-b5c7-e67887dbfcdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:16.322586 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e0cba0-40f8-42c3-b5c7-e67887dbfcdb admin admin] PATH_INFO: `/v3/projects` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:16.323267 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e0cba0-40f8-42c3-b5c7-e67887dbfcdb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:54:16.325780 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e0cba0-40f8-42c3-b5c7-e67887dbfcdb admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:54:16.421993 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:54:16.432680 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1226/2475] 10.222.0.102 () {60 vars in 1158 bytes} [Mon Aug 1 15:54:16 2022] POST /identity/v3/projects => generated 362 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:54:16.434251 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968a094c-8367-4583-b940-f5cc546ab856 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:54:16.446980 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968a094c-8367-4583-b940-f5cc546ab856 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:54:16.510329 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0912088-1dd7-4107-8fde-2ea986068734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:54:16.510946 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0912088-1dd7-4107-8fde-2ea986068734 admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:16.511805 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0912088-1dd7-4107-8fde-2ea986068734 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:16.512078 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0912088-1dd7-4107-8fde-2ea986068734 admin admin] PATH_INFO: `/v3/users` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:16.512779 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0912088-1dd7-4107-8fde-2ea986068734 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:54:16.514741 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0912088-1dd7-4107-8fde-2ea986068734 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:54:16.613418 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1250/2476] 10.222.0.102 () {60 vars in 1149 bytes} [Mon Aug 1 15:54:16 2022] POST /identity/v3/users => generated 288 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:54:16.615920 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e0cba0-40f8-42c3-b5c7-e67887dbfcdb admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:54:16.628589 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e0cba0-40f8-42c3-b5c7-e67887dbfcdb admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:54:16.633450 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dbf48f-f52a-479d-838f-017bd667da8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:54:16.634069 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dbf48f-f52a-479d-838f-017bd667da8c admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:16.634353 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dbf48f-f52a-479d-838f-017bd667da8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:16.634615 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dbf48f-f52a-479d-838f-017bd667da8c admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:16.635315 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dbf48f-f52a-479d-838f-017bd667da8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:54:16.637498 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dbf48f-f52a-479d-838f-017bd667da8c admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:54:16.648720 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1227/2477] 10.222.0.102 () {58 vars in 1127 bytes} [Mon Aug 1 15:54:16 2022] GET /identity/v3/roles => generated 1427 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:54:16.655008 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0912088-1dd7-4107-8fde-2ea986068734 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:54:16.665547 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0912088-1dd7-4107-8fde-2ea986068734 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:54:16.670242 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f99fc5-4da6-4a89-8d59-0f476f5b22e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:54:16.671007 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f99fc5-4da6-4a89-8d59-0f476f5b22e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:16.671417 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f99fc5-4da6-4a89-8d59-0f476f5b22e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:16.671774 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f99fc5-4da6-4a89-8d59-0f476f5b22e1 admin admin] PATH_INFO: `/v3/projects/d540aaa889d34240b30e964b97980027/users/cee408c840944b42b4903980f2224b85/roles/de1374f966c04c27b579515b54334fd2` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:16.692230 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f99fc5-4da6-4a89-8d59-0f476f5b22e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d540aaa889d34240b30e964b97980027, user_id=cee408c840944b42b4903980f2224b85, role_id=de1374f966c04c27b579515b54334fd2)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:54:16.696505 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f99fc5-4da6-4a89-8d59-0f476f5b22e1 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:54:16.765954 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1251/2478] 10.222.0.102 () {60 vars in 1488 bytes} [Mon Aug 1 15:54:16 2022] PUT /identity/v3/projects/d540aaa889d34240b30e964b97980027/users/cee408c840944b42b4903980f2224b85/roles/de1374f966c04c27b579515b54334fd2 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:54:16.769855 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dbf48f-f52a-479d-838f-017bd667da8c admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:54:16.781026 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dbf48f-f52a-479d-838f-017bd667da8c admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:54:16.845828 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5e84e0-e8cc-4573-b439-c3b8774311d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:54:16.846464 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5e84e0-e8cc-4573-b439-c3b8774311d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:16.846747 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5e84e0-e8cc-4573-b439-c3b8774311d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:16.847043 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5e84e0-e8cc-4573-b439-c3b8774311d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:16.847737 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5e84e0-e8cc-4573-b439-c3b8774311d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:54:16.849428 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5e84e0-e8cc-4573-b439-c3b8774311d0 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:54:16.863272 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1228/2479] 10.222.0.102 () {58 vars in 1127 bytes} [Mon Aug 1 15:54:16 2022] GET /identity/v3/roles => generated 1427 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:54:16.864514 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f99fc5-4da6-4a89-8d59-0f476f5b22e1 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:54:16.876694 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f99fc5-4da6-4a89-8d59-0f476f5b22e1 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:54:16.884030 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a10ff82-ec1c-48b2-a845-967b01d275cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:54:16.886792 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a10ff82-ec1c-48b2-a845-967b01d275cd admin admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:16.886792 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a10ff82-ec1c-48b2-a845-967b01d275cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:16.886792 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a10ff82-ec1c-48b2-a845-967b01d275cd admin admin] PATH_INFO: `/v3/projects/d540aaa889d34240b30e964b97980027/users/cee408c840944b42b4903980f2224b85/roles/de1374f966c04c27b579515b54334fd2` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:16.889139 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a10ff82-ec1c-48b2-a845-967b01d275cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=d540aaa889d34240b30e964b97980027, user_id=cee408c840944b42b4903980f2224b85, role_id=de1374f966c04c27b579515b54334fd2)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:54:16.893184 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a10ff82-ec1c-48b2-a845-967b01d275cd admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:54:16.901060 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:54:16.907086 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1252/2480] 10.222.0.102 () {60 vars in 1488 bytes} [Mon Aug 1 15:54:16 2022] PUT /identity/v3/projects/d540aaa889d34240b30e964b97980027/users/cee408c840944b42b4903980f2224b85/roles/de1374f966c04c27b579515b54334fd2 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:54:16.917788 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6fa6a9-74f0-4919-9950-d6d207c3d150 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:16.918425 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6fa6a9-74f0-4919-9950-d6d207c3d150 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:16.918425 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6fa6a9-74f0-4919-9950-d6d207c3d150 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:16.951743 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-0f6fa6a9-74f0-4919-9950-d6d207c3d150 None None] MFA Rules not processed for user `cee408c840944b42b4903980f2224b85`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:54:16.953027 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-0f6fa6a9-74f0-4919-9950-d6d207c3d150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:54:17.039086 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1229/2481] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:54:16 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:54:17.052865 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a10ff82-ec1c-48b2-a845-967b01d275cd admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:54:17.053914 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-1a10ff82-ec1c-48b2-a845-967b01d275cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:54:17.119017 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a10ff82-ec1c-48b2-a845-967b01d275cd admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:54:17.123584 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b810f35-93ca-408b-89c4-c2a4bb5e691d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff810b37183c4729859c1b05edff1703', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:54:17.124209 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b810f35-93ca-408b-89c4-c2a4bb5e691d service cinder] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:17.124500 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b810f35-93ca-408b-89c4-c2a4bb5e691d service cinder] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:17.124758 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b810f35-93ca-408b-89c4-c2a4bb5e691d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:17.134694 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b810f35-93ca-408b-89c4-c2a4bb5e691d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:54:17.136214 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b810f35-93ca-408b-89c4-c2a4bb5e691d service cinder] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:54:17.147290 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1253/2482] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:54:17 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:54:17.341125 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6fa6a9-74f0-4919-9950-d6d207c3d150 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:54:17.352478 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6fa6a9-74f0-4919-9950-d6d207c3d150 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:54:17.356747 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ce07f1-5328-452b-b253-54aa72a4944f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff810b37183c4729859c1b05edff1703', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:54:17.357431 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ce07f1-5328-452b-b253-54aa72a4944f service cinder] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:17.357816 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ce07f1-5328-452b-b253-54aa72a4944f service cinder] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:17.358093 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ce07f1-5328-452b-b253-54aa72a4944f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:17.427115 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ce07f1-5328-452b-b253-54aa72a4944f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:54:17.427115 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ce07f1-5328-452b-b253-54aa72a4944f service cinder] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:54:17.432407 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1230/2483] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:54:17 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:54:20.927083 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b810f35-93ca-408b-89c4-c2a4bb5e691d service cinder] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:54:21.002338 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b810f35-93ca-408b-89c4-c2a4bb5e691d service cinder] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:54:21.006886 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd6b608-8323-4ef7-ab5a-3a40108e2226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:54:21.007520 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd6b608-8323-4ef7-ab5a-3a40108e2226 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:21.007797 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd6b608-8323-4ef7-ab5a-3a40108e2226 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:21.008068 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd6b608-8323-4ef7-ab5a-3a40108e2226 admin admin] PATH_INFO: `/v3/users/e36fb4712b4549fba48fd3f64c26c4eb` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:21.010461 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd6b608-8323-4ef7-ab5a-3a40108e2226 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e36fb4712b4549fba48fd3f64c26c4eb)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:54:21.013971 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd6b608-8323-4ef7-ab5a-3a40108e2226 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:54:21.243177 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-6fd6b608-8323-4ef7-ab5a-3a40108e2226 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e36fb4712b4549fba48fd3f64c26c4eb'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:54:21.255747 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-6fd6b608-8323-4ef7-ab5a-3a40108e2226 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e36fb4712b4549fba48fd3f64c26c4eb'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:54:21.263291 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-6fd6b608-8323-4ef7-ab5a-3a40108e2226 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e36fb4712b4549fba48fd3f64c26c4eb'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:54:21.263979 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-6fd6b608-8323-4ef7-ab5a-3a40108e2226 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e36fb4712b4549fba48fd3f64c26c4eb'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:54:21.264722 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-6fd6b608-8323-4ef7-ab5a-3a40108e2226 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e36fb4712b4549fba48fd3f64c26c4eb'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:54:21.347032 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1254/2484] 10.222.0.102 () {58 vars in 1229 bytes} [Mon Aug 1 15:54:20 2022] DELETE /identity/v3/users/e36fb4712b4549fba48fd3f64c26c4eb => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:54:21.351654 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdb9f54-243a-48c7-a9c7-b2fc62488b68 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:21.352131 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdb9f54-243a-48c7-a9c7-b2fc62488b68 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:21.352236 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdb9f54-243a-48c7-a9c7-b2fc62488b68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:21.365944 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:54:21.372718 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-bbdb9f54-243a-48c7-a9c7-b2fc62488b68 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:54:21.373962 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-bbdb9f54-243a-48c7-a9c7-b2fc62488b68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:54:21.430901 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1231/2485] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:54:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:54:21.441679 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd6b608-8323-4ef7-ab5a-3a40108e2226 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:54:21.443107 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-6fd6b608-8323-4ef7-ab5a-3a40108e2226 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:54:21.466191 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:54:21.502073 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd6b608-8323-4ef7-ab5a-3a40108e2226 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:54:21.505670 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8beab3bd-8bce-4efc-94c8-619e47f124b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a856a413100443939fe9b10daa868518', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:54:21.507288 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beab3bd-8bce-4efc-94c8-619e47f124b1 service neutron] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:21.507288 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beab3bd-8bce-4efc-94c8-619e47f124b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:21.507288 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beab3bd-8bce-4efc-94c8-619e47f124b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:21.516713 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8beab3bd-8bce-4efc-94c8-619e47f124b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:54:21.518164 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8beab3bd-8bce-4efc-94c8-619e47f124b1 service neutron] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:54:21.527955 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1255/2486] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:54:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:54:21.960223 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdb9f54-243a-48c7-a9c7-b2fc62488b68 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:54:21.962269 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-bbdb9f54-243a-48c7-a9c7-b2fc62488b68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:54:21.975039 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdb9f54-243a-48c7-a9c7-b2fc62488b68 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:54:21.979699 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ae5ba9-a829-4b85-80e7-e88769d4a4f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:54:21.991115 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ae5ba9-a829-4b85-80e7-e88769d4a4f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:21.991115 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ae5ba9-a829-4b85-80e7-e88769d4a4f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:21.991115 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ae5ba9-a829-4b85-80e7-e88769d4a4f5 admin admin] PATH_INFO: `/v3/projects/308915c6a421474aa71c19f129d608c0` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:21.991115 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ae5ba9-a829-4b85-80e7-e88769d4a4f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=308915c6a421474aa71c19f129d608c0)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:54:21.991115 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ae5ba9-a829-4b85-80e7-e88769d4a4f5 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:54:22.113533 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-82ae5ba9-a829-4b85-80e7-e88769d4a4f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '308915c6a421474aa71c19f129d608c0', 'request_id': 'req-82ae5ba9-a829-4b85-80e7-e88769d4a4f5'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:54:22.183667 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-82ae5ba9-a829-4b85-80e7-e88769d4a4f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '308915c6a421474aa71c19f129d608c0', 'request_id': 'req-82ae5ba9-a829-4b85-80e7-e88769d4a4f5'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:54:22.191509 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-82ae5ba9-a829-4b85-80e7-e88769d4a4f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '308915c6a421474aa71c19f129d608c0', 'request_id': 'req-82ae5ba9-a829-4b85-80e7-e88769d4a4f5'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:54:22.202175 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-82ae5ba9-a829-4b85-80e7-e88769d4a4f5 admin admin] The token cache is being invalidate because project 308915c6a421474aa71c19f129d608c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80353) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 15:54:22.202458 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-82ae5ba9-a829-4b85-80e7-e88769d4a4f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:54:22.203220 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-82ae5ba9-a829-4b85-80e7-e88769d4a4f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:54:22.204745 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1232/2487] 10.222.0.102 () {58 vars in 1238 bytes} [Mon Aug 1 15:54:21 2022] DELETE /identity/v3/projects/308915c6a421474aa71c19f129d608c0 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:54:22.208780 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8beab3bd-8bce-4efc-94c8-619e47f124b1 service neutron] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:54:22.219539 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8beab3bd-8bce-4efc-94c8-619e47f124b1 service neutron] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:54:22.275341 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47ad882-2b7b-4826-a45f-cc6d7706b2c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:54:22.275893 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47ad882-2b7b-4826-a45f-cc6d7706b2c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:22.276165 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47ad882-2b7b-4826-a45f-cc6d7706b2c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:22.276431 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47ad882-2b7b-4826-a45f-cc6d7706b2c6 admin admin] PATH_INFO: `/v3/users/cee408c840944b42b4903980f2224b85` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:22.278125 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47ad882-2b7b-4826-a45f-cc6d7706b2c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cee408c840944b42b4903980f2224b85)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:54:22.280119 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47ad882-2b7b-4826-a45f-cc6d7706b2c6 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:54:22.423579 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ae5ba9-a829-4b85-80e7-e88769d4a4f5 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:54:22.425000 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-82ae5ba9-a829-4b85-80e7-e88769d4a4f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:54:22.462423 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-a47ad882-2b7b-4826-a45f-cc6d7706b2c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cee408c840944b42b4903980f2224b85'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:54:22.476485 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-a47ad882-2b7b-4826-a45f-cc6d7706b2c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cee408c840944b42b4903980f2224b85'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:54:22.484131 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ae5ba9-a829-4b85-80e7-e88769d4a4f5 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:54:22.484288 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-a47ad882-2b7b-4826-a45f-cc6d7706b2c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cee408c840944b42b4903980f2224b85'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:54:22.484977 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-a47ad882-2b7b-4826-a45f-cc6d7706b2c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cee408c840944b42b4903980f2224b85'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:54:22.485608 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-a47ad882-2b7b-4826-a45f-cc6d7706b2c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cee408c840944b42b4903980f2224b85'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:54:22.487975 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a827dd42-f73c-4eaa-9602-7ddb1e05693c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a856a413100443939fe9b10daa868518', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:54:22.488594 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a827dd42-f73c-4eaa-9602-7ddb1e05693c service neutron] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:22.488894 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a827dd42-f73c-4eaa-9602-7ddb1e05693c service neutron] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:22.492089 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a827dd42-f73c-4eaa-9602-7ddb1e05693c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:22.492089 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-a827dd42-f73c-4eaa-9602-7ddb1e05693c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:54:22.503784 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a827dd42-f73c-4eaa-9602-7ddb1e05693c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:54:22.505325 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a827dd42-f73c-4eaa-9602-7ddb1e05693c service neutron] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:54:22.515758 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1233/2488] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:54:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:54:22.576286 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1256/2489] 10.222.0.102 () {58 vars in 1229 bytes} [Mon Aug 1 15:54:22 2022] DELETE /identity/v3/users/cee408c840944b42b4903980f2224b85 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:54:23.023471 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a827dd42-f73c-4eaa-9602-7ddb1e05693c service neutron] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:54:23.025299 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-a827dd42-f73c-4eaa-9602-7ddb1e05693c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:54:23.052916 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a827dd42-f73c-4eaa-9602-7ddb1e05693c service neutron] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:54:23.100957 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:54:23.128968 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbadd667-6cee-4d2c-a523-eae1b1027226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:54:23.129619 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbadd667-6cee-4d2c-a523-eae1b1027226 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:23.129903 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbadd667-6cee-4d2c-a523-eae1b1027226 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:23.130176 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbadd667-6cee-4d2c-a523-eae1b1027226 admin admin] PATH_INFO: `/v3/projects/d540aaa889d34240b30e964b97980027` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:23.131353 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbadd667-6cee-4d2c-a523-eae1b1027226 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d540aaa889d34240b30e964b97980027)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:54:23.133321 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbadd667-6cee-4d2c-a523-eae1b1027226 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:54:23.237729 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-bbadd667-6cee-4d2c-a523-eae1b1027226 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd540aaa889d34240b30e964b97980027', 'request_id': 'req-bbadd667-6cee-4d2c-a523-eae1b1027226'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:54:23.329813 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-bbadd667-6cee-4d2c-a523-eae1b1027226 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd540aaa889d34240b30e964b97980027', 'request_id': 'req-bbadd667-6cee-4d2c-a523-eae1b1027226'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:54:23.338970 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-bbadd667-6cee-4d2c-a523-eae1b1027226 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd540aaa889d34240b30e964b97980027', 'request_id': 'req-bbadd667-6cee-4d2c-a523-eae1b1027226'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:54:23.348171 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-bbadd667-6cee-4d2c-a523-eae1b1027226 admin admin] The token cache is being invalidate because project d540aaa889d34240b30e964b97980027 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80353) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 15:54:23.348453 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-bbadd667-6cee-4d2c-a523-eae1b1027226 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:54:23.349146 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-bbadd667-6cee-4d2c-a523-eae1b1027226 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:54:23.350697 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1234/2490] 10.222.0.102 () {58 vars in 1238 bytes} [Mon Aug 1 15:54:23 2022] DELETE /identity/v3/projects/d540aaa889d34240b30e964b97980027 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:54:23.356118 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c099ed-bccf-43ad-9d95-9e5589fed5ea None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:23.356590 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c099ed-bccf-43ad-9d95-9e5589fed5ea None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:23.356701 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c099ed-bccf-43ad-9d95-9e5589fed5ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:23.377713 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-89c099ed-bccf-43ad-9d95-9e5589fed5ea None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:54:23.378909 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-89c099ed-bccf-43ad-9d95-9e5589fed5ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:54:23.416815 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:54:23.438789 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1257/2491] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:54:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 15:54:23.446603 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8850a3e-4ec4-4d52-b474-bf622c994674 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:23.447128 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8850a3e-4ec4-4d52-b474-bf622c994674 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:23.447874 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8850a3e-4ec4-4d52-b474-bf622c994674 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:23.474131 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-b8850a3e-4ec4-4d52-b474-bf622c994674 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:54:23.474131 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-b8850a3e-4ec4-4d52-b474-bf622c994674 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:54:23.481721 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1235/2492] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:54:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:54:23.486083 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c099ed-bccf-43ad-9d95-9e5589fed5ea None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:54:23.496835 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c099ed-bccf-43ad-9d95-9e5589fed5ea None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:54:23.502578 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f373407-0f40-4734-86d1-04645fa4d8a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:54:23.502735 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f373407-0f40-4734-86d1-04645fa4d8a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:23.503047 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f373407-0f40-4734-86d1-04645fa4d8a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:23.503538 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f373407-0f40-4734-86d1-04645fa4d8a7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:23.504199 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f373407-0f40-4734-86d1-04645fa4d8a7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:54:23.504529 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f373407-0f40-4734-86d1-04645fa4d8a7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:54:23.506314 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f373407-0f40-4734-86d1-04645fa4d8a7 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:54:23.520702 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1258/2493] 10.222.0.102 () {58 vars in 1158 bytes} [Mon Aug 1 15:54:23 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:54:23.525282 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8850a3e-4ec4-4d52-b474-bf622c994674 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:54:23.540598 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8850a3e-4ec4-4d52-b474-bf622c994674 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:54:23.547990 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3326e1-73c9-47c9-ab3d-9ac5d7e7be0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:54:23.548776 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3326e1-73c9-47c9-ab3d-9ac5d7e7be0e admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:23.553768 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3326e1-73c9-47c9-ab3d-9ac5d7e7be0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:23.553768 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3326e1-73c9-47c9-ab3d-9ac5d7e7be0e admin admin] PATH_INFO: `/v3/projects` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:23.553768 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3326e1-73c9-47c9-ab3d-9ac5d7e7be0e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:54:23.553768 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3326e1-73c9-47c9-ab3d-9ac5d7e7be0e admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:54:23.632066 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1236/2494] 10.222.0.102 () {60 vars in 1158 bytes} [Mon Aug 1 15:54:23 2022] POST /identity/v3/projects => generated 368 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 15:54:23.636141 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f373407-0f40-4734-86d1-04645fa4d8a7 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:54:23.648117 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f373407-0f40-4734-86d1-04645fa4d8a7 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:54:23.709365 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6898113-6d61-4e7b-8c2b-a9377b5a52e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:54:23.709995 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6898113-6d61-4e7b-8c2b-a9377b5a52e7 admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:23.710275 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6898113-6d61-4e7b-8c2b-a9377b5a52e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:23.710548 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6898113-6d61-4e7b-8c2b-a9377b5a52e7 admin admin] PATH_INFO: `/v3/users` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:23.711221 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6898113-6d61-4e7b-8c2b-a9377b5a52e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:54:23.713225 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6898113-6d61-4e7b-8c2b-a9377b5a52e7 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:54:23.793797 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1259/2495] 10.222.0.102 () {60 vars in 1149 bytes} [Mon Aug 1 15:54:23 2022] POST /identity/v3/users => generated 285 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:54:23.798046 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3326e1-73c9-47c9-ab3d-9ac5d7e7be0e admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:54:23.808922 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3326e1-73c9-47c9-ab3d-9ac5d7e7be0e admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:54:23.817386 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dde61f6-050d-4cea-a7be-f0b0868ca4fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:54:23.818015 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dde61f6-050d-4cea-a7be-f0b0868ca4fe admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:23.818291 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dde61f6-050d-4cea-a7be-f0b0868ca4fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:23.818558 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dde61f6-050d-4cea-a7be-f0b0868ca4fe admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:23.819269 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dde61f6-050d-4cea-a7be-f0b0868ca4fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:54:23.820942 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dde61f6-050d-4cea-a7be-f0b0868ca4fe admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:54:23.832581 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1237/2496] 10.222.0.102 () {58 vars in 1127 bytes} [Mon Aug 1 15:54:23 2022] GET /identity/v3/roles => generated 1427 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:54:23.838840 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6898113-6d61-4e7b-8c2b-a9377b5a52e7 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:54:23.849866 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6898113-6d61-4e7b-8c2b-a9377b5a52e7 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:54:23.854469 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603d2aa1-c250-45a1-982f-6df1167391d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:54:23.855120 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603d2aa1-c250-45a1-982f-6df1167391d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:23.855401 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603d2aa1-c250-45a1-982f-6df1167391d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:23.855674 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603d2aa1-c250-45a1-982f-6df1167391d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:23.856373 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603d2aa1-c250-45a1-982f-6df1167391d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:54:23.858021 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603d2aa1-c250-45a1-982f-6df1167391d1 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:54:23.869743 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1260/2497] 10.222.0.102 () {58 vars in 1127 bytes} [Mon Aug 1 15:54:23 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:54:23.874149 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dde61f6-050d-4cea-a7be-f0b0868ca4fe admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:54:23.885015 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dde61f6-050d-4cea-a7be-f0b0868ca4fe admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:54:23.890374 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcc959d-5563-4482-93a3-552b6ee00939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:54:23.891048 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcc959d-5563-4482-93a3-552b6ee00939 admin admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:23.891326 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcc959d-5563-4482-93a3-552b6ee00939 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:23.891754 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcc959d-5563-4482-93a3-552b6ee00939 admin admin] PATH_INFO: `/v3/projects/451a039147084551b3613b324715d6f4/users/8f1045045eaf4be59fd8d353d8a18ad0/roles/27f5093ac0674d799cdbd17c68482e32` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:23.907805 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcc959d-5563-4482-93a3-552b6ee00939 admin admin] RBAC: Authorizing `identity:create_grant(project_id=451a039147084551b3613b324715d6f4, user_id=8f1045045eaf4be59fd8d353d8a18ad0, role_id=27f5093ac0674d799cdbd17c68482e32)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:54:23.910548 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcc959d-5563-4482-93a3-552b6ee00939 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:54:23.994264 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1238/2498] 10.222.0.102 () {60 vars in 1488 bytes} [Mon Aug 1 15:54:23 2022] PUT /identity/v3/projects/451a039147084551b3613b324715d6f4/users/8f1045045eaf4be59fd8d353d8a18ad0/roles/27f5093ac0674d799cdbd17c68482e32 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:54:24.007110 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4775b16c-f129-41aa-93d6-551f6aa602c3 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:24.007480 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4775b16c-f129-41aa-93d6-551f6aa602c3 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:24.007831 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4775b16c-f129-41aa-93d6-551f6aa602c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:24.040114 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-4775b16c-f129-41aa-93d6-551f6aa602c3 None None] MFA Rules not processed for user `8f1045045eaf4be59fd8d353d8a18ad0`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:54:24.042589 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-4775b16c-f129-41aa-93d6-551f6aa602c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:54:24.125770 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1261/2499] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:54:24 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:54:24.129891 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcc959d-5563-4482-93a3-552b6ee00939 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:54:24.210078 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcc959d-5563-4482-93a3-552b6ee00939 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:54:24.215462 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d706ade6-91f4-4640-ad31-0388f1479ec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:54:24.216082 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d706ade6-91f4-4640-ad31-0388f1479ec7 admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:24.225886 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d706ade6-91f4-4640-ad31-0388f1479ec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:24.225886 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d706ade6-91f4-4640-ad31-0388f1479ec7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:24.225886 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d706ade6-91f4-4640-ad31-0388f1479ec7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:54:24.225886 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d706ade6-91f4-4640-ad31-0388f1479ec7 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:54:24.225886 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:54:24.320532 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1239/2500] 10.222.0.102 () {60 vars in 1158 bytes} [Mon Aug 1 15:54:24 2022] POST /identity/v3/projects => generated 370 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:54:24.325293 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4775b16c-f129-41aa-93d6-551f6aa602c3 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:54:24.336190 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4775b16c-f129-41aa-93d6-551f6aa602c3 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:54:24.377608 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:54:24.421665 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99311c92-c70b-4bea-9c6a-7ba00f840657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:54:24.425088 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99311c92-c70b-4bea-9c6a-7ba00f840657 admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:24.425402 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99311c92-c70b-4bea-9c6a-7ba00f840657 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:24.425985 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99311c92-c70b-4bea-9c6a-7ba00f840657 admin admin] PATH_INFO: `/v3/users` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:24.426694 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99311c92-c70b-4bea-9c6a-7ba00f840657 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:54:24.429432 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99311c92-c70b-4bea-9c6a-7ba00f840657 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:54:24.547050 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1262/2501] 10.222.0.102 () {60 vars in 1149 bytes} [Mon Aug 1 15:54:24 2022] POST /identity/v3/users => generated 292 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:54:24.551149 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d706ade6-91f4-4640-ad31-0388f1479ec7 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:54:24.564644 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d706ade6-91f4-4640-ad31-0388f1479ec7 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:54:24.570047 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc79aa1b-d782-415c-980c-440f2bb05cab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:54:24.576485 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc79aa1b-d782-415c-980c-440f2bb05cab admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:24.576485 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc79aa1b-d782-415c-980c-440f2bb05cab admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:24.576485 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc79aa1b-d782-415c-980c-440f2bb05cab admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:24.576485 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc79aa1b-d782-415c-980c-440f2bb05cab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:54:24.576485 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc79aa1b-d782-415c-980c-440f2bb05cab admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:54:24.587082 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1240/2502] 10.222.0.102 () {58 vars in 1127 bytes} [Mon Aug 1 15:54:24 2022] GET /identity/v3/roles => generated 1427 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:54:24.591132 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99311c92-c70b-4bea-9c6a-7ba00f840657 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:54:24.601272 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99311c92-c70b-4bea-9c6a-7ba00f840657 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:54:24.607008 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b482fde7-4efb-4006-892b-800098aaf2e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:54:24.607645 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b482fde7-4efb-4006-892b-800098aaf2e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:24.607928 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b482fde7-4efb-4006-892b-800098aaf2e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:24.613630 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b482fde7-4efb-4006-892b-800098aaf2e4 admin admin] PATH_INFO: `/v3/projects/4d9d52995b424a1c9ad3469e28ea88fa/users/7a0485d3e10d4e5081844cf6792ab8a7/roles/de1374f966c04c27b579515b54334fd2` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:24.624541 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b482fde7-4efb-4006-892b-800098aaf2e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d9d52995b424a1c9ad3469e28ea88fa, user_id=7a0485d3e10d4e5081844cf6792ab8a7, role_id=de1374f966c04c27b579515b54334fd2)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:54:24.627235 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b482fde7-4efb-4006-892b-800098aaf2e4 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:54:24.736897 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1263/2503] 10.222.0.102 () {60 vars in 1488 bytes} [Mon Aug 1 15:54:24 2022] PUT /identity/v3/projects/4d9d52995b424a1c9ad3469e28ea88fa/users/7a0485d3e10d4e5081844cf6792ab8a7/roles/de1374f966c04c27b579515b54334fd2 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:54:24.743830 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc79aa1b-d782-415c-980c-440f2bb05cab admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:54:24.754523 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc79aa1b-d782-415c-980c-440f2bb05cab admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:54:24.819563 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0a0425-29c4-47c9-a8ed-cf0df108f8c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:54:24.820223 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0a0425-29c4-47c9-a8ed-cf0df108f8c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:24.820502 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0a0425-29c4-47c9-a8ed-cf0df108f8c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:24.820772 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0a0425-29c4-47c9-a8ed-cf0df108f8c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:24.821504 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0a0425-29c4-47c9-a8ed-cf0df108f8c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:54:24.823171 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0a0425-29c4-47c9-a8ed-cf0df108f8c1 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:54:24.833901 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1241/2504] 10.222.0.102 () {58 vars in 1127 bytes} [Mon Aug 1 15:54:24 2022] GET /identity/v3/roles => generated 1427 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:54:24.838145 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b482fde7-4efb-4006-892b-800098aaf2e4 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:54:24.849541 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b482fde7-4efb-4006-892b-800098aaf2e4 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:54:24.854344 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d597555b-a4a0-427a-a497-f80409d77d7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:54:24.855030 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d597555b-a4a0-427a-a497-f80409d77d7a admin admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:24.855308 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d597555b-a4a0-427a-a497-f80409d77d7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:24.855582 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d597555b-a4a0-427a-a497-f80409d77d7a admin admin] PATH_INFO: `/v3/projects/4d9d52995b424a1c9ad3469e28ea88fa/users/7a0485d3e10d4e5081844cf6792ab8a7/roles/de1374f966c04c27b579515b54334fd2` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:24.857602 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d597555b-a4a0-427a-a497-f80409d77d7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d9d52995b424a1c9ad3469e28ea88fa, user_id=7a0485d3e10d4e5081844cf6792ab8a7, role_id=de1374f966c04c27b579515b54334fd2)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:54:24.860387 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d597555b-a4a0-427a-a497-f80409d77d7a admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:54:24.871172 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1264/2505] 10.222.0.102 () {60 vars in 1488 bytes} [Mon Aug 1 15:54:24 2022] PUT /identity/v3/projects/4d9d52995b424a1c9ad3469e28ea88fa/users/7a0485d3e10d4e5081844cf6792ab8a7/roles/de1374f966c04c27b579515b54334fd2 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:54:24.882437 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce6bf2f-8e0d-413f-a632-1b8aa5dce38d None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:24.882737 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce6bf2f-8e0d-413f-a632-1b8aa5dce38d None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:24.883021 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce6bf2f-8e0d-413f-a632-1b8aa5dce38d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:24.914277 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-fce6bf2f-8e0d-413f-a632-1b8aa5dce38d None None] MFA Rules not processed for user `7a0485d3e10d4e5081844cf6792ab8a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:54:24.915537 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-fce6bf2f-8e0d-413f-a632-1b8aa5dce38d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:54:24.994238 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1242/2506] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:54:24 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:54:25.006602 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d597555b-a4a0-427a-a497-f80409d77d7a admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:54:25.008407 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-d597555b-a4a0-427a-a497-f80409d77d7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:54:25.076657 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d597555b-a4a0-427a-a497-f80409d77d7a admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:54:25.080339 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f734062-b7c5-4dfb-94a5-fed97bc5edad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff810b37183c4729859c1b05edff1703', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:54:25.080999 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f734062-b7c5-4dfb-94a5-fed97bc5edad service cinder] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:25.081276 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f734062-b7c5-4dfb-94a5-fed97bc5edad service cinder] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:25.081546 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f734062-b7c5-4dfb-94a5-fed97bc5edad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:25.091549 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f734062-b7c5-4dfb-94a5-fed97bc5edad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:54:25.093565 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f734062-b7c5-4dfb-94a5-fed97bc5edad service cinder] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:54:25.105282 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1265/2507] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:54:25 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:54:25.251079 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce6bf2f-8e0d-413f-a632-1b8aa5dce38d None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:54:25.252506 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-fce6bf2f-8e0d-413f-a632-1b8aa5dce38d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:54:25.265216 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce6bf2f-8e0d-413f-a632-1b8aa5dce38d None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:54:25.269315 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c731847-5617-4fe5-84d3-b2db607da9ad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff810b37183c4729859c1b05edff1703', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:54:25.269955 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c731847-5617-4fe5-84d3-b2db607da9ad service cinder] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:25.270237 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c731847-5617-4fe5-84d3-b2db607da9ad service cinder] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:25.270512 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c731847-5617-4fe5-84d3-b2db607da9ad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:25.338553 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:54:25.342291 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c731847-5617-4fe5-84d3-b2db607da9ad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:54:25.343818 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c731847-5617-4fe5-84d3-b2db607da9ad service cinder] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:54:25.353497 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1243/2508] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:54:25 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:54:26.408581 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f734062-b7c5-4dfb-94a5-fed97bc5edad service cinder] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:54:26.410949 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-4f734062-b7c5-4dfb-94a5-fed97bc5edad service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:54:26.483798 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f734062-b7c5-4dfb-94a5-fed97bc5edad service cinder] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:54:26.488318 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2c70bf-04c7-450c-9f70-a879da092852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:54:26.488987 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2c70bf-04c7-450c-9f70-a879da092852 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:26.489261 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2c70bf-04c7-450c-9f70-a879da092852 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:26.489529 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2c70bf-04c7-450c-9f70-a879da092852 admin admin] PATH_INFO: `/v3/users/d60a67da3f284a469d374b8f1d93ea45` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:26.490680 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2c70bf-04c7-450c-9f70-a879da092852 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d60a67da3f284a469d374b8f1d93ea45)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:54:26.492584 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2c70bf-04c7-450c-9f70-a879da092852 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:54:26.671552 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:54:26.680690 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-6d2c70bf-04c7-450c-9f70-a879da092852 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd60a67da3f284a469d374b8f1d93ea45'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:54:26.694100 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-6d2c70bf-04c7-450c-9f70-a879da092852 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd60a67da3f284a469d374b8f1d93ea45'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:54:26.701000 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-6d2c70bf-04c7-450c-9f70-a879da092852 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd60a67da3f284a469d374b8f1d93ea45'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:54:26.701672 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-6d2c70bf-04c7-450c-9f70-a879da092852 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd60a67da3f284a469d374b8f1d93ea45'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:54:26.702276 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-6d2c70bf-04c7-450c-9f70-a879da092852 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd60a67da3f284a469d374b8f1d93ea45'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:54:26.792060 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1266/2509] 10.222.0.102 () {58 vars in 1229 bytes} [Mon Aug 1 15:54:26 2022] DELETE /identity/v3/users/d60a67da3f284a469d374b8f1d93ea45 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:54:27.041944 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c731847-5617-4fe5-84d3-b2db607da9ad service cinder] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:54:27.064539 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c731847-5617-4fe5-84d3-b2db607da9ad service cinder] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:54:27.132404 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc518f83-9a28-46dc-8cca-5808c32e24fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:54:27.133081 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc518f83-9a28-46dc-8cca-5808c32e24fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:27.133359 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc518f83-9a28-46dc-8cca-5808c32e24fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:27.133625 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc518f83-9a28-46dc-8cca-5808c32e24fd admin admin] PATH_INFO: `/v3/projects/4f475e8ed6ec4e5e89e3db406d1790a9` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:27.134777 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc518f83-9a28-46dc-8cca-5808c32e24fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f475e8ed6ec4e5e89e3db406d1790a9)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:54:27.136805 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc518f83-9a28-46dc-8cca-5808c32e24fd admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:54:27.237290 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-dc518f83-9a28-46dc-8cca-5808c32e24fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f475e8ed6ec4e5e89e3db406d1790a9', 'request_id': 'req-dc518f83-9a28-46dc-8cca-5808c32e24fd'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:54:27.302883 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-dc518f83-9a28-46dc-8cca-5808c32e24fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f475e8ed6ec4e5e89e3db406d1790a9', 'request_id': 'req-dc518f83-9a28-46dc-8cca-5808c32e24fd'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:54:27.309725 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-dc518f83-9a28-46dc-8cca-5808c32e24fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f475e8ed6ec4e5e89e3db406d1790a9', 'request_id': 'req-dc518f83-9a28-46dc-8cca-5808c32e24fd'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:54:27.323098 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-dc518f83-9a28-46dc-8cca-5808c32e24fd admin admin] The token cache is being invalidate because project 4f475e8ed6ec4e5e89e3db406d1790a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80353) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 15:54:27.323484 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-dc518f83-9a28-46dc-8cca-5808c32e24fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:54:27.336546 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-dc518f83-9a28-46dc-8cca-5808c32e24fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:54:27.336546 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1244/2510] 10.222.0.102 () {58 vars in 1238 bytes} [Mon Aug 1 15:54:27 2022] DELETE /identity/v3/projects/4f475e8ed6ec4e5e89e3db406d1790a9 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:54:27.336744 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce386edc-ba22-44d7-9d1a-ea706f7fbfb1 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:27.336744 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce386edc-ba22-44d7-9d1a-ea706f7fbfb1 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:27.336744 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce386edc-ba22-44d7-9d1a-ea706f7fbfb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:27.353633 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-ce386edc-ba22-44d7-9d1a-ea706f7fbfb1 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:54:27.355510 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-ce386edc-ba22-44d7-9d1a-ea706f7fbfb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:54:27.416891 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1267/2511] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:54:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 15:54:27.425654 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14997616-ea05-4dae-8197-20ef373c8960 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:27.425937 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14997616-ea05-4dae-8197-20ef373c8960 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:27.426317 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14997616-ea05-4dae-8197-20ef373c8960 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:27.446849 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-14997616-ea05-4dae-8197-20ef373c8960 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:54:27.448056 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-14997616-ea05-4dae-8197-20ef373c8960 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:54:27.456092 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1245/2512] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:54:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:54:27.460223 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce386edc-ba22-44d7-9d1a-ea706f7fbfb1 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:54:27.470889 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce386edc-ba22-44d7-9d1a-ea706f7fbfb1 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:54:27.475771 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e73f46-dae3-4686-b961-fcedcdc5708a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:54:27.476414 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e73f46-dae3-4686-b961-fcedcdc5708a admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:27.476696 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e73f46-dae3-4686-b961-fcedcdc5708a admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:27.477004 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e73f46-dae3-4686-b961-fcedcdc5708a admin admin] PATH_INFO: `/v3/domains` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:27.477699 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e73f46-dae3-4686-b961-fcedcdc5708a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:54:27.478006 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e73f46-dae3-4686-b961-fcedcdc5708a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:54:27.480300 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e73f46-dae3-4686-b961-fcedcdc5708a admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:54:27.492404 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1268/2513] 10.222.0.102 () {58 vars in 1158 bytes} [Mon Aug 1 15:54:27 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:54:27.496758 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14997616-ea05-4dae-8197-20ef373c8960 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:54:27.506292 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14997616-ea05-4dae-8197-20ef373c8960 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:54:27.511002 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf1f40d-1361-46c3-a290-6a5cbe389634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:54:27.511602 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf1f40d-1361-46c3-a290-6a5cbe389634 admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:27.511884 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf1f40d-1361-46c3-a290-6a5cbe389634 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:27.512151 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf1f40d-1361-46c3-a290-6a5cbe389634 admin admin] PATH_INFO: `/v3/projects` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:27.512804 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf1f40d-1361-46c3-a290-6a5cbe389634 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:54:27.514766 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf1f40d-1361-46c3-a290-6a5cbe389634 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:54:27.669116 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1246/2514] 10.222.0.102 () {60 vars in 1158 bytes} [Mon Aug 1 15:54:27 2022] POST /identity/v3/projects => generated 384 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:54:27.673365 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e73f46-dae3-4686-b961-fcedcdc5708a admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:54:27.683312 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e73f46-dae3-4686-b961-fcedcdc5708a admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:54:27.739282 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f2095c-6a6a-4158-8464-e0706821da56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:54:27.739888 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f2095c-6a6a-4158-8464-e0706821da56 admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:27.740166 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f2095c-6a6a-4158-8464-e0706821da56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:27.740438 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f2095c-6a6a-4158-8464-e0706821da56 admin admin] PATH_INFO: `/v3/users` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:27.741126 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f2095c-6a6a-4158-8464-e0706821da56 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:54:27.743099 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f2095c-6a6a-4158-8464-e0706821da56 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:54:27.839896 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1269/2515] 10.222.0.102 () {60 vars in 1149 bytes} [Mon Aug 1 15:54:27 2022] POST /identity/v3/users => generated 293 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 15:54:27.843982 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf1f40d-1361-46c3-a290-6a5cbe389634 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:54:27.854299 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf1f40d-1361-46c3-a290-6a5cbe389634 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:54:27.862894 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5464c4fd-422c-48c5-b3a9-c401fea4a55d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:54:27.863507 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5464c4fd-422c-48c5-b3a9-c401fea4a55d admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:27.863784 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5464c4fd-422c-48c5-b3a9-c401fea4a55d admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:27.864053 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5464c4fd-422c-48c5-b3a9-c401fea4a55d admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:27.864898 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5464c4fd-422c-48c5-b3a9-c401fea4a55d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:54:27.866620 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5464c4fd-422c-48c5-b3a9-c401fea4a55d admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:54:27.879084 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1247/2516] 10.222.0.102 () {58 vars in 1127 bytes} [Mon Aug 1 15:54:27 2022] GET /identity/v3/roles => generated 1427 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:54:27.887317 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f2095c-6a6a-4158-8464-e0706821da56 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:54:27.898145 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f2095c-6a6a-4158-8464-e0706821da56 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:54:27.903474 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dfe90a-63a4-41c4-90bd-01f3e49d09d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:54:27.904078 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dfe90a-63a4-41c4-90bd-01f3e49d09d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:27.904353 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dfe90a-63a4-41c4-90bd-01f3e49d09d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:27.904655 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dfe90a-63a4-41c4-90bd-01f3e49d09d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:27.905458 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dfe90a-63a4-41c4-90bd-01f3e49d09d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:54:27.907271 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dfe90a-63a4-41c4-90bd-01f3e49d09d1 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:54:27.919141 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1270/2517] 10.222.0.102 () {58 vars in 1127 bytes} [Mon Aug 1 15:54:27 2022] GET /identity/v3/roles => generated 1427 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 15:54:27.927408 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5464c4fd-422c-48c5-b3a9-c401fea4a55d admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:54:27.938458 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5464c4fd-422c-48c5-b3a9-c401fea4a55d admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:54:27.943055 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3941abda-da6f-4f24-b27f-b1e875edc17b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:54:27.943710 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3941abda-da6f-4f24-b27f-b1e875edc17b admin admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:27.943992 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3941abda-da6f-4f24-b27f-b1e875edc17b admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:27.944264 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3941abda-da6f-4f24-b27f-b1e875edc17b admin admin] PATH_INFO: `/v3/projects/637d3bbaff444826bf2399fd78c9d0b7/users/bd2da82242344efca6ab8a65654304a5/roles/27f5093ac0674d799cdbd17c68482e32` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:27.958992 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3941abda-da6f-4f24-b27f-b1e875edc17b admin admin] RBAC: Authorizing `identity:create_grant(project_id=637d3bbaff444826bf2399fd78c9d0b7, user_id=bd2da82242344efca6ab8a65654304a5, role_id=27f5093ac0674d799cdbd17c68482e32)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:54:27.964587 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3941abda-da6f-4f24-b27f-b1e875edc17b admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:54:28.081384 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1248/2518] 10.222.0.102 () {60 vars in 1488 bytes} [Mon Aug 1 15:54:27 2022] PUT /identity/v3/projects/637d3bbaff444826bf2399fd78c9d0b7/users/bd2da82242344efca6ab8a65654304a5/roles/27f5093ac0674d799cdbd17c68482e32 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 15:54:28.093751 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f8b187-398a-4bfa-9d9c-547bc4c4f875 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:28.094038 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f8b187-398a-4bfa-9d9c-547bc4c4f875 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:28.094306 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f8b187-398a-4bfa-9d9c-547bc4c4f875 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:28.124145 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-b3f8b187-398a-4bfa-9d9c-547bc4c4f875 None None] MFA Rules not processed for user `bd2da82242344efca6ab8a65654304a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:54:28.125498 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-b3f8b187-398a-4bfa-9d9c-547bc4c4f875 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:54:28.130686 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:54:28.198218 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1271/2519] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:54:28 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:54:28.211284 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3941abda-da6f-4f24-b27f-b1e875edc17b admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:54:28.213063 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-3941abda-da6f-4f24-b27f-b1e875edc17b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:54:28.236362 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:54:28.287843 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3941abda-da6f-4f24-b27f-b1e875edc17b admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:54:28.295249 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a545e7d2-724c-49bf-b4fb-41494acb87bd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77b43f1ee8cc4be3907a494abe90c1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:54:28.296930 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a545e7d2-724c-49bf-b4fb-41494acb87bd service nova] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:28.296930 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a545e7d2-724c-49bf-b4fb-41494acb87bd service nova] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:28.296930 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a545e7d2-724c-49bf-b4fb-41494acb87bd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:28.304646 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a545e7d2-724c-49bf-b4fb-41494acb87bd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:54:28.306274 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a545e7d2-724c-49bf-b4fb-41494acb87bd service nova] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:54:28.316489 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1249/2520] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:54:28 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:54:30.241306 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f8b187-398a-4bfa-9d9c-547bc4c4f875 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:54:30.242715 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-b3f8b187-398a-4bfa-9d9c-547bc4c4f875 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:54:30.312183 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f8b187-398a-4bfa-9d9c-547bc4c4f875 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:54:30.316698 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c840a211-6772-483d-b891-07c254d72eb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:54:30.317363 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c840a211-6772-483d-b891-07c254d72eb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:30.317641 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c840a211-6772-483d-b891-07c254d72eb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:30.317909 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c840a211-6772-483d-b891-07c254d72eb3 admin admin] PATH_INFO: `/v3/users/8f1045045eaf4be59fd8d353d8a18ad0` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:30.319048 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c840a211-6772-483d-b891-07c254d72eb3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f1045045eaf4be59fd8d353d8a18ad0)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:54:30.321010 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c840a211-6772-483d-b891-07c254d72eb3 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:54:30.528617 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-c840a211-6772-483d-b891-07c254d72eb3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f1045045eaf4be59fd8d353d8a18ad0'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:54:30.542870 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-c840a211-6772-483d-b891-07c254d72eb3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f1045045eaf4be59fd8d353d8a18ad0'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:54:30.550442 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-c840a211-6772-483d-b891-07c254d72eb3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f1045045eaf4be59fd8d353d8a18ad0'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:54:30.551205 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-c840a211-6772-483d-b891-07c254d72eb3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f1045045eaf4be59fd8d353d8a18ad0'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:54:30.551996 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-c840a211-6772-483d-b891-07c254d72eb3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f1045045eaf4be59fd8d353d8a18ad0'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:54:30.628545 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1272/2521] 10.222.0.102 () {58 vars in 1229 bytes} [Mon Aug 1 15:54:30 2022] DELETE /identity/v3/users/8f1045045eaf4be59fd8d353d8a18ad0 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:54:30.632991 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb4f035-27a2-4e89-bdcc-6549269177cf None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:30.633453 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb4f035-27a2-4e89-bdcc-6549269177cf None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:30.633574 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb4f035-27a2-4e89-bdcc-6549269177cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:30.652595 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-8cb4f035-27a2-4e89-bdcc-6549269177cf None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:54:30.653911 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-8cb4f035-27a2-4e89-bdcc-6549269177cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:54:30.713557 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1250/2522] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:54:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:54:30.723579 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c840a211-6772-483d-b891-07c254d72eb3 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:54:30.725113 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-c840a211-6772-483d-b891-07c254d72eb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:54:30.758160 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:54:30.784198 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c840a211-6772-483d-b891-07c254d72eb3 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:54:30.787857 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c73be9-005b-48eb-ba0e-1523a96fdb43 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a856a413100443939fe9b10daa868518', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:54:30.788399 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c73be9-005b-48eb-ba0e-1523a96fdb43 service neutron] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:30.788679 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c73be9-005b-48eb-ba0e-1523a96fdb43 service neutron] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:30.788997 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c73be9-005b-48eb-ba0e-1523a96fdb43 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:30.798630 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c73be9-005b-48eb-ba0e-1523a96fdb43 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:54:30.800051 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c73be9-005b-48eb-ba0e-1523a96fdb43 service neutron] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:54:30.810366 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1273/2523] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:54:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:54:31.226018 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb4f035-27a2-4e89-bdcc-6549269177cf None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:54:31.227464 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-8cb4f035-27a2-4e89-bdcc-6549269177cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:54:31.241085 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb4f035-27a2-4e89-bdcc-6549269177cf None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:54:31.245961 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce7a10c-66c9-4ce4-a385-e38e990bee77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:54:31.246652 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce7a10c-66c9-4ce4-a385-e38e990bee77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:31.247052 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce7a10c-66c9-4ce4-a385-e38e990bee77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:31.247436 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce7a10c-66c9-4ce4-a385-e38e990bee77 admin admin] PATH_INFO: `/v3/projects/451a039147084551b3613b324715d6f4` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:31.248507 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce7a10c-66c9-4ce4-a385-e38e990bee77 admin admin] RBAC: Authorizing `identity:delete_project(project_id=451a039147084551b3613b324715d6f4)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:54:31.250452 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce7a10c-66c9-4ce4-a385-e38e990bee77 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:54:31.373130 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-bce7a10c-66c9-4ce4-a385-e38e990bee77 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '451a039147084551b3613b324715d6f4', 'request_id': 'req-bce7a10c-66c9-4ce4-a385-e38e990bee77'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:54:31.446020 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-bce7a10c-66c9-4ce4-a385-e38e990bee77 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '451a039147084551b3613b324715d6f4', 'request_id': 'req-bce7a10c-66c9-4ce4-a385-e38e990bee77'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:54:31.455808 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-bce7a10c-66c9-4ce4-a385-e38e990bee77 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '451a039147084551b3613b324715d6f4', 'request_id': 'req-bce7a10c-66c9-4ce4-a385-e38e990bee77'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:54:31.464569 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-bce7a10c-66c9-4ce4-a385-e38e990bee77 admin admin] The token cache is being invalidate because project 451a039147084551b3613b324715d6f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80353) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 15:54:31.464986 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-bce7a10c-66c9-4ce4-a385-e38e990bee77 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:54:31.466284 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-bce7a10c-66c9-4ce4-a385-e38e990bee77 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:54:31.467897 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1251/2524] 10.222.0.102 () {58 vars in 1238 bytes} [Mon Aug 1 15:54:31 2022] DELETE /identity/v3/projects/451a039147084551b3613b324715d6f4 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:54:31.471852 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c73be9-005b-48eb-ba0e-1523a96fdb43 service neutron] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:54:31.482166 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c73be9-005b-48eb-ba0e-1523a96fdb43 service neutron] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:54:31.539694 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abe0258-2ab2-475c-9083-9cb06428c506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:54:31.540326 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abe0258-2ab2-475c-9083-9cb06428c506 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:31.540601 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abe0258-2ab2-475c-9083-9cb06428c506 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:31.540894 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abe0258-2ab2-475c-9083-9cb06428c506 admin admin] PATH_INFO: `/v3/users/7a0485d3e10d4e5081844cf6792ab8a7` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:31.542042 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abe0258-2ab2-475c-9083-9cb06428c506 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a0485d3e10d4e5081844cf6792ab8a7)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:54:31.544079 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abe0258-2ab2-475c-9083-9cb06428c506 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:54:31.827103 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-0abe0258-2ab2-475c-9083-9cb06428c506 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a0485d3e10d4e5081844cf6792ab8a7'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:54:31.841046 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-0abe0258-2ab2-475c-9083-9cb06428c506 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a0485d3e10d4e5081844cf6792ab8a7'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:54:31.848301 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-0abe0258-2ab2-475c-9083-9cb06428c506 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a0485d3e10d4e5081844cf6792ab8a7'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:54:31.849418 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-0abe0258-2ab2-475c-9083-9cb06428c506 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a0485d3e10d4e5081844cf6792ab8a7'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:54:31.850049 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-0abe0258-2ab2-475c-9083-9cb06428c506 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a0485d3e10d4e5081844cf6792ab8a7'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:54:31.942775 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1274/2525] 10.222.0.102 () {58 vars in 1229 bytes} [Mon Aug 1 15:54:31 2022] DELETE /identity/v3/users/7a0485d3e10d4e5081844cf6792ab8a7 => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 15:54:32.362345 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce7a10c-66c9-4ce4-a385-e38e990bee77 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:54:32.363830 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-bce7a10c-66c9-4ce4-a385-e38e990bee77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:54:32.378163 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce7a10c-66c9-4ce4-a385-e38e990bee77 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:54:32.414404 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:54:32.448672 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f3b3c4-f943-4cbe-82a0-3b95465a26eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:54:32.449389 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f3b3c4-f943-4cbe-82a0-3b95465a26eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:32.449891 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f3b3c4-f943-4cbe-82a0-3b95465a26eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:32.450221 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f3b3c4-f943-4cbe-82a0-3b95465a26eb admin admin] PATH_INFO: `/v3/projects/4d9d52995b424a1c9ad3469e28ea88fa` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:32.451803 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f3b3c4-f943-4cbe-82a0-3b95465a26eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d9d52995b424a1c9ad3469e28ea88fa)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:54:32.453798 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f3b3c4-f943-4cbe-82a0-3b95465a26eb admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:54:32.540574 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-a2f3b3c4-f943-4cbe-82a0-3b95465a26eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d9d52995b424a1c9ad3469e28ea88fa', 'request_id': 'req-a2f3b3c4-f943-4cbe-82a0-3b95465a26eb'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:54:32.611760 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-a2f3b3c4-f943-4cbe-82a0-3b95465a26eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d9d52995b424a1c9ad3469e28ea88fa', 'request_id': 'req-a2f3b3c4-f943-4cbe-82a0-3b95465a26eb'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:54:32.618231 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-a2f3b3c4-f943-4cbe-82a0-3b95465a26eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d9d52995b424a1c9ad3469e28ea88fa', 'request_id': 'req-a2f3b3c4-f943-4cbe-82a0-3b95465a26eb'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:54:32.629642 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-a2f3b3c4-f943-4cbe-82a0-3b95465a26eb admin admin] The token cache is being invalidate because project 4d9d52995b424a1c9ad3469e28ea88fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80353) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 15:54:32.629929 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-a2f3b3c4-f943-4cbe-82a0-3b95465a26eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:54:32.630561 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-a2f3b3c4-f943-4cbe-82a0-3b95465a26eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:54:32.632115 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1252/2526] 10.222.0.102 () {58 vars in 1238 bytes} [Mon Aug 1 15:54:32 2022] DELETE /identity/v3/projects/4d9d52995b424a1c9ad3469e28ea88fa => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:54:32.637138 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6d8a04-1688-4ffa-bcde-7a27c6b85d1c None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:32.645457 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6d8a04-1688-4ffa-bcde-7a27c6b85d1c None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:32.645457 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6d8a04-1688-4ffa-bcde-7a27c6b85d1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:32.657151 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-ee6d8a04-1688-4ffa-bcde-7a27c6b85d1c None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:54:32.658358 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-ee6d8a04-1688-4ffa-bcde-7a27c6b85d1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:54:32.704645 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:54:32.719902 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1275/2527] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:54:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:54:32.727978 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddd6227-00e0-416d-b8f3-14888f6f56ff None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:32.728284 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddd6227-00e0-416d-b8f3-14888f6f56ff None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:32.728552 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddd6227-00e0-416d-b8f3-14888f6f56ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:32.751446 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-6ddd6227-00e0-416d-b8f3-14888f6f56ff None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:54:32.752680 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-6ddd6227-00e0-416d-b8f3-14888f6f56ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:54:32.760723 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1253/2528] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:54:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:54:32.765019 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6d8a04-1688-4ffa-bcde-7a27c6b85d1c None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:54:32.774765 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6d8a04-1688-4ffa-bcde-7a27c6b85d1c None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:54:32.779507 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3795275e-2e02-4998-9cb4-cf0170243e83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:54:32.780132 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3795275e-2e02-4998-9cb4-cf0170243e83 admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:32.780399 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3795275e-2e02-4998-9cb4-cf0170243e83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:32.780665 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3795275e-2e02-4998-9cb4-cf0170243e83 admin admin] PATH_INFO: `/v3/domains` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:32.781383 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3795275e-2e02-4998-9cb4-cf0170243e83 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:54:32.781683 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3795275e-2e02-4998-9cb4-cf0170243e83 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:54:32.783279 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3795275e-2e02-4998-9cb4-cf0170243e83 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:54:32.795395 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1276/2529] 10.222.0.102 () {58 vars in 1158 bytes} [Mon Aug 1 15:54:32 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:54:32.799860 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddd6227-00e0-416d-b8f3-14888f6f56ff None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:54:32.810076 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddd6227-00e0-416d-b8f3-14888f6f56ff None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:54:32.814971 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61823e39-74ba-40b8-bbc7-d82c0747ac96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:54:32.815589 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61823e39-74ba-40b8-bbc7-d82c0747ac96 admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:32.815868 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61823e39-74ba-40b8-bbc7-d82c0747ac96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:32.816139 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61823e39-74ba-40b8-bbc7-d82c0747ac96 admin admin] PATH_INFO: `/v3/projects` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:32.816808 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61823e39-74ba-40b8-bbc7-d82c0747ac96 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:54:32.818745 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61823e39-74ba-40b8-bbc7-d82c0747ac96 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:54:32.911397 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1254/2530] 10.222.0.102 () {60 vars in 1158 bytes} [Mon Aug 1 15:54:32 2022] POST /identity/v3/projects => generated 388 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:54:32.915750 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3795275e-2e02-4998-9cb4-cf0170243e83 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:54:32.926632 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3795275e-2e02-4998-9cb4-cf0170243e83 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:54:32.983361 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8570091a-79ba-4bdf-831c-058b649b681a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:54:32.983995 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8570091a-79ba-4bdf-831c-058b649b681a admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:32.984276 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8570091a-79ba-4bdf-831c-058b649b681a admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:32.984545 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8570091a-79ba-4bdf-831c-058b649b681a admin admin] PATH_INFO: `/v3/users` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:32.985561 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8570091a-79ba-4bdf-831c-058b649b681a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:54:32.987526 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8570091a-79ba-4bdf-831c-058b649b681a admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:54:33.101232 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1277/2531] 10.222.0.102 () {60 vars in 1149 bytes} [Mon Aug 1 15:54:32 2022] POST /identity/v3/users => generated 295 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 15:54:33.105324 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61823e39-74ba-40b8-bbc7-d82c0747ac96 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:54:33.116269 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61823e39-74ba-40b8-bbc7-d82c0747ac96 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:54:33.120961 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9e02b8-e484-4d92-91f6-6bd7b042bd7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:54:33.121568 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9e02b8-e484-4d92-91f6-6bd7b042bd7a admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:33.121881 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9e02b8-e484-4d92-91f6-6bd7b042bd7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:33.122195 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9e02b8-e484-4d92-91f6-6bd7b042bd7a admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:33.122859 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9e02b8-e484-4d92-91f6-6bd7b042bd7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:54:33.124528 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9e02b8-e484-4d92-91f6-6bd7b042bd7a admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:54:33.134474 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1255/2532] 10.222.0.102 () {58 vars in 1127 bytes} [Mon Aug 1 15:54:33 2022] GET /identity/v3/roles => generated 1427 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:54:33.138302 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8570091a-79ba-4bdf-831c-058b649b681a admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:54:33.148701 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8570091a-79ba-4bdf-831c-058b649b681a admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:54:33.155057 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d06b0f-3c8b-4967-8304-1318cd23cf7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:54:33.155676 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d06b0f-3c8b-4967-8304-1318cd23cf7c admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:33.155952 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d06b0f-3c8b-4967-8304-1318cd23cf7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:33.156315 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d06b0f-3c8b-4967-8304-1318cd23cf7c admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:33.157044 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d06b0f-3c8b-4967-8304-1318cd23cf7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:54:33.161057 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d06b0f-3c8b-4967-8304-1318cd23cf7c admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:54:33.170545 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1278/2533] 10.222.0.102 () {58 vars in 1127 bytes} [Mon Aug 1 15:54:33 2022] GET /identity/v3/roles => generated 1427 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:54:33.180068 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9e02b8-e484-4d92-91f6-6bd7b042bd7a admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:54:33.190887 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9e02b8-e484-4d92-91f6-6bd7b042bd7a admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:54:33.195748 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f621abf-6596-4a57-acc7-5c9c28bf3115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:54:33.196432 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f621abf-6596-4a57-acc7-5c9c28bf3115 admin admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:33.196831 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f621abf-6596-4a57-acc7-5c9c28bf3115 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:33.200113 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f621abf-6596-4a57-acc7-5c9c28bf3115 admin admin] PATH_INFO: `/v3/projects/02fd2bf22e0f4b96bf3c5c65bd804739/users/57c340ab2bfa4fd380723096c62fae0d/roles/27f5093ac0674d799cdbd17c68482e32` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:33.213268 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f621abf-6596-4a57-acc7-5c9c28bf3115 admin admin] RBAC: Authorizing `identity:create_grant(project_id=02fd2bf22e0f4b96bf3c5c65bd804739, user_id=57c340ab2bfa4fd380723096c62fae0d, role_id=27f5093ac0674d799cdbd17c68482e32)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:54:33.216559 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f621abf-6596-4a57-acc7-5c9c28bf3115 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:54:33.278854 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1256/2534] 10.222.0.102 () {60 vars in 1488 bytes} [Mon Aug 1 15:54:33 2022] PUT /identity/v3/projects/02fd2bf22e0f4b96bf3c5c65bd804739/users/57c340ab2bfa4fd380723096c62fae0d/roles/27f5093ac0674d799cdbd17c68482e32 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:54:33.289272 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eece06df-0d6b-4fcb-ba41-19d03a97039e None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:33.289583 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eece06df-0d6b-4fcb-ba41-19d03a97039e None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:33.289854 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eece06df-0d6b-4fcb-ba41-19d03a97039e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:33.321245 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-eece06df-0d6b-4fcb-ba41-19d03a97039e None None] MFA Rules not processed for user `57c340ab2bfa4fd380723096c62fae0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:54:33.322463 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-eece06df-0d6b-4fcb-ba41-19d03a97039e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:54:33.390133 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1279/2535] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:54:33 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:54:33.400047 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f621abf-6596-4a57-acc7-5c9c28bf3115 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:54:33.460075 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:54:33.464666 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f621abf-6596-4a57-acc7-5c9c28bf3115 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:54:33.470076 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba2d288-9ad0-4a70-8dde-b7d1c47f4241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:54:33.470697 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba2d288-9ad0-4a70-8dde-b7d1c47f4241 admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:33.470987 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba2d288-9ad0-4a70-8dde-b7d1c47f4241 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:33.471261 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba2d288-9ad0-4a70-8dde-b7d1c47f4241 admin admin] PATH_INFO: `/v3/projects` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:33.472066 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba2d288-9ad0-4a70-8dde-b7d1c47f4241 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:54:33.474071 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba2d288-9ad0-4a70-8dde-b7d1c47f4241 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:54:33.580566 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1257/2536] 10.222.0.102 () {60 vars in 1158 bytes} [Mon Aug 1 15:54:33 2022] POST /identity/v3/projects => generated 386 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:54:33.584363 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eece06df-0d6b-4fcb-ba41-19d03a97039e None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:54:33.595235 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eece06df-0d6b-4fcb-ba41-19d03a97039e None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:54:33.636111 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:54:33.656021 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce89f4ee-12c6-4d55-8e20-6f57324edd3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:54:33.656021 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce89f4ee-12c6-4d55-8e20-6f57324edd3c admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:33.656021 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce89f4ee-12c6-4d55-8e20-6f57324edd3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:33.656021 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce89f4ee-12c6-4d55-8e20-6f57324edd3c admin admin] PATH_INFO: `/v3/users` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:33.656966 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce89f4ee-12c6-4d55-8e20-6f57324edd3c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:54:33.656966 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce89f4ee-12c6-4d55-8e20-6f57324edd3c admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:54:33.767428 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1280/2537] 10.222.0.102 () {60 vars in 1149 bytes} [Mon Aug 1 15:54:33 2022] POST /identity/v3/users => generated 300 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 15:54:33.771596 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba2d288-9ad0-4a70-8dde-b7d1c47f4241 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:54:33.781805 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba2d288-9ad0-4a70-8dde-b7d1c47f4241 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:54:33.786346 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e39d879-073a-467d-9ae2-444e2a1b5b6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:54:33.786946 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e39d879-073a-467d-9ae2-444e2a1b5b6b admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:33.787221 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e39d879-073a-467d-9ae2-444e2a1b5b6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:33.787488 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e39d879-073a-467d-9ae2-444e2a1b5b6b admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:33.788204 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e39d879-073a-467d-9ae2-444e2a1b5b6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:54:33.789854 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e39d879-073a-467d-9ae2-444e2a1b5b6b admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:54:33.800264 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1258/2538] 10.222.0.102 () {58 vars in 1127 bytes} [Mon Aug 1 15:54:33 2022] GET /identity/v3/roles => generated 1427 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:54:33.804592 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce89f4ee-12c6-4d55-8e20-6f57324edd3c admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:54:33.816651 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce89f4ee-12c6-4d55-8e20-6f57324edd3c admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:54:33.821698 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f98c909-54bb-4cf9-bba0-10995b8c88d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:54:33.822539 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f98c909-54bb-4cf9-bba0-10995b8c88d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:33.822779 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f98c909-54bb-4cf9-bba0-10995b8c88d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:33.823078 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f98c909-54bb-4cf9-bba0-10995b8c88d0 admin admin] PATH_INFO: `/v3/projects/5400a9e366f943b3a2ce91d718fb7bde/users/36cf952f1a754e3a9292a31a0bc8f209/roles/de1374f966c04c27b579515b54334fd2` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:33.840316 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f98c909-54bb-4cf9-bba0-10995b8c88d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5400a9e366f943b3a2ce91d718fb7bde, user_id=36cf952f1a754e3a9292a31a0bc8f209, role_id=de1374f966c04c27b579515b54334fd2)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:54:33.843073 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f98c909-54bb-4cf9-bba0-10995b8c88d0 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:54:33.970700 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1281/2539] 10.222.0.102 () {60 vars in 1488 bytes} [Mon Aug 1 15:54:33 2022] PUT /identity/v3/projects/5400a9e366f943b3a2ce91d718fb7bde/users/36cf952f1a754e3a9292a31a0bc8f209/roles/de1374f966c04c27b579515b54334fd2 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:54:33.974667 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e39d879-073a-467d-9ae2-444e2a1b5b6b admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:54:33.985655 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e39d879-073a-467d-9ae2-444e2a1b5b6b admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:54:34.042662 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736d174b-3af0-46c7-9757-f43fe37f412b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:54:34.043788 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736d174b-3af0-46c7-9757-f43fe37f412b admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:34.044069 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736d174b-3af0-46c7-9757-f43fe37f412b admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:34.044343 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736d174b-3af0-46c7-9757-f43fe37f412b admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:34.045096 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736d174b-3af0-46c7-9757-f43fe37f412b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:54:34.046725 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736d174b-3af0-46c7-9757-f43fe37f412b admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:54:34.056681 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1259/2540] 10.222.0.102 () {58 vars in 1127 bytes} [Mon Aug 1 15:54:33 2022] GET /identity/v3/roles => generated 1427 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:54:34.061927 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f98c909-54bb-4cf9-bba0-10995b8c88d0 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:54:34.072308 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f98c909-54bb-4cf9-bba0-10995b8c88d0 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:54:34.076936 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c149677e-c7ec-4694-b701-33f502872f6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:54:34.077589 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c149677e-c7ec-4694-b701-33f502872f6a admin admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:34.077872 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c149677e-c7ec-4694-b701-33f502872f6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:34.078144 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c149677e-c7ec-4694-b701-33f502872f6a admin admin] PATH_INFO: `/v3/projects/5400a9e366f943b3a2ce91d718fb7bde/users/36cf952f1a754e3a9292a31a0bc8f209/roles/de1374f966c04c27b579515b54334fd2` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:34.080170 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c149677e-c7ec-4694-b701-33f502872f6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=5400a9e366f943b3a2ce91d718fb7bde, user_id=36cf952f1a754e3a9292a31a0bc8f209, role_id=de1374f966c04c27b579515b54334fd2)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:54:34.082882 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c149677e-c7ec-4694-b701-33f502872f6a admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:54:34.092947 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1282/2541] 10.222.0.102 () {60 vars in 1488 bytes} [Mon Aug 1 15:54:34 2022] PUT /identity/v3/projects/5400a9e366f943b3a2ce91d718fb7bde/users/36cf952f1a754e3a9292a31a0bc8f209/roles/de1374f966c04c27b579515b54334fd2 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:54:34.104105 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616bfb61-0bdf-4aff-a67b-ed8044b9aa17 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:34.104418 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616bfb61-0bdf-4aff-a67b-ed8044b9aa17 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:34.104694 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616bfb61-0bdf-4aff-a67b-ed8044b9aa17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:34.132855 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-616bfb61-0bdf-4aff-a67b-ed8044b9aa17 None None] MFA Rules not processed for user `36cf952f1a754e3a9292a31a0bc8f209`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:54:34.134088 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-616bfb61-0bdf-4aff-a67b-ed8044b9aa17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:54:34.202090 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1260/2542] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:54:34 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:54:34.213773 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c149677e-c7ec-4694-b701-33f502872f6a admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:54:34.215484 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-c149677e-c7ec-4694-b701-33f502872f6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:54:34.277279 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c149677e-c7ec-4694-b701-33f502872f6a admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:54:34.281157 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fa9303-32cf-42af-b33e-39bac56d27a6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff810b37183c4729859c1b05edff1703', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:54:34.281771 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fa9303-32cf-42af-b33e-39bac56d27a6 service cinder] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:34.282047 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fa9303-32cf-42af-b33e-39bac56d27a6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:34.282316 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fa9303-32cf-42af-b33e-39bac56d27a6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:34.291683 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fa9303-32cf-42af-b33e-39bac56d27a6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:54:34.294012 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fa9303-32cf-42af-b33e-39bac56d27a6 service cinder] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:54:34.304996 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1283/2543] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:54:34 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:54:34.370678 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616bfb61-0bdf-4aff-a67b-ed8044b9aa17 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:54:34.428632 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:54:34.441741 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616bfb61-0bdf-4aff-a67b-ed8044b9aa17 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:54:34.446749 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98f9d61-4d24-415f-825e-6993fb7dff0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:54:34.450103 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98f9d61-4d24-415f-825e-6993fb7dff0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:34.450103 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98f9d61-4d24-415f-825e-6993fb7dff0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:34.450103 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98f9d61-4d24-415f-825e-6993fb7dff0e admin admin] PATH_INFO: `/v3/users/57c340ab2bfa4fd380723096c62fae0d` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:34.450103 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98f9d61-4d24-415f-825e-6993fb7dff0e admin admin] RBAC: Authorizing `identity:delete_user(user_id=57c340ab2bfa4fd380723096c62fae0d)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:54:34.451955 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98f9d61-4d24-415f-825e-6993fb7dff0e admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:54:34.669546 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-c98f9d61-4d24-415f-825e-6993fb7dff0e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57c340ab2bfa4fd380723096c62fae0d'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:54:34.792883 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-c98f9d61-4d24-415f-825e-6993fb7dff0e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57c340ab2bfa4fd380723096c62fae0d'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:54:34.806322 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-c98f9d61-4d24-415f-825e-6993fb7dff0e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57c340ab2bfa4fd380723096c62fae0d'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:54:34.807000 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-c98f9d61-4d24-415f-825e-6993fb7dff0e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57c340ab2bfa4fd380723096c62fae0d'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:54:34.807626 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-c98f9d61-4d24-415f-825e-6993fb7dff0e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57c340ab2bfa4fd380723096c62fae0d'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:54:34.820321 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1261/2544] 10.222.0.102 () {58 vars in 1229 bytes} [Mon Aug 1 15:54:34 2022] DELETE /identity/v3/users/57c340ab2bfa4fd380723096c62fae0d => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 15:54:34.825596 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3635cb3-4767-44eb-bc61-61f59d969fc8 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:34.826065 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3635cb3-4767-44eb-bc61-61f59d969fc8 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:34.826180 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3635cb3-4767-44eb-bc61-61f59d969fc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:34.845354 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-e3635cb3-4767-44eb-bc61-61f59d969fc8 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:54:34.846573 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-e3635cb3-4767-44eb-bc61-61f59d969fc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:54:34.908593 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1284/2545] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:54:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 15:54:34.918858 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98f9d61-4d24-415f-825e-6993fb7dff0e admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:54:34.920297 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-c98f9d61-4d24-415f-825e-6993fb7dff0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:54:34.977611 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98f9d61-4d24-415f-825e-6993fb7dff0e admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:54:34.981310 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dc8ea7-34f1-4c8e-a6e0-fb210cbc4d65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a856a413100443939fe9b10daa868518', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:54:34.981928 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dc8ea7-34f1-4c8e-a6e0-fb210cbc4d65 service neutron] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:34.982214 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dc8ea7-34f1-4c8e-a6e0-fb210cbc4d65 service neutron] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:34.982483 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dc8ea7-34f1-4c8e-a6e0-fb210cbc4d65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:34.991686 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2dc8ea7-34f1-4c8e-a6e0-fb210cbc4d65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:54:34.993150 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2dc8ea7-34f1-4c8e-a6e0-fb210cbc4d65 service neutron] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:54:35.002963 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1262/2546] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:54:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:54:35.440588 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3635cb3-4767-44eb-bc61-61f59d969fc8 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:54:35.442287 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-e3635cb3-4767-44eb-bc61-61f59d969fc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:54:35.455258 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3635cb3-4767-44eb-bc61-61f59d969fc8 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:54:35.460041 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17daecbe-5781-4107-9cf3-d6c35ce461e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:54:35.460698 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17daecbe-5781-4107-9cf3-d6c35ce461e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:35.461007 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17daecbe-5781-4107-9cf3-d6c35ce461e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:35.461281 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17daecbe-5781-4107-9cf3-d6c35ce461e1 admin admin] PATH_INFO: `/v3/projects/02fd2bf22e0f4b96bf3c5c65bd804739` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:35.462467 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17daecbe-5781-4107-9cf3-d6c35ce461e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=02fd2bf22e0f4b96bf3c5c65bd804739)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:54:35.464387 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17daecbe-5781-4107-9cf3-d6c35ce461e1 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:54:35.577163 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=93,keystone:INSERT=5,keystone:DELETE=2 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:54:35.587350 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-17daecbe-5781-4107-9cf3-d6c35ce461e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02fd2bf22e0f4b96bf3c5c65bd804739', 'request_id': 'req-17daecbe-5781-4107-9cf3-d6c35ce461e1'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:54:35.598360 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-17daecbe-5781-4107-9cf3-d6c35ce461e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02fd2bf22e0f4b96bf3c5c65bd804739', 'request_id': 'req-17daecbe-5781-4107-9cf3-d6c35ce461e1'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:54:35.643410 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dc8ea7-34f1-4c8e-a6e0-fb210cbc4d65 service neutron] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:54:35.643410 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-a2dc8ea7-34f1-4c8e-a6e0-fb210cbc4d65 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:54:35.656293 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dc8ea7-34f1-4c8e-a6e0-fb210cbc4d65 service neutron] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:54:35.712185 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee5dea5-047d-4753-80e3-3e8311aae9a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:54:35.712750 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee5dea5-047d-4753-80e3-3e8311aae9a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:35.713147 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee5dea5-047d-4753-80e3-3e8311aae9a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:35.713363 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee5dea5-047d-4753-80e3-3e8311aae9a2 admin admin] PATH_INFO: `/v3/users/bd2da82242344efca6ab8a65654304a5` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:35.714390 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-17daecbe-5781-4107-9cf3-d6c35ce461e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02fd2bf22e0f4b96bf3c5c65bd804739', 'request_id': 'req-17daecbe-5781-4107-9cf3-d6c35ce461e1'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:54:35.714557 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee5dea5-047d-4753-80e3-3e8311aae9a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd2da82242344efca6ab8a65654304a5)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:54:35.717256 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee5dea5-047d-4753-80e3-3e8311aae9a2 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:54:35.726369 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-17daecbe-5781-4107-9cf3-d6c35ce461e1 admin admin] The token cache is being invalidate because project 02fd2bf22e0f4b96bf3c5c65bd804739 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80352) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 15:54:35.729477 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-17daecbe-5781-4107-9cf3-d6c35ce461e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:54:35.729477 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-17daecbe-5781-4107-9cf3-d6c35ce461e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:54:35.732158 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1285/2547] 10.222.0.102 () {58 vars in 1238 bytes} [Mon Aug 1 15:54:35 2022] DELETE /identity/v3/projects/02fd2bf22e0f4b96bf3c5c65bd804739 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:54:35.733504 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:54:35.733959 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17daecbe-5781-4107-9cf3-d6c35ce461e1 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:54:35.735328 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-17daecbe-5781-4107-9cf3-d6c35ce461e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:54:35.748964 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17daecbe-5781-4107-9cf3-d6c35ce461e1 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:54:35.754917 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65750d5-00fe-4c05-92bd-b60b2d8bf672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:54:35.755564 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65750d5-00fe-4c05-92bd-b60b2d8bf672 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:35.755840 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65750d5-00fe-4c05-92bd-b60b2d8bf672 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:35.756112 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65750d5-00fe-4c05-92bd-b60b2d8bf672 admin admin] PATH_INFO: `/v3/users/36cf952f1a754e3a9292a31a0bc8f209` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:35.757318 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65750d5-00fe-4c05-92bd-b60b2d8bf672 admin admin] RBAC: Authorizing `identity:delete_user(user_id=36cf952f1a754e3a9292a31a0bc8f209)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:54:35.759348 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65750d5-00fe-4c05-92bd-b60b2d8bf672 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:54:35.892872 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-dee5dea5-047d-4753-80e3-3e8311aae9a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd2da82242344efca6ab8a65654304a5'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:54:35.970029 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-dee5dea5-047d-4753-80e3-3e8311aae9a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd2da82242344efca6ab8a65654304a5'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:54:35.982801 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-dee5dea5-047d-4753-80e3-3e8311aae9a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd2da82242344efca6ab8a65654304a5'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:54:35.983472 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-dee5dea5-047d-4753-80e3-3e8311aae9a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd2da82242344efca6ab8a65654304a5'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:54:35.984084 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-dee5dea5-047d-4753-80e3-3e8311aae9a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd2da82242344efca6ab8a65654304a5'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:54:35.984208 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-a65750d5-00fe-4c05-92bd-b60b2d8bf672 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36cf952f1a754e3a9292a31a0bc8f209'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:54:35.997093 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-a65750d5-00fe-4c05-92bd-b60b2d8bf672 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36cf952f1a754e3a9292a31a0bc8f209'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:54:35.997555 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1263/2548] 10.222.0.102 () {58 vars in 1229 bytes} [Mon Aug 1 15:54:35 2022] DELETE /identity/v3/users/bd2da82242344efca6ab8a65654304a5 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 15:54:35.998665 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719e26ce-a7f5-4263-b340-4cf2aac7ec87 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:35.998952 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719e26ce-a7f5-4263-b340-4cf2aac7ec87 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:35.999234 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719e26ce-a7f5-4263-b340-4cf2aac7ec87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:36.004586 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-a65750d5-00fe-4c05-92bd-b60b2d8bf672 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36cf952f1a754e3a9292a31a0bc8f209'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:54:36.005291 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-a65750d5-00fe-4c05-92bd-b60b2d8bf672 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36cf952f1a754e3a9292a31a0bc8f209'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:54:36.005897 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-a65750d5-00fe-4c05-92bd-b60b2d8bf672 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36cf952f1a754e3a9292a31a0bc8f209'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:54:36.018751 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-719e26ce-a7f5-4263-b340-4cf2aac7ec87 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:54:36.019993 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-719e26ce-a7f5-4263-b340-4cf2aac7ec87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:54:36.077680 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1264/2549] 10.222.0.65 () {58 vars in 1020 bytes} [Mon Aug 1 15:54:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:54:36.078932 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c04e1d-8dc7-467b-8be0-9dc77e75f1cb None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:36.079218 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c04e1d-8dc7-467b-8be0-9dc77e75f1cb None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:36.079441 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1286/2550] 10.222.0.102 () {58 vars in 1229 bytes} [Mon Aug 1 15:54:35 2022] DELETE /identity/v3/users/36cf952f1a754e3a9292a31a0bc8f209 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:54:36.079556 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c04e1d-8dc7-467b-8be0-9dc77e75f1cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:36.099418 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65750d5-00fe-4c05-92bd-b60b2d8bf672 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:54:36.100893 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-a65750d5-00fe-4c05-92bd-b60b2d8bf672 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:54:36.103509 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-40c04e1d-8dc7-467b-8be0-9dc77e75f1cb None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:54:36.104702 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-40c04e1d-8dc7-467b-8be0-9dc77e75f1cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:54:36.196172 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1265/2551] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:54:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:54:36.205445 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c04e1d-8dc7-467b-8be0-9dc77e75f1cb None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:54:36.206898 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-40c04e1d-8dc7-467b-8be0-9dc77e75f1cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:54:36.209701 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65750d5-00fe-4c05-92bd-b60b2d8bf672 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:54:36.215434 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cc0523-ffcc-4420-9b29-360e7062d635 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77b43f1ee8cc4be3907a494abe90c1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:54:36.216060 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cc0523-ffcc-4420-9b29-360e7062d635 service nova] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:36.216346 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cc0523-ffcc-4420-9b29-360e7062d635 service nova] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:36.216650 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cc0523-ffcc-4420-9b29-360e7062d635 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:36.231759 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cc0523-ffcc-4420-9b29-360e7062d635 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:54:36.231759 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cc0523-ffcc-4420-9b29-360e7062d635 service nova] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:54:36.239141 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1287/2552] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:54:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:54:36.382665 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:54:36.406506 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c04e1d-8dc7-467b-8be0-9dc77e75f1cb None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:54:36.410618 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347a93f6-f8f4-42ea-ab93-b05148591b20 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a856a413100443939fe9b10daa868518', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:54:36.411255 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347a93f6-f8f4-42ea-ab93-b05148591b20 service neutron] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:36.411525 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347a93f6-f8f4-42ea-ab93-b05148591b20 service neutron] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:36.411790 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347a93f6-f8f4-42ea-ab93-b05148591b20 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:36.422646 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347a93f6-f8f4-42ea-ab93-b05148591b20 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:54:36.424430 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347a93f6-f8f4-42ea-ab93-b05148591b20 service neutron] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:54:36.436381 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1266/2553] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:54:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:54:36.568873 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cc0523-ffcc-4420-9b29-360e7062d635 service nova] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:54:36.570457 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-48cc0523-ffcc-4420-9b29-360e7062d635 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:54:36.585736 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cc0523-ffcc-4420-9b29-360e7062d635 service nova] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:54:36.591410 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456c81cc-4b6d-4b2a-9878-0cc424667a90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:54:36.592256 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456c81cc-4b6d-4b2a-9878-0cc424667a90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:36.592554 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456c81cc-4b6d-4b2a-9878-0cc424667a90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:36.592959 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456c81cc-4b6d-4b2a-9878-0cc424667a90 admin admin] PATH_INFO: `/v3/projects/5400a9e366f943b3a2ce91d718fb7bde` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:36.594277 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456c81cc-4b6d-4b2a-9878-0cc424667a90 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5400a9e366f943b3a2ce91d718fb7bde)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:54:36.601178 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456c81cc-4b6d-4b2a-9878-0cc424667a90 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:54:36.615727 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:54:36.740570 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-456c81cc-4b6d-4b2a-9878-0cc424667a90 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5400a9e366f943b3a2ce91d718fb7bde', 'request_id': 'req-456c81cc-4b6d-4b2a-9878-0cc424667a90'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:54:36.750428 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-456c81cc-4b6d-4b2a-9878-0cc424667a90 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5400a9e366f943b3a2ce91d718fb7bde', 'request_id': 'req-456c81cc-4b6d-4b2a-9878-0cc424667a90'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:54:36.849482 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-456c81cc-4b6d-4b2a-9878-0cc424667a90 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5400a9e366f943b3a2ce91d718fb7bde', 'request_id': 'req-456c81cc-4b6d-4b2a-9878-0cc424667a90'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:54:36.861343 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-456c81cc-4b6d-4b2a-9878-0cc424667a90 admin admin] The token cache is being invalidate because project 5400a9e366f943b3a2ce91d718fb7bde was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80352) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 15:54:36.862268 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-456c81cc-4b6d-4b2a-9878-0cc424667a90 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:54:36.862268 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-456c81cc-4b6d-4b2a-9878-0cc424667a90 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:54:36.863831 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1288/2554] 10.222.0.102 () {58 vars in 1238 bytes} [Mon Aug 1 15:54:36 2022] DELETE /identity/v3/projects/5400a9e366f943b3a2ce91d718fb7bde => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:54:36.869106 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e0414e-d63c-48a0-be7e-ee9164fe8e19 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:36.869605 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e0414e-d63c-48a0-be7e-ee9164fe8e19 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:36.869717 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e0414e-d63c-48a0-be7e-ee9164fe8e19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:36.889053 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-a7e0414e-d63c-48a0-be7e-ee9164fe8e19 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:54:36.890271 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-a7e0414e-d63c-48a0-be7e-ee9164fe8e19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:54:36.933778 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456c81cc-4b6d-4b2a-9878-0cc424667a90 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:54:36.937462 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-456c81cc-4b6d-4b2a-9878-0cc424667a90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:54:36.958235 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1267/2555] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:54:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:54:36.967665 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6071d0f3-3fc5-47e5-9345-8089eee7a3b6 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:36.967773 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6071d0f3-3fc5-47e5-9345-8089eee7a3b6 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:36.968031 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6071d0f3-3fc5-47e5-9345-8089eee7a3b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:36.989690 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-6071d0f3-3fc5-47e5-9345-8089eee7a3b6 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:54:36.990888 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-6071d0f3-3fc5-47e5-9345-8089eee7a3b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:54:36.998865 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1268/2556] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:54:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 15:54:37.003012 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6071d0f3-3fc5-47e5-9345-8089eee7a3b6 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:54:37.007286 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456c81cc-4b6d-4b2a-9878-0cc424667a90 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:54:37.012402 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6071d0f3-3fc5-47e5-9345-8089eee7a3b6 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:54:37.012816 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf72ef26-a775-458e-9b39-d5fcaced5533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:54:37.013583 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf72ef26-a775-458e-9b39-d5fcaced5533 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:37.013886 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf72ef26-a775-458e-9b39-d5fcaced5533 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:37.014290 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf72ef26-a775-458e-9b39-d5fcaced5533 admin admin] PATH_INFO: `/v3/projects/637d3bbaff444826bf2399fd78c9d0b7` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:37.015748 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf72ef26-a775-458e-9b39-d5fcaced5533 admin admin] RBAC: Authorizing `identity:delete_project(project_id=637d3bbaff444826bf2399fd78c9d0b7)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:54:37.017624 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f52fddb-4500-4e81-896f-8d0863396823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:54:37.017774 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf72ef26-a775-458e-9b39-d5fcaced5533 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:54:37.018230 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f52fddb-4500-4e81-896f-8d0863396823 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:37.018509 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f52fddb-4500-4e81-896f-8d0863396823 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:37.018780 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f52fddb-4500-4e81-896f-8d0863396823 admin admin] PATH_INFO: `/v3/domains` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:37.019476 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f52fddb-4500-4e81-896f-8d0863396823 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:54:37.019777 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f52fddb-4500-4e81-896f-8d0863396823 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:54:37.021405 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f52fddb-4500-4e81-896f-8d0863396823 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:54:37.035384 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1269/2557] 10.222.0.102 () {58 vars in 1158 bytes} [Mon Aug 1 15:54:37 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:54:37.039797 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f52fddb-4500-4e81-896f-8d0863396823 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:54:37.049880 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f52fddb-4500-4e81-896f-8d0863396823 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:54:37.054506 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829255df-8f87-4d71-91c7-39dde6021731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:54:37.055100 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829255df-8f87-4d71-91c7-39dde6021731 admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:37.055377 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829255df-8f87-4d71-91c7-39dde6021731 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:37.055646 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829255df-8f87-4d71-91c7-39dde6021731 admin admin] PATH_INFO: `/v3/projects` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:37.056296 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829255df-8f87-4d71-91c7-39dde6021731 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:54:37.058227 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829255df-8f87-4d71-91c7-39dde6021731 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:54:37.135381 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-cf72ef26-a775-458e-9b39-d5fcaced5533 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '637d3bbaff444826bf2399fd78c9d0b7', 'request_id': 'req-cf72ef26-a775-458e-9b39-d5fcaced5533'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:54:37.142201 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-cf72ef26-a775-458e-9b39-d5fcaced5533 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '637d3bbaff444826bf2399fd78c9d0b7', 'request_id': 'req-cf72ef26-a775-458e-9b39-d5fcaced5533'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:54:37.163420 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1270/2558] 10.222.0.102 () {60 vars in 1158 bytes} [Mon Aug 1 15:54:37 2022] POST /identity/v3/projects => generated 402 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 15:54:37.167476 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829255df-8f87-4d71-91c7-39dde6021731 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:54:37.221097 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-cf72ef26-a775-458e-9b39-d5fcaced5533 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '637d3bbaff444826bf2399fd78c9d0b7', 'request_id': 'req-cf72ef26-a775-458e-9b39-d5fcaced5533'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:54:37.229990 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829255df-8f87-4d71-91c7-39dde6021731 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:54:37.232344 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-cf72ef26-a775-458e-9b39-d5fcaced5533 admin admin] The token cache is being invalidate because project 637d3bbaff444826bf2399fd78c9d0b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80352) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 15:54:37.233620 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-cf72ef26-a775-458e-9b39-d5fcaced5533 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:54:37.234468 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-cf72ef26-a775-458e-9b39-d5fcaced5533 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:54:37.235013 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1451aeb-e2dd-4989-ab24-3c7455587a2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:54:37.235639 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1451aeb-e2dd-4989-ab24-3c7455587a2c admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:37.235920 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1451aeb-e2dd-4989-ab24-3c7455587a2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:37.236189 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1451aeb-e2dd-4989-ab24-3c7455587a2c admin admin] PATH_INFO: `/v3/users` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:37.236821 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1289/2559] 10.222.0.102 () {58 vars in 1238 bytes} [Mon Aug 1 15:54:36 2022] DELETE /identity/v3/projects/637d3bbaff444826bf2399fd78c9d0b7 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 15:54:37.236983 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1451aeb-e2dd-4989-ab24-3c7455587a2c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:54:37.238825 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1451aeb-e2dd-4989-ab24-3c7455587a2c admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:54:37.241652 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d42e8ad-91d5-46c5-9d14-f80de14b4cc2 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:37.249479 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d42e8ad-91d5-46c5-9d14-f80de14b4cc2 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:37.249479 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d42e8ad-91d5-46c5-9d14-f80de14b4cc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:37.263656 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-1d42e8ad-91d5-46c5-9d14-f80de14b4cc2 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:54:37.264883 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-1d42e8ad-91d5-46c5-9d14-f80de14b4cc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:54:37.273841 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1290/2560] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:54:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:54:37.283206 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856549e4-88ed-4f0c-b3d5-6b0df3ff71c2 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:37.283491 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856549e4-88ed-4f0c-b3d5-6b0df3ff71c2 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:37.283767 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856549e4-88ed-4f0c-b3d5-6b0df3ff71c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:37.303549 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-856549e4-88ed-4f0c-b3d5-6b0df3ff71c2 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:54:37.306657 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-856549e4-88ed-4f0c-b3d5-6b0df3ff71c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:54:37.313391 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1291/2561] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:54:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 15:54:37.317288 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856549e4-88ed-4f0c-b3d5-6b0df3ff71c2 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:54:37.326914 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856549e4-88ed-4f0c-b3d5-6b0df3ff71c2 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:54:37.331493 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9571cf-97e8-4900-ac6a-1cc95a176a2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:54:37.332082 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9571cf-97e8-4900-ac6a-1cc95a176a2b admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:37.337370 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9571cf-97e8-4900-ac6a-1cc95a176a2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:37.337370 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9571cf-97e8-4900-ac6a-1cc95a176a2b admin admin] PATH_INFO: `/v3/domains` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:37.337370 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9571cf-97e8-4900-ac6a-1cc95a176a2b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:54:37.337666 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1271/2562] 10.222.0.102 () {60 vars in 1149 bytes} [Mon Aug 1 15:54:37 2022] POST /identity/v3/users => generated 302 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 15:54:37.337765 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9571cf-97e8-4900-ac6a-1cc95a176a2b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:54:37.337765 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9571cf-97e8-4900-ac6a-1cc95a176a2b admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:54:37.338318 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1451aeb-e2dd-4989-ab24-3c7455587a2c admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:54:37.339947 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-b1451aeb-e2dd-4989-ab24-3c7455587a2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:54:37.347501 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1292/2563] 10.222.0.102 () {58 vars in 1158 bytes} [Mon Aug 1 15:54:37 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:54:37.351524 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9571cf-97e8-4900-ac6a-1cc95a176a2b admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:54:37.352062 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1451aeb-e2dd-4989-ab24-3c7455587a2c admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:54:37.357237 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfb78f3-9868-4ab7-8d40-41fc205b7977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:54:37.357857 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfb78f3-9868-4ab7-8d40-41fc205b7977 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:37.358507 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfb78f3-9868-4ab7-8d40-41fc205b7977 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:37.358507 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfb78f3-9868-4ab7-8d40-41fc205b7977 admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:37.359080 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfb78f3-9868-4ab7-8d40-41fc205b7977 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:54:37.360682 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfb78f3-9868-4ab7-8d40-41fc205b7977 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:54:37.362861 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9571cf-97e8-4900-ac6a-1cc95a176a2b admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:54:37.367660 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57409851-5a71-4bc4-b702-2854e5c8e5b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:54:37.368264 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57409851-5a71-4bc4-b702-2854e5c8e5b5 admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:37.368551 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57409851-5a71-4bc4-b702-2854e5c8e5b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:37.368823 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57409851-5a71-4bc4-b702-2854e5c8e5b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:37.369505 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57409851-5a71-4bc4-b702-2854e5c8e5b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:54:37.372041 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57409851-5a71-4bc4-b702-2854e5c8e5b5 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:54:37.372511 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1272/2564] 10.222.0.102 () {58 vars in 1127 bytes} [Mon Aug 1 15:54:37 2022] GET /identity/v3/roles => generated 1427 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 15:54:37.376586 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfb78f3-9868-4ab7-8d40-41fc205b7977 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:54:37.377037 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:54:37.382897 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:54:37.393487 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfb78f3-9868-4ab7-8d40-41fc205b7977 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:54:37.393487 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73324f9-4b09-42d7-afd7-31a61d7c7d3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:54:37.393487 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73324f9-4b09-42d7-afd7-31a61d7c7d3f admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:37.393839 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73324f9-4b09-42d7-afd7-31a61d7c7d3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:37.393839 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73324f9-4b09-42d7-afd7-31a61d7c7d3f admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:37.394506 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73324f9-4b09-42d7-afd7-31a61d7c7d3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:54:37.396106 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73324f9-4b09-42d7-afd7-31a61d7c7d3f admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:54:37.407251 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1273/2565] 10.222.0.102 () {58 vars in 1127 bytes} [Mon Aug 1 15:54:37 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:54:37.411406 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73324f9-4b09-42d7-afd7-31a61d7c7d3f admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:54:37.420690 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73324f9-4b09-42d7-afd7-31a61d7c7d3f admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:54:37.428456 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47371a51-9f29-4b89-94fc-5d602fc185d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:54:37.429173 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47371a51-9f29-4b89-94fc-5d602fc185d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:37.429451 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47371a51-9f29-4b89-94fc-5d602fc185d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:37.429722 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47371a51-9f29-4b89-94fc-5d602fc185d8 admin admin] PATH_INFO: `/v3/projects/b8ba971769244c4ab29f942f3a9739f4/users/783813f89fa2431ea3f8324e62a29851/roles/27f5093ac0674d799cdbd17c68482e32` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:37.446086 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47371a51-9f29-4b89-94fc-5d602fc185d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8ba971769244c4ab29f942f3a9739f4, user_id=783813f89fa2431ea3f8324e62a29851, role_id=27f5093ac0674d799cdbd17c68482e32)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:54:37.448783 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47371a51-9f29-4b89-94fc-5d602fc185d8 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:54:37.465003 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1293/2566] 10.222.0.102 () {60 vars in 1158 bytes} [Mon Aug 1 15:54:37 2022] POST /identity/v3/projects => generated 376 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:54:37.469157 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57409851-5a71-4bc4-b702-2854e5c8e5b5 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:54:37.515988 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1274/2567] 10.222.0.102 () {60 vars in 1488 bytes} [Mon Aug 1 15:54:37 2022] PUT /identity/v3/projects/b8ba971769244c4ab29f942f3a9739f4/users/783813f89fa2431ea3f8324e62a29851/roles/27f5093ac0674d799cdbd17c68482e32 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 15:54:37.527394 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da72138c-c011-4ab2-861a-e942d6bd93e9 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:37.527671 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da72138c-c011-4ab2-861a-e942d6bd93e9 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:37.528030 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da72138c-c011-4ab2-861a-e942d6bd93e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:37.531117 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57409851-5a71-4bc4-b702-2854e5c8e5b5 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:54:37.555427 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-da72138c-c011-4ab2-861a-e942d6bd93e9 None None] MFA Rules not processed for user `783813f89fa2431ea3f8324e62a29851`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:54:37.556912 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-da72138c-c011-4ab2-861a-e942d6bd93e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:54:37.587284 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144c7f06-e13f-46d5-91f6-39c7c6d8b192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:54:37.587910 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144c7f06-e13f-46d5-91f6-39c7c6d8b192 admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:37.588186 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144c7f06-e13f-46d5-91f6-39c7c6d8b192 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:37.588458 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144c7f06-e13f-46d5-91f6-39c7c6d8b192 admin admin] PATH_INFO: `/v3/users` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:37.589144 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144c7f06-e13f-46d5-91f6-39c7c6d8b192 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:54:37.591106 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144c7f06-e13f-46d5-91f6-39c7c6d8b192 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:54:37.623143 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1275/2568] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:54:37 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 15:54:37.627661 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da72138c-c011-4ab2-861a-e942d6bd93e9 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:54:37.638594 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da72138c-c011-4ab2-861a-e942d6bd93e9 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:54:37.643139 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ed27c2-00bc-4a3c-8a0c-51557b1228ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:54:37.643778 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ed27c2-00bc-4a3c-8a0c-51557b1228ed admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:37.644007 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ed27c2-00bc-4a3c-8a0c-51557b1228ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:37.644277 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ed27c2-00bc-4a3c-8a0c-51557b1228ed admin admin] PATH_INFO: `/v3/projects` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:37.644992 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ed27c2-00bc-4a3c-8a0c-51557b1228ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:54:37.646878 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ed27c2-00bc-4a3c-8a0c-51557b1228ed admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:54:37.692548 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1294/2569] 10.222.0.102 () {60 vars in 1149 bytes} [Mon Aug 1 15:54:37 2022] POST /identity/v3/users => generated 289 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:54:37.696475 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144c7f06-e13f-46d5-91f6-39c7c6d8b192 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:54:37.706305 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144c7f06-e13f-46d5-91f6-39c7c6d8b192 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:54:37.710979 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabc79b7-bfb5-4c3a-bbb2-2c9bf7c4b097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:54:37.711567 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabc79b7-bfb5-4c3a-bbb2-2c9bf7c4b097 admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:37.711847 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabc79b7-bfb5-4c3a-bbb2-2c9bf7c4b097 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:37.712122 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabc79b7-bfb5-4c3a-bbb2-2c9bf7c4b097 admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:37.712832 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabc79b7-bfb5-4c3a-bbb2-2c9bf7c4b097 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:54:37.714456 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabc79b7-bfb5-4c3a-bbb2-2c9bf7c4b097 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:54:37.724209 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1295/2570] 10.222.0.102 () {58 vars in 1127 bytes} [Mon Aug 1 15:54:37 2022] GET /identity/v3/roles => generated 1427 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 15:54:37.727762 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabc79b7-bfb5-4c3a-bbb2-2c9bf7c4b097 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:54:37.737841 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabc79b7-bfb5-4c3a-bbb2-2c9bf7c4b097 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:54:37.742711 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8516a6a4-17fe-4d25-98f4-71af8a5f3b5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:54:37.743305 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8516a6a4-17fe-4d25-98f4-71af8a5f3b5a admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:37.743586 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8516a6a4-17fe-4d25-98f4-71af8a5f3b5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:37.743890 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8516a6a4-17fe-4d25-98f4-71af8a5f3b5a admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:37.744567 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8516a6a4-17fe-4d25-98f4-71af8a5f3b5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:54:37.746271 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8516a6a4-17fe-4d25-98f4-71af8a5f3b5a admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:54:37.757602 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1296/2571] 10.222.0.102 () {58 vars in 1127 bytes} [Mon Aug 1 15:54:37 2022] GET /identity/v3/roles => generated 1427 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 15:54:37.766490 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8516a6a4-17fe-4d25-98f4-71af8a5f3b5a admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:54:37.767951 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1276/2572] 10.222.0.102 () {60 vars in 1158 bytes} [Mon Aug 1 15:54:37 2022] POST /identity/v3/projects => generated 400 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 15:54:37.771839 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ed27c2-00bc-4a3c-8a0c-51557b1228ed admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:54:37.780204 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8516a6a4-17fe-4d25-98f4-71af8a5f3b5a admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:54:37.837308 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ed27c2-00bc-4a3c-8a0c-51557b1228ed admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:54:37.838917 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3571da67-045c-46e5-ac75-f52aa898aa1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:54:37.840015 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3571da67-045c-46e5-ac75-f52aa898aa1a admin admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:37.840015 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3571da67-045c-46e5-ac75-f52aa898aa1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:37.840242 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3571da67-045c-46e5-ac75-f52aa898aa1a admin admin] PATH_INFO: `/v3/projects/221868916d854dafac75240604e6c0f9/users/15c789cd90754da4aedcabc770245c46/roles/27f5093ac0674d799cdbd17c68482e32` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:37.842466 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:54:37.843226 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c902820-255c-4c91-bef6-0463668b2533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:54:37.843898 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c902820-255c-4c91-bef6-0463668b2533 admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:37.844171 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c902820-255c-4c91-bef6-0463668b2533 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:37.844467 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c902820-255c-4c91-bef6-0463668b2533 admin admin] PATH_INFO: `/v3/users` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:37.845191 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c902820-255c-4c91-bef6-0463668b2533 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:54:37.847114 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c902820-255c-4c91-bef6-0463668b2533 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:54:37.856151 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3571da67-045c-46e5-ac75-f52aa898aa1a admin admin] RBAC: Authorizing `identity:create_grant(project_id=221868916d854dafac75240604e6c0f9, user_id=15c789cd90754da4aedcabc770245c46, role_id=27f5093ac0674d799cdbd17c68482e32)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:54:37.858924 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3571da67-045c-46e5-ac75-f52aa898aa1a admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:54:37.952594 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1277/2573] 10.222.0.102 () {60 vars in 1149 bytes} [Mon Aug 1 15:54:37 2022] POST /identity/v3/users => generated 307 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 15:54:37.953314 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1297/2574] 10.222.0.102 () {60 vars in 1488 bytes} [Mon Aug 1 15:54:37 2022] PUT /identity/v3/projects/221868916d854dafac75240604e6c0f9/users/15c789cd90754da4aedcabc770245c46/roles/27f5093ac0674d799cdbd17c68482e32 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 15:54:37.953729 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c902820-255c-4c91-bef6-0463668b2533 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:54:37.959807 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1748a2f-ba0c-4079-a3e6-4e656ddc09bc None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:37.960090 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1748a2f-ba0c-4079-a3e6-4e656ddc09bc None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:37.960366 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1748a2f-ba0c-4079-a3e6-4e656ddc09bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:37.963943 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c902820-255c-4c91-bef6-0463668b2533 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:54:37.990324 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-e1748a2f-ba0c-4079-a3e6-4e656ddc09bc None None] MFA Rules not processed for user `15c789cd90754da4aedcabc770245c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:54:37.991547 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-e1748a2f-ba0c-4079-a3e6-4e656ddc09bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:54:37.991980 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:54:38.024791 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32ee296-6478-4cfb-9a36-c2c8aa5526cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:54:38.025443 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32ee296-6478-4cfb-9a36-c2c8aa5526cd admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:38.025786 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32ee296-6478-4cfb-9a36-c2c8aa5526cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:38.026064 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32ee296-6478-4cfb-9a36-c2c8aa5526cd admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:38.026758 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32ee296-6478-4cfb-9a36-c2c8aa5526cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:54:38.028499 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32ee296-6478-4cfb-9a36-c2c8aa5526cd admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:54:38.038194 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1278/2575] 10.222.0.102 () {58 vars in 1127 bytes} [Mon Aug 1 15:54:37 2022] GET /identity/v3/roles => generated 1427 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 15:54:38.042376 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32ee296-6478-4cfb-9a36-c2c8aa5526cd admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:54:38.052646 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32ee296-6478-4cfb-9a36-c2c8aa5526cd admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:54:38.059972 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9579d6-dc0d-4f17-84aa-eee65844943a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:54:38.060556 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1298/2576] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:54:37 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 15:54:38.061109 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9579d6-dc0d-4f17-84aa-eee65844943a admin admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:38.061109 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9579d6-dc0d-4f17-84aa-eee65844943a admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:38.069298 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9579d6-dc0d-4f17-84aa-eee65844943a admin admin] PATH_INFO: `/v3/projects/460a10069cd34060990a3c8811c37423/users/2c68057617f74687b6f175ec19a9d890/roles/de1374f966c04c27b579515b54334fd2` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:38.076994 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9579d6-dc0d-4f17-84aa-eee65844943a admin admin] RBAC: Authorizing `identity:create_grant(project_id=460a10069cd34060990a3c8811c37423, user_id=2c68057617f74687b6f175ec19a9d890, role_id=de1374f966c04c27b579515b54334fd2)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:54:38.077681 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1748a2f-ba0c-4079-a3e6-4e656ddc09bc None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:54:38.079131 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-e1748a2f-ba0c-4079-a3e6-4e656ddc09bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:54:38.079762 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9579d6-dc0d-4f17-84aa-eee65844943a admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:54:38.155780 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1748a2f-ba0c-4079-a3e6-4e656ddc09bc None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:54:38.160867 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1279/2577] 10.222.0.102 () {60 vars in 1488 bytes} [Mon Aug 1 15:54:38 2022] PUT /identity/v3/projects/460a10069cd34060990a3c8811c37423/users/2c68057617f74687b6f175ec19a9d890/roles/de1374f966c04c27b579515b54334fd2 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 15:54:38.164648 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9579d6-dc0d-4f17-84aa-eee65844943a admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:54:38.227916 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89156c9b-6286-4103-81f5-0d664fb61caa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77b43f1ee8cc4be3907a494abe90c1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:54:38.228522 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89156c9b-6286-4103-81f5-0d664fb61caa service nova] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:38.228800 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89156c9b-6286-4103-81f5-0d664fb61caa service nova] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:38.229101 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89156c9b-6286-4103-81f5-0d664fb61caa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:38.235577 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:54:38.238955 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9579d6-dc0d-4f17-84aa-eee65844943a admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:54:38.243837 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be65cc3-6af3-45e9-b6d9-094917b68964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:54:38.244503 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be65cc3-6af3-45e9-b6d9-094917b68964 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:38.244782 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be65cc3-6af3-45e9-b6d9-094917b68964 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:38.245087 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be65cc3-6af3-45e9-b6d9-094917b68964 admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:38.245843 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be65cc3-6af3-45e9-b6d9-094917b68964 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:54:38.248148 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be65cc3-6af3-45e9-b6d9-094917b68964 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:54:38.258555 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1280/2578] 10.222.0.102 () {58 vars in 1127 bytes} [Mon Aug 1 15:54:38 2022] GET /identity/v3/roles => generated 1427 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 15:54:38.263378 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be65cc3-6af3-45e9-b6d9-094917b68964 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:54:38.273206 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be65cc3-6af3-45e9-b6d9-094917b68964 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:54:38.282325 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c54b82-fc13-4337-966e-ef84eb0f6da2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:54:38.282993 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c54b82-fc13-4337-966e-ef84eb0f6da2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:38.283271 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c54b82-fc13-4337-966e-ef84eb0f6da2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:38.283546 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c54b82-fc13-4337-966e-ef84eb0f6da2 admin admin] PATH_INFO: `/v3/projects/460a10069cd34060990a3c8811c37423/users/2c68057617f74687b6f175ec19a9d890/roles/de1374f966c04c27b579515b54334fd2` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:38.285703 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c54b82-fc13-4337-966e-ef84eb0f6da2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=460a10069cd34060990a3c8811c37423, user_id=2c68057617f74687b6f175ec19a9d890, role_id=de1374f966c04c27b579515b54334fd2)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:54:38.288364 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c54b82-fc13-4337-966e-ef84eb0f6da2 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:54:38.290143 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89156c9b-6286-4103-81f5-0d664fb61caa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:54:38.291731 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89156c9b-6286-4103-81f5-0d664fb61caa service nova] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:54:38.299593 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1281/2579] 10.222.0.102 () {60 vars in 1488 bytes} [Mon Aug 1 15:54:38 2022] PUT /identity/v3/projects/460a10069cd34060990a3c8811c37423/users/2c68057617f74687b6f175ec19a9d890/roles/de1374f966c04c27b579515b54334fd2 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:54:38.301201 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1299/2580] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:54:38 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 15:54:38.369896 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8773f693-b5df-4141-8ed0-bef3da1a94ed None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:38.369896 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8773f693-b5df-4141-8ed0-bef3da1a94ed None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:38.369896 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8773f693-b5df-4141-8ed0-bef3da1a94ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:38.402921 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-8773f693-b5df-4141-8ed0-bef3da1a94ed None None] MFA Rules not processed for user `2c68057617f74687b6f175ec19a9d890`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:54:38.404407 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-8773f693-b5df-4141-8ed0-bef3da1a94ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:54:38.486092 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1282/2581] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:54:38 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:54:38.497063 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89156c9b-6286-4103-81f5-0d664fb61caa service nova] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:54:38.498445 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-89156c9b-6286-4103-81f5-0d664fb61caa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:54:38.530186 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8773f693-b5df-4141-8ed0-bef3da1a94ed None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:54:38.537430 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:54:38.565921 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89156c9b-6286-4103-81f5-0d664fb61caa service nova] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:54:38.598697 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8773f693-b5df-4141-8ed0-bef3da1a94ed None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:54:38.603672 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61c2b88-3cc3-440d-ae70-3fcd5b73cfea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:54:38.604418 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61c2b88-3cc3-440d-ae70-3fcd5b73cfea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:38.604706 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61c2b88-3cc3-440d-ae70-3fcd5b73cfea admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:38.605010 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61c2b88-3cc3-440d-ae70-3fcd5b73cfea admin admin] PATH_INFO: `/v3/users/15c789cd90754da4aedcabc770245c46` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:38.606203 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61c2b88-3cc3-440d-ae70-3fcd5b73cfea admin admin] RBAC: Authorizing `identity:delete_user(user_id=15c789cd90754da4aedcabc770245c46)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:54:38.608128 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61c2b88-3cc3-440d-ae70-3fcd5b73cfea admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:54:38.626056 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f178a14-fa28-47b3-9a64-f0af1bafb65b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff810b37183c4729859c1b05edff1703', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:54:38.626276 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f178a14-fa28-47b3-9a64-f0af1bafb65b service cinder] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:38.626456 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f178a14-fa28-47b3-9a64-f0af1bafb65b service cinder] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:38.626732 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f178a14-fa28-47b3-9a64-f0af1bafb65b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:38.636037 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f178a14-fa28-47b3-9a64-f0af1bafb65b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:54:38.638034 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f178a14-fa28-47b3-9a64-f0af1bafb65b service cinder] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:54:38.647656 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1300/2582] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:54:38 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:54:38.815607 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-f61c2b88-3cc3-440d-ae70-3fcd5b73cfea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15c789cd90754da4aedcabc770245c46'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:54:38.904915 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f178a14-fa28-47b3-9a64-f0af1bafb65b service cinder] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:54:38.906347 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-2f178a14-fa28-47b3-9a64-f0af1bafb65b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:54:38.912385 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-f61c2b88-3cc3-440d-ae70-3fcd5b73cfea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15c789cd90754da4aedcabc770245c46'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:54:38.917736 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f178a14-fa28-47b3-9a64-f0af1bafb65b service cinder] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:54:38.921381 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844cafd2-d736-44c9-86a0-5bbd322e2970 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff810b37183c4729859c1b05edff1703', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:54:38.922114 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844cafd2-d736-44c9-86a0-5bbd322e2970 service cinder] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:38.922412 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844cafd2-d736-44c9-86a0-5bbd322e2970 service cinder] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:38.922700 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844cafd2-d736-44c9-86a0-5bbd322e2970 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:38.925954 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-f61c2b88-3cc3-440d-ae70-3fcd5b73cfea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15c789cd90754da4aedcabc770245c46'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:54:38.926616 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-f61c2b88-3cc3-440d-ae70-3fcd5b73cfea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15c789cd90754da4aedcabc770245c46'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:54:38.927232 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-f61c2b88-3cc3-440d-ae70-3fcd5b73cfea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15c789cd90754da4aedcabc770245c46'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:54:38.940972 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1283/2583] 10.222.0.102 () {58 vars in 1229 bytes} [Mon Aug 1 15:54:38 2022] DELETE /identity/v3/users/15c789cd90754da4aedcabc770245c46 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:54:38.945416 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a035af9e-0837-4022-ae5c-27d410ddff5b None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:38.945703 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a035af9e-0837-4022-ae5c-27d410ddff5b None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:38.945984 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a035af9e-0837-4022-ae5c-27d410ddff5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:38.967463 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-a035af9e-0837-4022-ae5c-27d410ddff5b None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:54:38.969078 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-a035af9e-0837-4022-ae5c-27d410ddff5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:54:38.984349 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844cafd2-d736-44c9-86a0-5bbd322e2970 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:54:38.985827 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844cafd2-d736-44c9-86a0-5bbd322e2970 service cinder] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:54:38.994983 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1301/2584] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:54:38 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 15:54:39.029214 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1284/2585] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:54:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:54:39.038479 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844cafd2-d736-44c9-86a0-5bbd322e2970 service cinder] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:54:39.040708 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-844cafd2-d736-44c9-86a0-5bbd322e2970 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:54:39.047283 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:54:39.100819 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844cafd2-d736-44c9-86a0-5bbd322e2970 service cinder] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:54:39.150756 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1281197a-ce6a-4a0c-aabc-5a7e1115b9c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a856a413100443939fe9b10daa868518', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:54:39.151371 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1281197a-ce6a-4a0c-aabc-5a7e1115b9c5 service neutron] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:39.151649 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1281197a-ce6a-4a0c-aabc-5a7e1115b9c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:39.151923 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1281197a-ce6a-4a0c-aabc-5a7e1115b9c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:39.161407 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1281197a-ce6a-4a0c-aabc-5a7e1115b9c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:54:39.162873 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1281197a-ce6a-4a0c-aabc-5a7e1115b9c5 service neutron] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:54:39.173043 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1302/2586] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:54:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:54:39.616959 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a035af9e-0837-4022-ae5c-27d410ddff5b None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:54:39.618641 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-a035af9e-0837-4022-ae5c-27d410ddff5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:54:39.647053 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a035af9e-0837-4022-ae5c-27d410ddff5b None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:54:39.652005 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c9854c-a80f-4e9a-b5cd-52206a89d619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:54:39.653213 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c9854c-a80f-4e9a-b5cd-52206a89d619 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:39.653514 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c9854c-a80f-4e9a-b5cd-52206a89d619 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:39.653866 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c9854c-a80f-4e9a-b5cd-52206a89d619 admin admin] PATH_INFO: `/v3/projects/221868916d854dafac75240604e6c0f9` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:39.655031 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c9854c-a80f-4e9a-b5cd-52206a89d619 admin admin] RBAC: Authorizing `identity:delete_project(project_id=221868916d854dafac75240604e6c0f9)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:54:39.657036 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c9854c-a80f-4e9a-b5cd-52206a89d619 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:54:39.681743 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:54:39.780027 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-c9c9854c-a80f-4e9a-b5cd-52206a89d619 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '221868916d854dafac75240604e6c0f9', 'request_id': 'req-c9c9854c-a80f-4e9a-b5cd-52206a89d619'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:54:39.878340 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-c9c9854c-a80f-4e9a-b5cd-52206a89d619 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '221868916d854dafac75240604e6c0f9', 'request_id': 'req-c9c9854c-a80f-4e9a-b5cd-52206a89d619'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:54:39.885320 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-c9c9854c-a80f-4e9a-b5cd-52206a89d619 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '221868916d854dafac75240604e6c0f9', 'request_id': 'req-c9c9854c-a80f-4e9a-b5cd-52206a89d619'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:54:39.896099 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-c9c9854c-a80f-4e9a-b5cd-52206a89d619 admin admin] The token cache is being invalidate because project 221868916d854dafac75240604e6c0f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80353) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 15:54:39.896392 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-c9c9854c-a80f-4e9a-b5cd-52206a89d619 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:54:39.897075 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-c9c9854c-a80f-4e9a-b5cd-52206a89d619 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:54:39.898595 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1285/2587] 10.222.0.102 () {58 vars in 1238 bytes} [Mon Aug 1 15:54:39 2022] DELETE /identity/v3/projects/221868916d854dafac75240604e6c0f9 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:54:39.904012 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5d00e9-3fd1-469a-8896-180eecf93811 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:39.904298 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5d00e9-3fd1-469a-8896-180eecf93811 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:39.904576 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5d00e9-3fd1-469a-8896-180eecf93811 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:39.924558 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-fc5d00e9-3fd1-469a-8896-180eecf93811 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:54:39.925834 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-fc5d00e9-3fd1-469a-8896-180eecf93811 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:54:39.985925 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1303/2588] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:54:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:54:39.993888 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a52afa-357b-44c6-8dd9-387f41b24746 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:39.994365 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a52afa-357b-44c6-8dd9-387f41b24746 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:39.994494 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a52afa-357b-44c6-8dd9-387f41b24746 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:40.019258 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-a0a52afa-357b-44c6-8dd9-387f41b24746 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:54:40.020475 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-a0a52afa-357b-44c6-8dd9-387f41b24746 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:54:40.028984 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1286/2589] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:54:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:54:40.033522 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5d00e9-3fd1-469a-8896-180eecf93811 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:54:40.043777 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5d00e9-3fd1-469a-8896-180eecf93811 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:54:40.052543 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2d2cdd-ede7-4988-a142-0be4b47ab104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:54:40.053223 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2d2cdd-ede7-4988-a142-0be4b47ab104 admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:40.053510 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2d2cdd-ede7-4988-a142-0be4b47ab104 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:40.053781 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2d2cdd-ede7-4988-a142-0be4b47ab104 admin admin] PATH_INFO: `/v3/domains` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:40.054482 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2d2cdd-ede7-4988-a142-0be4b47ab104 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:54:40.054786 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2d2cdd-ede7-4988-a142-0be4b47ab104 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:54:40.056406 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2d2cdd-ede7-4988-a142-0be4b47ab104 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:54:40.076106 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1304/2590] 10.222.0.102 () {58 vars in 1158 bytes} [Mon Aug 1 15:54:40 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:54:40.080405 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a52afa-357b-44c6-8dd9-387f41b24746 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:54:40.090380 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a52afa-357b-44c6-8dd9-387f41b24746 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:54:40.095166 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669b8b17-8c2f-4f5a-8fd1-59b2fdf26673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:54:40.095792 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669b8b17-8c2f-4f5a-8fd1-59b2fdf26673 admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:40.096065 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669b8b17-8c2f-4f5a-8fd1-59b2fdf26673 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:40.096330 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669b8b17-8c2f-4f5a-8fd1-59b2fdf26673 admin admin] PATH_INFO: `/v3/projects` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:40.097015 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669b8b17-8c2f-4f5a-8fd1-59b2fdf26673 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:54:40.098890 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669b8b17-8c2f-4f5a-8fd1-59b2fdf26673 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:54:40.181575 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1287/2591] 10.222.0.102 () {60 vars in 1158 bytes} [Mon Aug 1 15:54:40 2022] POST /identity/v3/projects => generated 394 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:54:40.186135 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2d2cdd-ede7-4988-a142-0be4b47ab104 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:54:40.196356 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2d2cdd-ede7-4988-a142-0be4b47ab104 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:54:40.242985 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:54:40.252490 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9559b70a-e7b6-482a-a565-77620294fdda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:54:40.253121 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9559b70a-e7b6-482a-a565-77620294fdda admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:40.253402 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9559b70a-e7b6-482a-a565-77620294fdda admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:40.253676 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9559b70a-e7b6-482a-a565-77620294fdda admin admin] PATH_INFO: `/v3/users` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:40.254344 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9559b70a-e7b6-482a-a565-77620294fdda admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:54:40.256279 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9559b70a-e7b6-482a-a565-77620294fdda admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:54:40.344697 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1305/2592] 10.222.0.102 () {60 vars in 1149 bytes} [Mon Aug 1 15:54:40 2022] POST /identity/v3/users => generated 298 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:54:40.345108 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669b8b17-8c2f-4f5a-8fd1-59b2fdf26673 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:54:40.355938 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669b8b17-8c2f-4f5a-8fd1-59b2fdf26673 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:54:40.362708 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee60f4e-0d41-4cab-82a4-80716e96c4fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:54:40.363400 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee60f4e-0d41-4cab-82a4-80716e96c4fe admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:40.367790 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee60f4e-0d41-4cab-82a4-80716e96c4fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:40.367790 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee60f4e-0d41-4cab-82a4-80716e96c4fe admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:40.367790 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee60f4e-0d41-4cab-82a4-80716e96c4fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:54:40.367790 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee60f4e-0d41-4cab-82a4-80716e96c4fe admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:54:40.377875 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1288/2593] 10.222.0.102 () {58 vars in 1127 bytes} [Mon Aug 1 15:54:40 2022] GET /identity/v3/roles => generated 1427 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:54:40.382149 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9559b70a-e7b6-482a-a565-77620294fdda admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:54:40.393239 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9559b70a-e7b6-482a-a565-77620294fdda admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:54:40.398129 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97f7a1e-4d87-4534-bb91-c257e4d22eb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:54:40.398740 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97f7a1e-4d87-4534-bb91-c257e4d22eb6 admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:40.399021 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97f7a1e-4d87-4534-bb91-c257e4d22eb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:40.399293 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97f7a1e-4d87-4534-bb91-c257e4d22eb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:40.399984 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97f7a1e-4d87-4534-bb91-c257e4d22eb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:54:40.401634 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97f7a1e-4d87-4534-bb91-c257e4d22eb6 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:54:40.413061 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1306/2594] 10.222.0.102 () {58 vars in 1127 bytes} [Mon Aug 1 15:54:40 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:54:40.417419 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee60f4e-0d41-4cab-82a4-80716e96c4fe admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:54:40.428673 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee60f4e-0d41-4cab-82a4-80716e96c4fe admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:54:40.434099 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fb603f-4841-4d14-96a6-ae4a39814c3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:54:40.435239 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fb603f-4841-4d14-96a6-ae4a39814c3d admin admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:40.435685 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fb603f-4841-4d14-96a6-ae4a39814c3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:40.436175 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fb603f-4841-4d14-96a6-ae4a39814c3d admin admin] PATH_INFO: `/v3/projects/8670e73a64af4a569135a8d602abcc82/users/5ab86c5e87f44cc5a06db1bf3bef70d5/roles/27f5093ac0674d799cdbd17c68482e32` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:40.454974 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fb603f-4841-4d14-96a6-ae4a39814c3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=8670e73a64af4a569135a8d602abcc82, user_id=5ab86c5e87f44cc5a06db1bf3bef70d5, role_id=27f5093ac0674d799cdbd17c68482e32)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:54:40.458022 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fb603f-4841-4d14-96a6-ae4a39814c3d admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:54:40.559392 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1289/2595] 10.222.0.102 () {60 vars in 1488 bytes} [Mon Aug 1 15:54:40 2022] PUT /identity/v3/projects/8670e73a64af4a569135a8d602abcc82/users/5ab86c5e87f44cc5a06db1bf3bef70d5/roles/27f5093ac0674d799cdbd17c68482e32 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:54:40.571850 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0df86ca-14ed-4fc3-b503-4168cf94d1e3 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:40.572158 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0df86ca-14ed-4fc3-b503-4168cf94d1e3 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:40.572437 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0df86ca-14ed-4fc3-b503-4168cf94d1e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:40.602451 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-e0df86ca-14ed-4fc3-b503-4168cf94d1e3 None None] MFA Rules not processed for user `5ab86c5e87f44cc5a06db1bf3bef70d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:54:40.603492 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-e0df86ca-14ed-4fc3-b503-4168cf94d1e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:54:40.670311 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1307/2596] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:54:40 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:54:40.674548 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fb603f-4841-4d14-96a6-ae4a39814c3d admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:54:40.748420 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fb603f-4841-4d14-96a6-ae4a39814c3d admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:54:40.753817 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb2f13d-33f8-4932-a422-23d624cb1e3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:54:40.754531 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb2f13d-33f8-4932-a422-23d624cb1e3d admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:40.754816 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb2f13d-33f8-4932-a422-23d624cb1e3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:40.755090 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb2f13d-33f8-4932-a422-23d624cb1e3d admin admin] PATH_INFO: `/v3/projects` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:40.755767 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb2f13d-33f8-4932-a422-23d624cb1e3d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:54:40.757757 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb2f13d-33f8-4932-a422-23d624cb1e3d admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:54:40.862818 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1290/2597] 10.222.0.102 () {60 vars in 1158 bytes} [Mon Aug 1 15:54:40 2022] POST /identity/v3/projects => generated 394 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 15:54:40.863917 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0df86ca-14ed-4fc3-b503-4168cf94d1e3 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:54:40.875323 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0df86ca-14ed-4fc3-b503-4168cf94d1e3 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:54:40.935490 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa7ed3e-1687-4764-9326-f297988fe526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:54:41.182266 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa7ed3e-1687-4764-9326-f297988fe526 admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:41.182266 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa7ed3e-1687-4764-9326-f297988fe526 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:41.182266 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa7ed3e-1687-4764-9326-f297988fe526 admin admin] PATH_INFO: `/v3/users` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:41.182266 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa7ed3e-1687-4764-9326-f297988fe526 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:54:41.182266 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa7ed3e-1687-4764-9326-f297988fe526 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:54:41.289007 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1308/2598] 10.222.0.102 () {60 vars in 1149 bytes} [Mon Aug 1 15:54:40 2022] POST /identity/v3/users => generated 304 bytes in 422 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:54:41.290167 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb2f13d-33f8-4932-a422-23d624cb1e3d admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:54:41.302027 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb2f13d-33f8-4932-a422-23d624cb1e3d admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:54:41.306749 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44dfd17-9a26-49db-ab4b-5f94e0b75aba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:54:41.307542 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44dfd17-9a26-49db-ab4b-5f94e0b75aba admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:41.307699 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44dfd17-9a26-49db-ab4b-5f94e0b75aba admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:41.308014 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44dfd17-9a26-49db-ab4b-5f94e0b75aba admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:41.308767 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44dfd17-9a26-49db-ab4b-5f94e0b75aba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:54:41.310701 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44dfd17-9a26-49db-ab4b-5f94e0b75aba admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:54:41.321950 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1291/2599] 10.222.0.102 () {58 vars in 1127 bytes} [Mon Aug 1 15:54:41 2022] GET /identity/v3/roles => generated 1427 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:54:41.326388 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa7ed3e-1687-4764-9326-f297988fe526 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:54:41.336442 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa7ed3e-1687-4764-9326-f297988fe526 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:54:41.341590 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772b06bf-8c2d-4abb-b0f5-874cc3e7cf19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:54:41.342287 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772b06bf-8c2d-4abb-b0f5-874cc3e7cf19 admin admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:41.342635 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772b06bf-8c2d-4abb-b0f5-874cc3e7cf19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:41.342914 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772b06bf-8c2d-4abb-b0f5-874cc3e7cf19 admin admin] PATH_INFO: `/v3/projects/2c637474fe8f46509ef059062013a259/users/a7dc9405091c4997b1139771c548246d/roles/de1374f966c04c27b579515b54334fd2` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:41.359752 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772b06bf-8c2d-4abb-b0f5-874cc3e7cf19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c637474fe8f46509ef059062013a259, user_id=a7dc9405091c4997b1139771c548246d, role_id=de1374f966c04c27b579515b54334fd2)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:54:41.362549 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772b06bf-8c2d-4abb-b0f5-874cc3e7cf19 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:54:41.368504 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f42c46-ba91-479b-98f6-a6bc42023564 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:41.368840 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f42c46-ba91-479b-98f6-a6bc42023564 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:41.369151 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f42c46-ba91-479b-98f6-a6bc42023564 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:41.389382 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-64f42c46-ba91-479b-98f6-a6bc42023564 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:54:41.390604 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-64f42c46-ba91-479b-98f6-a6bc42023564 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:54:41.398875 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1292/2600] 10.222.0.65 () {58 vars in 1020 bytes} [Mon Aug 1 15:54:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:54:41.427611 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f42c46-ba91-479b-98f6-a6bc42023564 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:54:41.428955 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-64f42c46-ba91-479b-98f6-a6bc42023564 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:54:41.451558 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:54:41.451900 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1309/2601] 10.222.0.102 () {60 vars in 1488 bytes} [Mon Aug 1 15:54:41 2022] PUT /identity/v3/projects/2c637474fe8f46509ef059062013a259/users/a7dc9405091c4997b1139771c548246d/roles/de1374f966c04c27b579515b54334fd2 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:54:41.451900 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772b06bf-8c2d-4abb-b0f5-874cc3e7cf19 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:54:41.482069 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:54:41.516538 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f42c46-ba91-479b-98f6-a6bc42023564 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:54:41.527939 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772b06bf-8c2d-4abb-b0f5-874cc3e7cf19 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:54:41.534005 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49a2c4e-33ac-401b-a34c-0c08ebcb0e93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:54:41.534802 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49a2c4e-33ac-401b-a34c-0c08ebcb0e93 admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:41.535655 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49a2c4e-33ac-401b-a34c-0c08ebcb0e93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:41.535655 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49a2c4e-33ac-401b-a34c-0c08ebcb0e93 admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:41.536463 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49a2c4e-33ac-401b-a34c-0c08ebcb0e93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:54:41.538158 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49a2c4e-33ac-401b-a34c-0c08ebcb0e93 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:54:41.556592 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1310/2602] 10.222.0.102 () {58 vars in 1127 bytes} [Mon Aug 1 15:54:41 2022] GET /identity/v3/roles => generated 1427 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 15:54:41.557612 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49a2c4e-33ac-401b-a34c-0c08ebcb0e93 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:54:41.604787 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49a2c4e-33ac-401b-a34c-0c08ebcb0e93 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:54:41.604787 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8724353f-72b4-4579-9650-769ffdba0a8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:54:41.604787 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8724353f-72b4-4579-9650-769ffdba0a8e admin admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:41.604787 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8724353f-72b4-4579-9650-769ffdba0a8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:41.605384 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8724353f-72b4-4579-9650-769ffdba0a8e admin admin] PATH_INFO: `/v3/projects/2c637474fe8f46509ef059062013a259/users/a7dc9405091c4997b1139771c548246d/roles/de1374f966c04c27b579515b54334fd2` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:41.605384 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8724353f-72b4-4579-9650-769ffdba0a8e admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c637474fe8f46509ef059062013a259, user_id=a7dc9405091c4997b1139771c548246d, role_id=de1374f966c04c27b579515b54334fd2)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:54:41.605384 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8724353f-72b4-4579-9650-769ffdba0a8e admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:54:41.605384 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1311/2603] 10.222.0.102 () {60 vars in 1488 bytes} [Mon Aug 1 15:54:41 2022] PUT /identity/v3/projects/2c637474fe8f46509ef059062013a259/users/a7dc9405091c4997b1139771c548246d/roles/de1374f966c04c27b579515b54334fd2 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 15:54:41.605937 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb4b38a-4410-4393-8d5c-c7edb18639aa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77b43f1ee8cc4be3907a494abe90c1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:54:41.605937 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb4b38a-4410-4393-8d5c-c7edb18639aa service nova] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:41.605937 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb4b38a-4410-4393-8d5c-c7edb18639aa service nova] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:41.605937 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb4b38a-4410-4393-8d5c-c7edb18639aa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:41.606320 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb4b38a-4410-4393-8d5c-c7edb18639aa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:54:41.606416 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c66fe6c-3ca1-42a0-a59e-26fa479ed65c None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:41.606416 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c66fe6c-3ca1-42a0-a59e-26fa479ed65c None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:41.606416 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c66fe6c-3ca1-42a0-a59e-26fa479ed65c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:41.606711 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb4b38a-4410-4393-8d5c-c7edb18639aa service nova] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:54:41.614409 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1293/2604] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:54:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 15:54:41.635378 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-7c66fe6c-3ca1-42a0-a59e-26fa479ed65c None None] MFA Rules not processed for user `a7dc9405091c4997b1139771c548246d`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:54:41.637220 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-7c66fe6c-3ca1-42a0-a59e-26fa479ed65c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:54:41.710583 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1312/2605] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:54:41 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 15:54:41.722553 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb4b38a-4410-4393-8d5c-c7edb18639aa service nova] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:54:41.723976 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-efb4b38a-4410-4393-8d5c-c7edb18639aa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:54:41.785541 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb4b38a-4410-4393-8d5c-c7edb18639aa service nova] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:54:41.839178 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdb090f-316c-41da-9194-05740ea0b9cb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff810b37183c4729859c1b05edff1703', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:54:41.839715 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdb090f-316c-41da-9194-05740ea0b9cb service cinder] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:41.839993 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdb090f-316c-41da-9194-05740ea0b9cb service cinder] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:41.840264 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdb090f-316c-41da-9194-05740ea0b9cb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:41.847720 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:54:41.850100 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdb090f-316c-41da-9194-05740ea0b9cb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:54:41.853650 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdb090f-316c-41da-9194-05740ea0b9cb service cinder] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:54:41.861658 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1294/2606] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:54:41 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:54:41.913399 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c66fe6c-3ca1-42a0-a59e-26fa479ed65c None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:54:41.914785 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-7c66fe6c-3ca1-42a0-a59e-26fa479ed65c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:54:41.926799 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c66fe6c-3ca1-42a0-a59e-26fa479ed65c None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:54:41.930408 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8be1c3-1d1d-4473-a248-2f9d4dd3603a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff810b37183c4729859c1b05edff1703', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:54:41.931011 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8be1c3-1d1d-4473-a248-2f9d4dd3603a service cinder] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:41.931283 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8be1c3-1d1d-4473-a248-2f9d4dd3603a service cinder] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:41.931559 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8be1c3-1d1d-4473-a248-2f9d4dd3603a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:41.989722 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8be1c3-1d1d-4473-a248-2f9d4dd3603a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:54:41.991097 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8be1c3-1d1d-4473-a248-2f9d4dd3603a service cinder] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:54:42.000623 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1313/2607] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:54:41 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:54:44.402137 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdb090f-316c-41da-9194-05740ea0b9cb service cinder] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:54:44.404200 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-cfdb090f-316c-41da-9194-05740ea0b9cb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:54:44.469666 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdb090f-316c-41da-9194-05740ea0b9cb service cinder] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:54:44.474443 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a31af72-c47d-4ded-b818-d82b95862deb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:54:44.475141 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a31af72-c47d-4ded-b818-d82b95862deb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:44.475425 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a31af72-c47d-4ded-b818-d82b95862deb admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:44.475700 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a31af72-c47d-4ded-b818-d82b95862deb admin admin] PATH_INFO: `/v3/users/783813f89fa2431ea3f8324e62a29851` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:44.476914 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a31af72-c47d-4ded-b818-d82b95862deb admin admin] RBAC: Authorizing `identity:delete_user(user_id=783813f89fa2431ea3f8324e62a29851)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:54:44.478871 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a31af72-c47d-4ded-b818-d82b95862deb admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:54:44.666782 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-1a31af72-c47d-4ded-b818-d82b95862deb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '783813f89fa2431ea3f8324e62a29851'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:54:44.748793 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-1a31af72-c47d-4ded-b818-d82b95862deb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '783813f89fa2431ea3f8324e62a29851'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:54:44.761649 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-1a31af72-c47d-4ded-b818-d82b95862deb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '783813f89fa2431ea3f8324e62a29851'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:54:44.762294 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-1a31af72-c47d-4ded-b818-d82b95862deb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '783813f89fa2431ea3f8324e62a29851'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:54:44.763426 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-1a31af72-c47d-4ded-b818-d82b95862deb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '783813f89fa2431ea3f8324e62a29851'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:54:44.775713 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1295/2608] 10.222.0.102 () {58 vars in 1229 bytes} [Mon Aug 1 15:54:44 2022] DELETE /identity/v3/users/783813f89fa2431ea3f8324e62a29851 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:54:44.780965 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63d9830-4e50-4b7b-b8d5-7d604379a7f8 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:44.781431 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63d9830-4e50-4b7b-b8d5-7d604379a7f8 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:44.786490 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63d9830-4e50-4b7b-b8d5-7d604379a7f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:44.800296 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-a63d9830-4e50-4b7b-b8d5-7d604379a7f8 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:54:44.801514 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-a63d9830-4e50-4b7b-b8d5-7d604379a7f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:54:44.831264 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:54:44.867831 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1314/2609] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:54:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:54:44.881230 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a31af72-c47d-4ded-b818-d82b95862deb admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:54:44.882677 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-1a31af72-c47d-4ded-b818-d82b95862deb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:54:44.946618 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a31af72-c47d-4ded-b818-d82b95862deb admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:54:44.950951 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9be6476-25a6-47fb-8966-7ccf0d116ae6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a856a413100443939fe9b10daa868518', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:54:44.951569 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9be6476-25a6-47fb-8966-7ccf0d116ae6 service neutron] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:44.951847 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9be6476-25a6-47fb-8966-7ccf0d116ae6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:44.952125 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9be6476-25a6-47fb-8966-7ccf0d116ae6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:44.961825 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9be6476-25a6-47fb-8966-7ccf0d116ae6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:54:44.963321 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9be6476-25a6-47fb-8966-7ccf0d116ae6 service neutron] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:54:44.974354 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1296/2610] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:54:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:54:45.453198 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63d9830-4e50-4b7b-b8d5-7d604379a7f8 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:54:45.454684 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-a63d9830-4e50-4b7b-b8d5-7d604379a7f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:54:45.469586 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63d9830-4e50-4b7b-b8d5-7d604379a7f8 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:54:45.475492 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81987242-8f90-4d85-a988-e96f8cdbb3c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:54:45.476148 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81987242-8f90-4d85-a988-e96f8cdbb3c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:45.476416 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81987242-8f90-4d85-a988-e96f8cdbb3c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:45.476682 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81987242-8f90-4d85-a988-e96f8cdbb3c9 admin admin] PATH_INFO: `/v3/projects/b8ba971769244c4ab29f942f3a9739f4` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:45.477885 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81987242-8f90-4d85-a988-e96f8cdbb3c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8ba971769244c4ab29f942f3a9739f4)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:54:45.479972 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81987242-8f90-4d85-a988-e96f8cdbb3c9 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:54:45.607381 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-81987242-8f90-4d85-a988-e96f8cdbb3c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8ba971769244c4ab29f942f3a9739f4', 'request_id': 'req-81987242-8f90-4d85-a988-e96f8cdbb3c9'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:54:45.613610 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-81987242-8f90-4d85-a988-e96f8cdbb3c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8ba971769244c4ab29f942f3a9739f4', 'request_id': 'req-81987242-8f90-4d85-a988-e96f8cdbb3c9'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:54:45.696939 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-81987242-8f90-4d85-a988-e96f8cdbb3c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8ba971769244c4ab29f942f3a9739f4', 'request_id': 'req-81987242-8f90-4d85-a988-e96f8cdbb3c9'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:54:45.707852 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-81987242-8f90-4d85-a988-e96f8cdbb3c9 admin admin] The token cache is being invalidate because project b8ba971769244c4ab29f942f3a9739f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80352) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 15:54:45.708132 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-81987242-8f90-4d85-a988-e96f8cdbb3c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:54:45.711921 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-81987242-8f90-4d85-a988-e96f8cdbb3c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:54:45.711921 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1315/2611] 10.222.0.102 () {58 vars in 1238 bytes} [Mon Aug 1 15:54:45 2022] DELETE /identity/v3/projects/b8ba971769244c4ab29f942f3a9739f4 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:54:45.714522 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9be6476-25a6-47fb-8966-7ccf0d116ae6 service neutron] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:54:45.724628 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9be6476-25a6-47fb-8966-7ccf0d116ae6 service neutron] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:54:45.737314 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:54:45.780795 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c8eb70-8276-4d87-8dc4-f6b03dde589a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:54:45.781462 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c8eb70-8276-4d87-8dc4-f6b03dde589a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:45.781773 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c8eb70-8276-4d87-8dc4-f6b03dde589a admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:45.782043 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c8eb70-8276-4d87-8dc4-f6b03dde589a admin admin] PATH_INFO: `/v3/users/2c68057617f74687b6f175ec19a9d890` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:45.783204 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c8eb70-8276-4d87-8dc4-f6b03dde589a admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c68057617f74687b6f175ec19a9d890)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:54:45.785149 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c8eb70-8276-4d87-8dc4-f6b03dde589a admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:54:45.987645 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-d4c8eb70-8276-4d87-8dc4-f6b03dde589a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c68057617f74687b6f175ec19a9d890'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:54:46.072065 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-d4c8eb70-8276-4d87-8dc4-f6b03dde589a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c68057617f74687b6f175ec19a9d890'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:54:46.085868 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-d4c8eb70-8276-4d87-8dc4-f6b03dde589a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c68057617f74687b6f175ec19a9d890'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:54:46.086507 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-d4c8eb70-8276-4d87-8dc4-f6b03dde589a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c68057617f74687b6f175ec19a9d890'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:54:46.087121 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-d4c8eb70-8276-4d87-8dc4-f6b03dde589a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c68057617f74687b6f175ec19a9d890'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:54:46.100516 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1297/2612] 10.222.0.102 () {58 vars in 1229 bytes} [Mon Aug 1 15:54:45 2022] DELETE /identity/v3/users/2c68057617f74687b6f175ec19a9d890 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:54:46.630659 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81987242-8f90-4d85-a988-e96f8cdbb3c9 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:54:46.632117 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-81987242-8f90-4d85-a988-e96f8cdbb3c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:54:46.646555 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81987242-8f90-4d85-a988-e96f8cdbb3c9 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:54:46.708646 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31c2049-a256-459f-955f-636901342f30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:54:46.709319 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31c2049-a256-459f-955f-636901342f30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:46.709598 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31c2049-a256-459f-955f-636901342f30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:46.709868 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31c2049-a256-459f-955f-636901342f30 admin admin] PATH_INFO: `/v3/projects/460a10069cd34060990a3c8811c37423` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:46.711085 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31c2049-a256-459f-955f-636901342f30 admin admin] RBAC: Authorizing `identity:delete_project(project_id=460a10069cd34060990a3c8811c37423)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:54:46.713157 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31c2049-a256-459f-955f-636901342f30 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:54:46.821042 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb10716-4a82-4a1d-8ebc-bfa01db2bc3c None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:46.821650 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb10716-4a82-4a1d-8ebc-bfa01db2bc3c None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:46.821650 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb10716-4a82-4a1d-8ebc-bfa01db2bc3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:46.842041 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-7cb10716-4a82-4a1d-8ebc-bfa01db2bc3c None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:54:46.843261 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-7cb10716-4a82-4a1d-8ebc-bfa01db2bc3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:54:46.856294 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1298/2613] 10.222.0.65 () {58 vars in 1020 bytes} [Mon Aug 1 15:54:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 15:54:46.864001 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-a31c2049-a256-459f-955f-636901342f30 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '460a10069cd34060990a3c8811c37423', 'request_id': 'req-a31c2049-a256-459f-955f-636901342f30'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:54:46.870699 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-a31c2049-a256-459f-955f-636901342f30 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '460a10069cd34060990a3c8811c37423', 'request_id': 'req-a31c2049-a256-459f-955f-636901342f30'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:54:46.873452 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:54:46.881850 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb10716-4a82-4a1d-8ebc-bfa01db2bc3c None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:54:46.883233 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-7cb10716-4a82-4a1d-8ebc-bfa01db2bc3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:54:46.956421 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb10716-4a82-4a1d-8ebc-bfa01db2bc3c None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:54:46.982179 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:54:47.003645 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-a31c2049-a256-459f-955f-636901342f30 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '460a10069cd34060990a3c8811c37423', 'request_id': 'req-a31c2049-a256-459f-955f-636901342f30'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:54:47.016302 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-a31c2049-a256-459f-955f-636901342f30 admin admin] The token cache is being invalidate because project 460a10069cd34060990a3c8811c37423 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80352) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 15:54:47.016593 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-a31c2049-a256-459f-955f-636901342f30 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:54:47.017273 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-a31c2049-a256-459f-955f-636901342f30 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:54:47.018842 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1316/2614] 10.222.0.102 () {58 vars in 1238 bytes} [Mon Aug 1 15:54:46 2022] DELETE /identity/v3/projects/460a10069cd34060990a3c8811c37423 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:54:47.020427 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7dffc0-a8ff-4a4b-9b5d-ffe2aa40510d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77b43f1ee8cc4be3907a494abe90c1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:54:47.021616 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7dffc0-a8ff-4a4b-9b5d-ffe2aa40510d service nova] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:47.021939 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7dffc0-a8ff-4a4b-9b5d-ffe2aa40510d service nova] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:47.022177 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7dffc0-a8ff-4a4b-9b5d-ffe2aa40510d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:47.023974 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-6c7dffc0-a8ff-4a4b-9b5d-ffe2aa40510d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:54:47.032207 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55433a9-98c6-4661-8cea-e364c8d75081 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:47.032890 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55433a9-98c6-4661-8cea-e364c8d75081 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:47.033512 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55433a9-98c6-4661-8cea-e364c8d75081 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:47.053338 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-d55433a9-98c6-4661-8cea-e364c8d75081 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:54:47.054553 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-d55433a9-98c6-4661-8cea-e364c8d75081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:54:47.088503 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7dffc0-a8ff-4a4b-9b5d-ffe2aa40510d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:54:47.090134 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7dffc0-a8ff-4a4b-9b5d-ffe2aa40510d service nova] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:54:47.100336 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1299/2615] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:54:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 15:54:47.117310 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1317/2616] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:54:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:54:47.125931 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f6eee7-0876-4944-8c28-9e689a26fa57 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:47.126205 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f6eee7-0876-4944-8c28-9e689a26fa57 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:47.126485 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f6eee7-0876-4944-8c28-9e689a26fa57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:47.147790 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-d4f6eee7-0876-4944-8c28-9e689a26fa57 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:54:47.152251 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-d4f6eee7-0876-4944-8c28-9e689a26fa57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:54:47.159064 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1300/2617] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:54:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:54:47.163341 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55433a9-98c6-4661-8cea-e364c8d75081 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:54:47.174001 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55433a9-98c6-4661-8cea-e364c8d75081 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:54:47.178646 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6205821b-6c8e-4e50-a7b8-3fca1c1a09e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:54:47.179258 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6205821b-6c8e-4e50-a7b8-3fca1c1a09e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:47.179536 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6205821b-6c8e-4e50-a7b8-3fca1c1a09e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:47.179808 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6205821b-6c8e-4e50-a7b8-3fca1c1a09e0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:47.180640 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6205821b-6c8e-4e50-a7b8-3fca1c1a09e0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:54:47.180964 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6205821b-6c8e-4e50-a7b8-3fca1c1a09e0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:54:47.182661 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6205821b-6c8e-4e50-a7b8-3fca1c1a09e0 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:54:47.195747 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1318/2618] 10.222.0.102 () {58 vars in 1158 bytes} [Mon Aug 1 15:54:47 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:54:47.208414 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f6eee7-0876-4944-8c28-9e689a26fa57 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:54:47.209412 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6205821b-6c8e-4e50-a7b8-3fca1c1a09e0 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:54:47.210382 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f6eee7-0876-4944-8c28-9e689a26fa57 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:54:47.211398 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-6205821b-6c8e-4e50-a7b8-3fca1c1a09e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:54:47.215005 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6d44a7-c3e5-4e8b-8205-3061189c7386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:54:47.216294 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6d44a7-c3e5-4e8b-8205-3061189c7386 admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:47.216582 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6d44a7-c3e5-4e8b-8205-3061189c7386 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:47.216886 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6d44a7-c3e5-4e8b-8205-3061189c7386 admin admin] PATH_INFO: `/v3/projects` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:47.217542 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6d44a7-c3e5-4e8b-8205-3061189c7386 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:54:47.219467 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6d44a7-c3e5-4e8b-8205-3061189c7386 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:54:47.225581 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6205821b-6c8e-4e50-a7b8-3fca1c1a09e0 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:54:47.230584 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88cc084-bba2-492d-a77f-e66552b309c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:54:47.232393 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88cc084-bba2-492d-a77f-e66552b309c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:47.232393 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88cc084-bba2-492d-a77f-e66552b309c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:47.232608 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88cc084-bba2-492d-a77f-e66552b309c5 admin admin] PATH_INFO: `/v3/users/5ab86c5e87f44cc5a06db1bf3bef70d5` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:47.233820 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88cc084-bba2-492d-a77f-e66552b309c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ab86c5e87f44cc5a06db1bf3bef70d5)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:54:47.235719 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88cc084-bba2-492d-a77f-e66552b309c5 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:54:47.345856 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1301/2619] 10.222.0.102 () {60 vars in 1158 bytes} [Mon Aug 1 15:54:47 2022] POST /identity/v3/projects => generated 380 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:54:47.349372 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6d44a7-c3e5-4e8b-8205-3061189c7386 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:54:47.413084 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6d44a7-c3e5-4e8b-8205-3061189c7386 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:54:47.417738 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8c56ba-e303-46ca-9fa4-cae659c6e48a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:54:47.418350 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8c56ba-e303-46ca-9fa4-cae659c6e48a admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:47.418644 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8c56ba-e303-46ca-9fa4-cae659c6e48a admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:47.419009 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8c56ba-e303-46ca-9fa4-cae659c6e48a admin admin] PATH_INFO: `/v3/users` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:47.419669 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8c56ba-e303-46ca-9fa4-cae659c6e48a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:54:47.421691 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8c56ba-e303-46ca-9fa4-cae659c6e48a admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:54:47.457426 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-d88cc084-bba2-492d-a77f-e66552b309c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ab86c5e87f44cc5a06db1bf3bef70d5'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:54:47.469818 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-d88cc084-bba2-492d-a77f-e66552b309c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ab86c5e87f44cc5a06db1bf3bef70d5'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:54:47.476499 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-d88cc084-bba2-492d-a77f-e66552b309c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ab86c5e87f44cc5a06db1bf3bef70d5'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:54:47.477178 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-d88cc084-bba2-492d-a77f-e66552b309c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ab86c5e87f44cc5a06db1bf3bef70d5'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:54:47.477794 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-d88cc084-bba2-492d-a77f-e66552b309c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ab86c5e87f44cc5a06db1bf3bef70d5'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:54:47.512321 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1302/2620] 10.222.0.102 () {60 vars in 1149 bytes} [Mon Aug 1 15:54:47 2022] POST /identity/v3/users => generated 291 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 15:54:47.516809 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8c56ba-e303-46ca-9fa4-cae659c6e48a admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:54:47.518460 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-af8c56ba-e303-46ca-9fa4-cae659c6e48a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:54:47.530880 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8c56ba-e303-46ca-9fa4-cae659c6e48a admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:54:47.535569 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6519d43d-17b7-4b87-b3eb-eb7a6d757474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:54:47.535864 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1319/2621] 10.222.0.102 () {58 vars in 1229 bytes} [Mon Aug 1 15:54:47 2022] DELETE /identity/v3/users/5ab86c5e87f44cc5a06db1bf3bef70d5 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 15:54:47.538955 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6519d43d-17b7-4b87-b3eb-eb7a6d757474 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:47.539251 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6519d43d-17b7-4b87-b3eb-eb7a6d757474 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:47.539533 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6519d43d-17b7-4b87-b3eb-eb7a6d757474 admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:47.540050 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c488bbb3-e0bd-4c27-a0f1-15cda795d8ee None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:47.540276 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6519d43d-17b7-4b87-b3eb-eb7a6d757474 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:54:47.540430 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c488bbb3-e0bd-4c27-a0f1-15cda795d8ee None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:47.540634 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c488bbb3-e0bd-4c27-a0f1-15cda795d8ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:47.541882 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6519d43d-17b7-4b87-b3eb-eb7a6d757474 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:54:47.552361 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1303/2622] 10.222.0.102 () {58 vars in 1127 bytes} [Mon Aug 1 15:54:47 2022] GET /identity/v3/roles => generated 1427 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 15:54:47.556295 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6519d43d-17b7-4b87-b3eb-eb7a6d757474 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:54:47.561902 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-c488bbb3-e0bd-4c27-a0f1-15cda795d8ee None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:54:47.563889 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-c488bbb3-e0bd-4c27-a0f1-15cda795d8ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:54:47.566500 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6519d43d-17b7-4b87-b3eb-eb7a6d757474 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:54:47.585970 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:54:47.604840 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:54:47.623952 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1320/2623] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:54:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 15:54:47.625608 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2613ee32-c1ee-4160-97d7-1e7884a053a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:54:47.626229 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2613ee32-c1ee-4160-97d7-1e7884a053a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:47.626511 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2613ee32-c1ee-4160-97d7-1e7884a053a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:47.626784 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2613ee32-c1ee-4160-97d7-1e7884a053a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:47.627477 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2613ee32-c1ee-4160-97d7-1e7884a053a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:54:47.629155 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2613ee32-c1ee-4160-97d7-1e7884a053a7 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:54:47.633802 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c488bbb3-e0bd-4c27-a0f1-15cda795d8ee None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:54:47.636048 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-c488bbb3-e0bd-4c27-a0f1-15cda795d8ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:54:47.641157 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1304/2624] 10.222.0.102 () {58 vars in 1127 bytes} [Mon Aug 1 15:54:47 2022] GET /identity/v3/roles => generated 1427 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 15:54:47.645207 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2613ee32-c1ee-4160-97d7-1e7884a053a7 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:54:47.654814 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2613ee32-c1ee-4160-97d7-1e7884a053a7 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:54:47.659551 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b8f555-50ad-4926-9f8f-b96b190bd773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:54:47.660203 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b8f555-50ad-4926-9f8f-b96b190bd773 admin admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:47.660485 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b8f555-50ad-4926-9f8f-b96b190bd773 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:47.660753 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b8f555-50ad-4926-9f8f-b96b190bd773 admin admin] PATH_INFO: `/v3/projects/b6e28de1113e44838e7de4b17a16bb5f/users/8c709d31b87b4f958931cf26cda328a3/roles/27f5093ac0674d799cdbd17c68482e32` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:47.678526 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b8f555-50ad-4926-9f8f-b96b190bd773 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6e28de1113e44838e7de4b17a16bb5f, user_id=8c709d31b87b4f958931cf26cda328a3, role_id=27f5093ac0674d799cdbd17c68482e32)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:54:47.679111 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b8f555-50ad-4926-9f8f-b96b190bd773 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:54:47.698816 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c488bbb3-e0bd-4c27-a0f1-15cda795d8ee None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:54:47.702504 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1712da-6b60-490f-8a8e-684448448cc9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a856a413100443939fe9b10daa868518', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:54:47.703114 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1712da-6b60-490f-8a8e-684448448cc9 service neutron] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:47.703389 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1712da-6b60-490f-8a8e-684448448cc9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:47.703656 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1712da-6b60-490f-8a8e-684448448cc9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:47.712551 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1712da-6b60-490f-8a8e-684448448cc9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:54:47.714005 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1712da-6b60-490f-8a8e-684448448cc9 service neutron] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:54:47.723446 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1321/2625] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:54:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 15:54:47.792423 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1305/2626] 10.222.0.102 () {60 vars in 1488 bytes} [Mon Aug 1 15:54:47 2022] PUT /identity/v3/projects/b6e28de1113e44838e7de4b17a16bb5f/users/8c709d31b87b4f958931cf26cda328a3/roles/27f5093ac0674d799cdbd17c68482e32 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 15:54:47.804513 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1eee8fe-1147-44fc-9371-29c7a151bb02 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:47.804798 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1eee8fe-1147-44fc-9371-29c7a151bb02 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:47.805107 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1eee8fe-1147-44fc-9371-29c7a151bb02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:47.833148 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-f1eee8fe-1147-44fc-9371-29c7a151bb02 None None] MFA Rules not processed for user `8c709d31b87b4f958931cf26cda328a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:54:47.834363 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-f1eee8fe-1147-44fc-9371-29c7a151bb02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:54:47.899245 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1322/2627] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:54:47 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 15:54:47.904503 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b8f555-50ad-4926-9f8f-b96b190bd773 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:54:47.973655 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b8f555-50ad-4926-9f8f-b96b190bd773 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:54:47.979947 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9e6d52-e511-48bb-8580-077324f93fe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:54:47.980648 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9e6d52-e511-48bb-8580-077324f93fe6 admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:47.980961 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9e6d52-e511-48bb-8580-077324f93fe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:47.982084 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9e6d52-e511-48bb-8580-077324f93fe6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:47.982802 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9e6d52-e511-48bb-8580-077324f93fe6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:54:47.985937 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9e6d52-e511-48bb-8580-077324f93fe6 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:54:48.053082 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1306/2628] 10.222.0.102 () {60 vars in 1158 bytes} [Mon Aug 1 15:54:47 2022] POST /identity/v3/projects => generated 382 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:54:48.057407 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1eee8fe-1147-44fc-9371-29c7a151bb02 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:54:48.069016 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1eee8fe-1147-44fc-9371-29c7a151bb02 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:54:48.130014 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3fb839-8011-4f76-952f-d379c8b348bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:54:48.130633 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3fb839-8011-4f76-952f-d379c8b348bf admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:48.130914 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3fb839-8011-4f76-952f-d379c8b348bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:48.131188 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3fb839-8011-4f76-952f-d379c8b348bf admin admin] PATH_INFO: `/v3/users` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:48.131867 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3fb839-8011-4f76-952f-d379c8b348bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:54:48.133814 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3fb839-8011-4f76-952f-d379c8b348bf admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:54:48.213324 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9e6d52-e511-48bb-8580-077324f93fe6 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:54:48.215099 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-9d9e6d52-e511-48bb-8580-077324f93fe6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:54:48.228160 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9e6d52-e511-48bb-8580-077324f93fe6 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:54:48.233076 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3745b0e-4835-4e3d-9b77-29862d6ab5e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:54:48.237821 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3745b0e-4835-4e3d-9b77-29862d6ab5e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:48.237821 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3745b0e-4835-4e3d-9b77-29862d6ab5e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:48.237821 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3745b0e-4835-4e3d-9b77-29862d6ab5e8 admin admin] PATH_INFO: `/v3/projects/8670e73a64af4a569135a8d602abcc82` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:48.237821 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3745b0e-4835-4e3d-9b77-29862d6ab5e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8670e73a64af4a569135a8d602abcc82)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:54:48.237821 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3745b0e-4835-4e3d-9b77-29862d6ab5e8 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:54:48.262412 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1323/2629] 10.222.0.102 () {60 vars in 1149 bytes} [Mon Aug 1 15:54:48 2022] POST /identity/v3/users => generated 298 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:54:48.266867 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3fb839-8011-4f76-952f-d379c8b348bf admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:54:48.276672 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3fb839-8011-4f76-952f-d379c8b348bf admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:54:48.282012 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edffa6d3-5901-4155-ad2f-c6a922960260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:54:48.282602 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edffa6d3-5901-4155-ad2f-c6a922960260 admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:48.282874 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edffa6d3-5901-4155-ad2f-c6a922960260 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:48.283142 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edffa6d3-5901-4155-ad2f-c6a922960260 admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:48.283848 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edffa6d3-5901-4155-ad2f-c6a922960260 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:54:48.285518 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edffa6d3-5901-4155-ad2f-c6a922960260 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:54:48.288116 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:54:48.296049 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1324/2630] 10.222.0.102 () {58 vars in 1127 bytes} [Mon Aug 1 15:54:48 2022] GET /identity/v3/roles => generated 1427 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:54:48.299916 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edffa6d3-5901-4155-ad2f-c6a922960260 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:54:48.309944 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edffa6d3-5901-4155-ad2f-c6a922960260 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:54:48.314594 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b99772-e47e-4059-9bd2-bf7fa397eddf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:54:48.319870 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b99772-e47e-4059-9bd2-bf7fa397eddf admin admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:48.319870 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b99772-e47e-4059-9bd2-bf7fa397eddf admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:48.319870 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b99772-e47e-4059-9bd2-bf7fa397eddf admin admin] PATH_INFO: `/v3/projects/3622186565c34ab780be41d23672af34/users/7dbe2010330b4c2cba82825b71dae9de/roles/de1374f966c04c27b579515b54334fd2` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:48.330767 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b99772-e47e-4059-9bd2-bf7fa397eddf admin admin] RBAC: Authorizing `identity:create_grant(project_id=3622186565c34ab780be41d23672af34, user_id=7dbe2010330b4c2cba82825b71dae9de, role_id=de1374f966c04c27b579515b54334fd2)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:54:48.333453 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b99772-e47e-4059-9bd2-bf7fa397eddf admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:54:48.392642 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1325/2631] 10.222.0.102 () {60 vars in 1488 bytes} [Mon Aug 1 15:54:48 2022] PUT /identity/v3/projects/3622186565c34ab780be41d23672af34/users/7dbe2010330b4c2cba82825b71dae9de/roles/de1374f966c04c27b579515b54334fd2 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 15:54:48.396383 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b99772-e47e-4059-9bd2-bf7fa397eddf admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:54:48.401984 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-f3745b0e-4835-4e3d-9b77-29862d6ab5e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8670e73a64af4a569135a8d602abcc82', 'request_id': 'req-f3745b0e-4835-4e3d-9b77-29862d6ab5e8'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:54:48.461115 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b99772-e47e-4059-9bd2-bf7fa397eddf admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:54:48.474381 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-f3745b0e-4835-4e3d-9b77-29862d6ab5e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8670e73a64af4a569135a8d602abcc82', 'request_id': 'req-f3745b0e-4835-4e3d-9b77-29862d6ab5e8'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:54:48.481750 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-f3745b0e-4835-4e3d-9b77-29862d6ab5e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8670e73a64af4a569135a8d602abcc82', 'request_id': 'req-f3745b0e-4835-4e3d-9b77-29862d6ab5e8'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:54:48.483723 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:54:48.492325 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-f3745b0e-4835-4e3d-9b77-29862d6ab5e8 admin admin] The token cache is being invalidate because project 8670e73a64af4a569135a8d602abcc82 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80353) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 15:54:48.492609 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-f3745b0e-4835-4e3d-9b77-29862d6ab5e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:54:48.493306 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-f3745b0e-4835-4e3d-9b77-29862d6ab5e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:54:48.494803 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1307/2632] 10.222.0.102 () {58 vars in 1238 bytes} [Mon Aug 1 15:54:48 2022] DELETE /identity/v3/projects/8670e73a64af4a569135a8d602abcc82 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 15:54:48.498857 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3745b0e-4835-4e3d-9b77-29862d6ab5e8 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:54:48.500314 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-f3745b0e-4835-4e3d-9b77-29862d6ab5e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:54:48.521061 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc23db97-57d4-448a-b376-a7f7303c993d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:54:48.521678 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc23db97-57d4-448a-b376-a7f7303c993d admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:48.521956 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc23db97-57d4-448a-b376-a7f7303c993d admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:48.522230 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc23db97-57d4-448a-b376-a7f7303c993d admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:48.522918 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc23db97-57d4-448a-b376-a7f7303c993d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:54:48.524521 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc23db97-57d4-448a-b376-a7f7303c993d admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:54:48.534819 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1326/2633] 10.222.0.102 () {58 vars in 1127 bytes} [Mon Aug 1 15:54:48 2022] GET /identity/v3/roles => generated 1427 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 15:54:48.538912 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc23db97-57d4-448a-b376-a7f7303c993d admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:54:48.540603 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-dc23db97-57d4-448a-b376-a7f7303c993d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:54:48.552623 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc23db97-57d4-448a-b376-a7f7303c993d admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:54:48.557671 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc47610-3cac-4a9e-81fe-3dd0b3dfcc85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:54:48.558410 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc47610-3cac-4a9e-81fe-3dd0b3dfcc85 admin admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:48.558682 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc47610-3cac-4a9e-81fe-3dd0b3dfcc85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:48.558956 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc47610-3cac-4a9e-81fe-3dd0b3dfcc85 admin admin] PATH_INFO: `/v3/projects/3622186565c34ab780be41d23672af34/users/7dbe2010330b4c2cba82825b71dae9de/roles/de1374f966c04c27b579515b54334fd2` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:48.561712 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc47610-3cac-4a9e-81fe-3dd0b3dfcc85 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3622186565c34ab780be41d23672af34, user_id=7dbe2010330b4c2cba82825b71dae9de, role_id=de1374f966c04c27b579515b54334fd2)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:54:48.564519 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc47610-3cac-4a9e-81fe-3dd0b3dfcc85 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:54:48.566055 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3745b0e-4835-4e3d-9b77-29862d6ab5e8 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:54:48.572062 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0fde5a-4d98-4019-8d44-30efb1c4521a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:54:48.572705 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0fde5a-4d98-4019-8d44-30efb1c4521a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:48.573015 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0fde5a-4d98-4019-8d44-30efb1c4521a admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:48.573286 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0fde5a-4d98-4019-8d44-30efb1c4521a admin admin] PATH_INFO: `/v3/users/a7dc9405091c4997b1139771c548246d` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:48.574905 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0fde5a-4d98-4019-8d44-30efb1c4521a admin admin] RBAC: Authorizing `identity:delete_user(user_id=a7dc9405091c4997b1139771c548246d)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:54:48.576550 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1327/2634] 10.222.0.102 () {60 vars in 1488 bytes} [Mon Aug 1 15:54:48 2022] PUT /identity/v3/projects/3622186565c34ab780be41d23672af34/users/7dbe2010330b4c2cba82825b71dae9de/roles/de1374f966c04c27b579515b54334fd2 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 15:54:48.578078 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0fde5a-4d98-4019-8d44-30efb1c4521a admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:54:48.587494 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f5e26c-df80-4e77-9892-38e9cfc62ef4 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:48.587775 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f5e26c-df80-4e77-9892-38e9cfc62ef4 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:48.588205 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f5e26c-df80-4e77-9892-38e9cfc62ef4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:48.625285 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-b8f5e26c-df80-4e77-9892-38e9cfc62ef4 None None] MFA Rules not processed for user `7dbe2010330b4c2cba82825b71dae9de`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:54:48.626586 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-b8f5e26c-df80-4e77-9892-38e9cfc62ef4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:54:48.681502 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:54:48.703587 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1328/2635] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:54:48 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 15:54:48.714252 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f5e26c-df80-4e77-9892-38e9cfc62ef4 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:54:48.715572 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-b8f5e26c-df80-4e77-9892-38e9cfc62ef4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:54:48.760242 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-8b0fde5a-4d98-4019-8d44-30efb1c4521a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7dc9405091c4997b1139771c548246d'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:54:48.774294 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f5e26c-df80-4e77-9892-38e9cfc62ef4 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:54:48.778110 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85ecdf1-7f6d-4826-b3ec-67a8ab3eca6b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff810b37183c4729859c1b05edff1703', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:54:48.779220 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85ecdf1-7f6d-4826-b3ec-67a8ab3eca6b service cinder] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:48.779500 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85ecdf1-7f6d-4826-b3ec-67a8ab3eca6b service cinder] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:48.779772 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85ecdf1-7f6d-4826-b3ec-67a8ab3eca6b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:48.788825 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85ecdf1-7f6d-4826-b3ec-67a8ab3eca6b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:54:48.792002 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85ecdf1-7f6d-4826-b3ec-67a8ab3eca6b service cinder] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:54:48.800191 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1329/2636] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:54:48 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 15:54:48.868896 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-8b0fde5a-4d98-4019-8d44-30efb1c4521a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7dc9405091c4997b1139771c548246d'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:54:48.898238 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-8b0fde5a-4d98-4019-8d44-30efb1c4521a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7dc9405091c4997b1139771c548246d'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:54:48.903377 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-8b0fde5a-4d98-4019-8d44-30efb1c4521a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7dc9405091c4997b1139771c548246d'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:54:48.903377 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-8b0fde5a-4d98-4019-8d44-30efb1c4521a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7dc9405091c4997b1139771c548246d'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:54:48.904973 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85ecdf1-7f6d-4826-b3ec-67a8ab3eca6b service cinder] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:54:48.912700 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1308/2637] 10.222.0.102 () {58 vars in 1229 bytes} [Mon Aug 1 15:54:48 2022] DELETE /identity/v3/users/a7dc9405091c4997b1139771c548246d => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:54:48.913712 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85ecdf1-7f6d-4826-b3ec-67a8ab3eca6b service cinder] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:54:48.971211 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f353af-f7fc-4ba7-9bc2-27aa285a771e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff810b37183c4729859c1b05edff1703', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:54:48.971211 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f353af-f7fc-4ba7-9bc2-27aa285a771e service cinder] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:48.971211 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f353af-f7fc-4ba7-9bc2-27aa285a771e service cinder] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:48.971211 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f353af-f7fc-4ba7-9bc2-27aa285a771e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:48.971802 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-f7f353af-f7fc-4ba7-9bc2-27aa285a771e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:54:49.030433 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f353af-f7fc-4ba7-9bc2-27aa285a771e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:54:49.031875 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f353af-f7fc-4ba7-9bc2-27aa285a771e service cinder] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:54:49.040777 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1330/2638] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:54:48 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 15:54:49.300010 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0fde5a-4d98-4019-8d44-30efb1c4521a admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:54:49.302774 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-8b0fde5a-4d98-4019-8d44-30efb1c4521a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:54:49.378370 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0fde5a-4d98-4019-8d44-30efb1c4521a admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:54:49.382914 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60051dae-cc33-4d2c-8990-f24de0825606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:54:49.383555 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60051dae-cc33-4d2c-8990-f24de0825606 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:49.383833 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60051dae-cc33-4d2c-8990-f24de0825606 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:49.384104 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60051dae-cc33-4d2c-8990-f24de0825606 admin admin] PATH_INFO: `/v3/projects/2c637474fe8f46509ef059062013a259` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:49.385304 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60051dae-cc33-4d2c-8990-f24de0825606 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c637474fe8f46509ef059062013a259)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:54:49.387212 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60051dae-cc33-4d2c-8990-f24de0825606 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:54:49.398520 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:54:49.538504 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-60051dae-cc33-4d2c-8990-f24de0825606 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c637474fe8f46509ef059062013a259', 'request_id': 'req-60051dae-cc33-4d2c-8990-f24de0825606'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:54:49.603294 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-60051dae-cc33-4d2c-8990-f24de0825606 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c637474fe8f46509ef059062013a259', 'request_id': 'req-60051dae-cc33-4d2c-8990-f24de0825606'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:54:49.610690 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-60051dae-cc33-4d2c-8990-f24de0825606 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c637474fe8f46509ef059062013a259', 'request_id': 'req-60051dae-cc33-4d2c-8990-f24de0825606'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:54:49.621480 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-60051dae-cc33-4d2c-8990-f24de0825606 admin admin] The token cache is being invalidate because project 2c637474fe8f46509ef059062013a259 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80353) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 15:54:49.621814 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-60051dae-cc33-4d2c-8990-f24de0825606 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:54:49.622476 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-60051dae-cc33-4d2c-8990-f24de0825606 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:54:49.623997 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1309/2639] 10.222.0.102 () {58 vars in 1238 bytes} [Mon Aug 1 15:54:49 2022] DELETE /identity/v3/projects/2c637474fe8f46509ef059062013a259 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:54:49.628948 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11a16d4-89a5-4809-ab06-f74834f58820 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:49.629266 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11a16d4-89a5-4809-ab06-f74834f58820 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:49.629548 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11a16d4-89a5-4809-ab06-f74834f58820 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:49.649565 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-f11a16d4-89a5-4809-ab06-f74834f58820 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:54:49.650767 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-f11a16d4-89a5-4809-ab06-f74834f58820 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:54:49.691927 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:54:49.714090 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1331/2640] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:54:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:54:49.724482 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eec73e-974f-4477-ad70-51c76f8b8ec7 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:49.724482 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eec73e-974f-4477-ad70-51c76f8b8ec7 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:49.724685 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eec73e-974f-4477-ad70-51c76f8b8ec7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:49.752823 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-a8eec73e-974f-4477-ad70-51c76f8b8ec7 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:54:49.752823 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-a8eec73e-974f-4477-ad70-51c76f8b8ec7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:54:49.755993 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1310/2641] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:54:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:54:49.761927 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11a16d4-89a5-4809-ab06-f74834f58820 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:54:49.772403 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11a16d4-89a5-4809-ab06-f74834f58820 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:54:49.777232 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaba384-f080-45f2-bd8b-f778cc135563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:54:49.777844 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaba384-f080-45f2-bd8b-f778cc135563 admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:49.778120 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaba384-f080-45f2-bd8b-f778cc135563 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:49.778952 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaba384-f080-45f2-bd8b-f778cc135563 admin admin] PATH_INFO: `/v3/domains` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:49.779638 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aaba384-f080-45f2-bd8b-f778cc135563 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:54:49.779938 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aaba384-f080-45f2-bd8b-f778cc135563 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:54:49.781669 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aaba384-f080-45f2-bd8b-f778cc135563 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:54:49.793692 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1332/2642] 10.222.0.102 () {58 vars in 1158 bytes} [Mon Aug 1 15:54:49 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:54:49.797687 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8eec73e-974f-4477-ad70-51c76f8b8ec7 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:54:49.807154 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8eec73e-974f-4477-ad70-51c76f8b8ec7 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:54:49.812072 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df00ad9e-8321-45fa-bae7-c9ac6179a4a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:54:49.812695 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df00ad9e-8321-45fa-bae7-c9ac6179a4a6 admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:49.812990 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df00ad9e-8321-45fa-bae7-c9ac6179a4a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:49.813268 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df00ad9e-8321-45fa-bae7-c9ac6179a4a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:49.813935 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df00ad9e-8321-45fa-bae7-c9ac6179a4a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:54:49.815857 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df00ad9e-8321-45fa-bae7-c9ac6179a4a6 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:54:49.922018 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1311/2643] 10.222.0.102 () {60 vars in 1158 bytes} [Mon Aug 1 15:54:49 2022] POST /identity/v3/projects => generated 408 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:54:49.926302 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaba384-f080-45f2-bd8b-f778cc135563 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:54:49.936868 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaba384-f080-45f2-bd8b-f778cc135563 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:54:49.995265 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947e11bf-3ec2-4731-8af1-d89d78924d50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:54:49.995878 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947e11bf-3ec2-4731-8af1-d89d78924d50 admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:49.996156 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947e11bf-3ec2-4731-8af1-d89d78924d50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:49.996428 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947e11bf-3ec2-4731-8af1-d89d78924d50 admin admin] PATH_INFO: `/v3/users` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:49.997140 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947e11bf-3ec2-4731-8af1-d89d78924d50 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:54:49.999064 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947e11bf-3ec2-4731-8af1-d89d78924d50 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:54:50.074101 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1333/2644] 10.222.0.102 () {60 vars in 1149 bytes} [Mon Aug 1 15:54:49 2022] POST /identity/v3/users => generated 305 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:54:50.078918 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df00ad9e-8321-45fa-bae7-c9ac6179a4a6 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:54:50.089057 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df00ad9e-8321-45fa-bae7-c9ac6179a4a6 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:54:50.093613 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce77e9d-11fa-4064-bf21-264c2dcd99d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:54:50.094278 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce77e9d-11fa-4064-bf21-264c2dcd99d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:50.094555 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce77e9d-11fa-4064-bf21-264c2dcd99d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:50.094824 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce77e9d-11fa-4064-bf21-264c2dcd99d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:50.095509 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce77e9d-11fa-4064-bf21-264c2dcd99d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:54:50.097193 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce77e9d-11fa-4064-bf21-264c2dcd99d1 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:54:50.107235 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1312/2645] 10.222.0.102 () {58 vars in 1127 bytes} [Mon Aug 1 15:54:50 2022] GET /identity/v3/roles => generated 1427 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:54:50.110992 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947e11bf-3ec2-4731-8af1-d89d78924d50 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:54:50.121063 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947e11bf-3ec2-4731-8af1-d89d78924d50 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:54:50.127278 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7371640e-ad57-4e8d-a272-eea9536a28b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:54:50.127883 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7371640e-ad57-4e8d-a272-eea9536a28b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:50.128163 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7371640e-ad57-4e8d-a272-eea9536a28b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:50.128437 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7371640e-ad57-4e8d-a272-eea9536a28b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:50.129169 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7371640e-ad57-4e8d-a272-eea9536a28b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:54:50.130774 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7371640e-ad57-4e8d-a272-eea9536a28b3 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:54:50.142100 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1334/2646] 10.222.0.102 () {58 vars in 1127 bytes} [Mon Aug 1 15:54:50 2022] GET /identity/v3/roles => generated 1427 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:54:50.146223 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce77e9d-11fa-4064-bf21-264c2dcd99d1 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:54:50.156301 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce77e9d-11fa-4064-bf21-264c2dcd99d1 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:54:50.160814 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac07033c-075e-4c57-92f6-39acce10fb80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:54:50.161526 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac07033c-075e-4c57-92f6-39acce10fb80 admin admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:50.161810 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac07033c-075e-4c57-92f6-39acce10fb80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:50.162084 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac07033c-075e-4c57-92f6-39acce10fb80 admin admin] PATH_INFO: `/v3/projects/ad61839394444e9db32047fa7f6b80b0/users/f9684c6051a0449b9e49ac81c6666ba4/roles/27f5093ac0674d799cdbd17c68482e32` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:50.176315 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac07033c-075e-4c57-92f6-39acce10fb80 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad61839394444e9db32047fa7f6b80b0, user_id=f9684c6051a0449b9e49ac81c6666ba4, role_id=27f5093ac0674d799cdbd17c68482e32)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:54:50.178996 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac07033c-075e-4c57-92f6-39acce10fb80 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:54:50.234066 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1313/2647] 10.222.0.102 () {60 vars in 1488 bytes} [Mon Aug 1 15:54:50 2022] PUT /identity/v3/projects/ad61839394444e9db32047fa7f6b80b0/users/f9684c6051a0449b9e49ac81c6666ba4/roles/27f5093ac0674d799cdbd17c68482e32 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:54:50.244200 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f60cada-47c0-400c-ad65-165576bd31ad None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:50.245389 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f60cada-47c0-400c-ad65-165576bd31ad None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:50.245389 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f60cada-47c0-400c-ad65-165576bd31ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:50.274213 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-5f60cada-47c0-400c-ad65-165576bd31ad None None] MFA Rules not processed for user `f9684c6051a0449b9e49ac81c6666ba4`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:54:50.275438 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-5f60cada-47c0-400c-ad65-165576bd31ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:54:50.345755 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1335/2648] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:54:50 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:54:50.350456 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac07033c-075e-4c57-92f6-39acce10fb80 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:54:50.414742 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac07033c-075e-4c57-92f6-39acce10fb80 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:54:50.419983 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24efeb8d-26c8-4a89-851f-dc359100f93b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:54:50.420601 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24efeb8d-26c8-4a89-851f-dc359100f93b admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:50.420910 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24efeb8d-26c8-4a89-851f-dc359100f93b admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:50.421190 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24efeb8d-26c8-4a89-851f-dc359100f93b admin admin] PATH_INFO: `/v3/projects` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:50.421878 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24efeb8d-26c8-4a89-851f-dc359100f93b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:54:50.423885 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24efeb8d-26c8-4a89-851f-dc359100f93b admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:54:50.513405 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1314/2649] 10.222.0.102 () {60 vars in 1158 bytes} [Mon Aug 1 15:54:50 2022] POST /identity/v3/projects => generated 410 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:54:50.517632 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f60cada-47c0-400c-ad65-165576bd31ad None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:54:50.528605 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f60cada-47c0-400c-ad65-165576bd31ad None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:54:50.569140 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:54:50.587084 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50150cee-b060-4225-99b8-1c12d1220c11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:54:50.587694 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50150cee-b060-4225-99b8-1c12d1220c11 admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:50.587974 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50150cee-b060-4225-99b8-1c12d1220c11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:50.588245 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50150cee-b060-4225-99b8-1c12d1220c11 admin admin] PATH_INFO: `/v3/users` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:50.588933 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50150cee-b060-4225-99b8-1c12d1220c11 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:54:50.590954 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50150cee-b060-4225-99b8-1c12d1220c11 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:54:50.679433 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1336/2650] 10.222.0.102 () {60 vars in 1149 bytes} [Mon Aug 1 15:54:50 2022] POST /identity/v3/users => generated 312 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:54:50.683461 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24efeb8d-26c8-4a89-851f-dc359100f93b admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:54:50.694921 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24efeb8d-26c8-4a89-851f-dc359100f93b admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:54:50.699797 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72bef79-a984-4a88-b4b0-ee14787b510b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:54:50.705102 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72bef79-a984-4a88-b4b0-ee14787b510b admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:50.705102 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72bef79-a984-4a88-b4b0-ee14787b510b admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:50.705102 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72bef79-a984-4a88-b4b0-ee14787b510b admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:50.705102 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72bef79-a984-4a88-b4b0-ee14787b510b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:54:50.705102 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72bef79-a984-4a88-b4b0-ee14787b510b admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:54:50.713872 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1315/2651] 10.222.0.102 () {58 vars in 1127 bytes} [Mon Aug 1 15:54:50 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:54:50.718107 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50150cee-b060-4225-99b8-1c12d1220c11 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:54:50.728762 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50150cee-b060-4225-99b8-1c12d1220c11 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:54:50.735507 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39f5fd9-014c-4590-86c2-25057457d8a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:54:50.739504 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39f5fd9-014c-4590-86c2-25057457d8a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:50.739504 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39f5fd9-014c-4590-86c2-25057457d8a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:50.739504 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39f5fd9-014c-4590-86c2-25057457d8a3 admin admin] PATH_INFO: `/v3/projects/a4259c8518034b9798149a76a3fb3e00/users/8520d0147d2d4f76a5d7eda26a9f44d7/roles/de1374f966c04c27b579515b54334fd2` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:50.752465 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39f5fd9-014c-4590-86c2-25057457d8a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4259c8518034b9798149a76a3fb3e00, user_id=8520d0147d2d4f76a5d7eda26a9f44d7, role_id=de1374f966c04c27b579515b54334fd2)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:54:50.755342 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39f5fd9-014c-4590-86c2-25057457d8a3 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:54:50.856926 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1337/2652] 10.222.0.102 () {60 vars in 1488 bytes} [Mon Aug 1 15:54:50 2022] PUT /identity/v3/projects/a4259c8518034b9798149a76a3fb3e00/users/8520d0147d2d4f76a5d7eda26a9f44d7/roles/de1374f966c04c27b579515b54334fd2 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:54:50.859555 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72bef79-a984-4a88-b4b0-ee14787b510b admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:54:50.877590 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72bef79-a984-4a88-b4b0-ee14787b510b admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:54:50.884153 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:54:50.942033 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbe598a-3d0c-4b37-b26c-d633d7152f7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:54:50.942648 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbe598a-3d0c-4b37-b26c-d633d7152f7f admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:50.942924 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbe598a-3d0c-4b37-b26c-d633d7152f7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:50.943194 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbe598a-3d0c-4b37-b26c-d633d7152f7f admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:50.943885 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbe598a-3d0c-4b37-b26c-d633d7152f7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:54:50.945516 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbe598a-3d0c-4b37-b26c-d633d7152f7f admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:54:50.958218 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1316/2653] 10.222.0.102 () {58 vars in 1127 bytes} [Mon Aug 1 15:54:50 2022] GET /identity/v3/roles => generated 1427 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:54:50.959626 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39f5fd9-014c-4590-86c2-25057457d8a3 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:54:50.970966 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39f5fd9-014c-4590-86c2-25057457d8a3 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:54:50.975608 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d61c6a-c63f-4bd3-82c8-23043027281b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:54:50.976258 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d61c6a-c63f-4bd3-82c8-23043027281b admin admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:50.976532 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d61c6a-c63f-4bd3-82c8-23043027281b admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:50.976802 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d61c6a-c63f-4bd3-82c8-23043027281b admin admin] PATH_INFO: `/v3/projects/a4259c8518034b9798149a76a3fb3e00/users/8520d0147d2d4f76a5d7eda26a9f44d7/roles/de1374f966c04c27b579515b54334fd2` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:50.978757 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d61c6a-c63f-4bd3-82c8-23043027281b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4259c8518034b9798149a76a3fb3e00, user_id=8520d0147d2d4f76a5d7eda26a9f44d7, role_id=de1374f966c04c27b579515b54334fd2)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:54:50.982317 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d61c6a-c63f-4bd3-82c8-23043027281b admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:54:50.993029 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1338/2654] 10.222.0.102 () {60 vars in 1488 bytes} [Mon Aug 1 15:54:50 2022] PUT /identity/v3/projects/a4259c8518034b9798149a76a3fb3e00/users/8520d0147d2d4f76a5d7eda26a9f44d7/roles/de1374f966c04c27b579515b54334fd2 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 15:54:51.003221 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61835d1-3ca3-4ac9-9e2b-9baee0959462 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:51.003503 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61835d1-3ca3-4ac9-9e2b-9baee0959462 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:51.003774 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61835d1-3ca3-4ac9-9e2b-9baee0959462 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:51.031993 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-c61835d1-3ca3-4ac9-9e2b-9baee0959462 None None] MFA Rules not processed for user `8520d0147d2d4f76a5d7eda26a9f44d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:54:51.033401 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-c61835d1-3ca3-4ac9-9e2b-9baee0959462 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:54:51.099805 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1317/2655] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:54:51 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:54:51.110969 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d61c6a-c63f-4bd3-82c8-23043027281b admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:54:51.112672 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-b3d61c6a-c63f-4bd3-82c8-23043027281b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:54:51.174516 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d61c6a-c63f-4bd3-82c8-23043027281b admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:54:51.178324 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee16f879-f0c1-45c4-babb-5bef8fed04d9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff810b37183c4729859c1b05edff1703', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:54:51.178941 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee16f879-f0c1-45c4-babb-5bef8fed04d9 service cinder] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:51.179221 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee16f879-f0c1-45c4-babb-5bef8fed04d9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:51.179492 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee16f879-f0c1-45c4-babb-5bef8fed04d9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:51.192218 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee16f879-f0c1-45c4-babb-5bef8fed04d9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:54:51.192218 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee16f879-f0c1-45c4-babb-5bef8fed04d9 service cinder] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:54:51.200977 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1339/2656] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:54:51 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:54:51.560432 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61835d1-3ca3-4ac9-9e2b-9baee0959462 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:54:51.565673 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-c61835d1-3ca3-4ac9-9e2b-9baee0959462 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:54:51.576080 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61835d1-3ca3-4ac9-9e2b-9baee0959462 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:54:51.579795 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3fcf57-a9c5-445c-b36f-0277adb5dd02 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff810b37183c4729859c1b05edff1703', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:54:51.580403 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3fcf57-a9c5-445c-b36f-0277adb5dd02 service cinder] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:51.580682 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3fcf57-a9c5-445c-b36f-0277adb5dd02 service cinder] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:51.581010 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3fcf57-a9c5-445c-b36f-0277adb5dd02 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:51.639493 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3fcf57-a9c5-445c-b36f-0277adb5dd02 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:54:51.641389 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3fcf57-a9c5-445c-b36f-0277adb5dd02 service cinder] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:54:51.651038 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1318/2657] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:54:51 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:54:51.689225 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f8ddc1-d06d-4e71-b76f-4834442b8b09 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:51.689532 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f8ddc1-d06d-4e71-b76f-4834442b8b09 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:51.689804 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f8ddc1-d06d-4e71-b76f-4834442b8b09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:51.710530 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-15f8ddc1-d06d-4e71-b76f-4834442b8b09 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:54:51.711696 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-15f8ddc1-d06d-4e71-b76f-4834442b8b09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:54:51.772764 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1340/2658] 10.222.0.65 () {58 vars in 1020 bytes} [Mon Aug 1 15:54:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:54:51.796833 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3fcf57-a9c5-445c-b36f-0277adb5dd02 service cinder] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:54:51.798105 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-ac3fcf57-a9c5-445c-b36f-0277adb5dd02 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:54:51.837597 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:54:51.879662 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3fcf57-a9c5-445c-b36f-0277adb5dd02 service cinder] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:54:51.885820 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37eab6fd-12d1-4e66-a4b7-f5bd6c0729ff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77b43f1ee8cc4be3907a494abe90c1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:54:51.886477 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eab6fd-12d1-4e66-a4b7-f5bd6c0729ff service nova] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:51.886902 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eab6fd-12d1-4e66-a4b7-f5bd6c0729ff service nova] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:51.887218 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eab6fd-12d1-4e66-a4b7-f5bd6c0729ff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:51.897176 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37eab6fd-12d1-4e66-a4b7-f5bd6c0729ff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:54:51.900080 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37eab6fd-12d1-4e66-a4b7-f5bd6c0729ff service nova] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:54:51.908429 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1319/2659] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:54:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:54:52.215459 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f8ddc1-d06d-4e71-b76f-4834442b8b09 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:54:52.216912 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-15f8ddc1-d06d-4e71-b76f-4834442b8b09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:54:52.228979 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f8ddc1-d06d-4e71-b76f-4834442b8b09 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:54:52.234679 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c33996-0122-41f1-9f2d-108f51c5a393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:54:52.235303 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c33996-0122-41f1-9f2d-108f51c5a393 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:52.235584 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c33996-0122-41f1-9f2d-108f51c5a393 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:52.235858 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c33996-0122-41f1-9f2d-108f51c5a393 admin admin] PATH_INFO: `/v3/users/8c709d31b87b4f958931cf26cda328a3` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:52.237081 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c33996-0122-41f1-9f2d-108f51c5a393 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c709d31b87b4f958931cf26cda328a3)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:54:52.255603 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c33996-0122-41f1-9f2d-108f51c5a393 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:54:52.440708 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:54:52.453908 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-86c33996-0122-41f1-9f2d-108f51c5a393 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c709d31b87b4f958931cf26cda328a3'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:54:52.466123 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-86c33996-0122-41f1-9f2d-108f51c5a393 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c709d31b87b4f958931cf26cda328a3'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:54:52.472800 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-86c33996-0122-41f1-9f2d-108f51c5a393 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c709d31b87b4f958931cf26cda328a3'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:54:52.473485 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-86c33996-0122-41f1-9f2d-108f51c5a393 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c709d31b87b4f958931cf26cda328a3'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:54:52.474082 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-86c33996-0122-41f1-9f2d-108f51c5a393 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c709d31b87b4f958931cf26cda328a3'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:54:52.571545 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1341/2660] 10.222.0.102 () {58 vars in 1229 bytes} [Mon Aug 1 15:54:52 2022] DELETE /identity/v3/users/8c709d31b87b4f958931cf26cda328a3 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:54:52.576147 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ff1222-30d1-45d3-81a2-a3b56e161d02 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:52.576630 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ff1222-30d1-45d3-81a2-a3b56e161d02 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:52.576757 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ff1222-30d1-45d3-81a2-a3b56e161d02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:52.595715 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-98ff1222-30d1-45d3-81a2-a3b56e161d02 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:54:52.596954 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-98ff1222-30d1-45d3-81a2-a3b56e161d02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:54:52.655379 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1320/2661] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:54:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:54:52.665289 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c33996-0122-41f1-9f2d-108f51c5a393 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:54:52.666705 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-86c33996-0122-41f1-9f2d-108f51c5a393 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:54:52.735343 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c33996-0122-41f1-9f2d-108f51c5a393 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:54:52.739565 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cf98c8-380d-498c-8b8a-d1c64c45baf5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a856a413100443939fe9b10daa868518', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:54:52.740181 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cf98c8-380d-498c-8b8a-d1c64c45baf5 service neutron] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:52.740462 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cf98c8-380d-498c-8b8a-d1c64c45baf5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:52.740737 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cf98c8-380d-498c-8b8a-d1c64c45baf5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:52.751465 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cf98c8-380d-498c-8b8a-d1c64c45baf5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:54:52.752962 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cf98c8-380d-498c-8b8a-d1c64c45baf5 service neutron] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:54:52.762401 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1342/2662] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:54:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:54:53.176032 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ff1222-30d1-45d3-81a2-a3b56e161d02 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:54:53.177483 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-98ff1222-30d1-45d3-81a2-a3b56e161d02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:54:53.194573 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ff1222-30d1-45d3-81a2-a3b56e161d02 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:54:53.194972 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5921ac79-74b5-4b5a-b750-246459f59d92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:54:53.195616 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5921ac79-74b5-4b5a-b750-246459f59d92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:53.195894 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5921ac79-74b5-4b5a-b750-246459f59d92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:53.196163 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5921ac79-74b5-4b5a-b750-246459f59d92 admin admin] PATH_INFO: `/v3/projects/b6e28de1113e44838e7de4b17a16bb5f` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:53.197377 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5921ac79-74b5-4b5a-b750-246459f59d92 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6e28de1113e44838e7de4b17a16bb5f)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:54:53.199289 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5921ac79-74b5-4b5a-b750-246459f59d92 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:54:53.297132 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-5921ac79-74b5-4b5a-b750-246459f59d92 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6e28de1113e44838e7de4b17a16bb5f', 'request_id': 'req-5921ac79-74b5-4b5a-b750-246459f59d92'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:54:53.363197 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-5921ac79-74b5-4b5a-b750-246459f59d92 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6e28de1113e44838e7de4b17a16bb5f', 'request_id': 'req-5921ac79-74b5-4b5a-b750-246459f59d92'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:54:53.370218 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-5921ac79-74b5-4b5a-b750-246459f59d92 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6e28de1113e44838e7de4b17a16bb5f', 'request_id': 'req-5921ac79-74b5-4b5a-b750-246459f59d92'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:54:53.382560 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-5921ac79-74b5-4b5a-b750-246459f59d92 admin admin] The token cache is being invalidate because project b6e28de1113e44838e7de4b17a16bb5f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80353) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 15:54:53.382896 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-5921ac79-74b5-4b5a-b750-246459f59d92 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:54:53.383552 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-5921ac79-74b5-4b5a-b750-246459f59d92 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:54:53.385240 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1321/2663] 10.222.0.102 () {58 vars in 1238 bytes} [Mon Aug 1 15:54:53 2022] DELETE /identity/v3/projects/b6e28de1113e44838e7de4b17a16bb5f => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:54:53.390063 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cf98c8-380d-498c-8b8a-d1c64c45baf5 service neutron] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:54:53.404872 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cf98c8-380d-498c-8b8a-d1c64c45baf5 service neutron] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:54:53.460790 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98489c6-3729-4cbb-8613-17ff9ac9ba77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:54:53.461423 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98489c6-3729-4cbb-8613-17ff9ac9ba77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:53.461653 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98489c6-3729-4cbb-8613-17ff9ac9ba77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:53.461928 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98489c6-3729-4cbb-8613-17ff9ac9ba77 admin admin] PATH_INFO: `/v3/users/7dbe2010330b4c2cba82825b71dae9de` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:53.463081 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98489c6-3729-4cbb-8613-17ff9ac9ba77 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7dbe2010330b4c2cba82825b71dae9de)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:54:53.465031 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98489c6-3729-4cbb-8613-17ff9ac9ba77 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:54:53.668186 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-a98489c6-3729-4cbb-8613-17ff9ac9ba77 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7dbe2010330b4c2cba82825b71dae9de'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:54:53.672747 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:54:53.680774 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-a98489c6-3729-4cbb-8613-17ff9ac9ba77 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7dbe2010330b4c2cba82825b71dae9de'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:54:53.687967 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-a98489c6-3729-4cbb-8613-17ff9ac9ba77 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7dbe2010330b4c2cba82825b71dae9de'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:54:53.688643 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-a98489c6-3729-4cbb-8613-17ff9ac9ba77 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7dbe2010330b4c2cba82825b71dae9de'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:54:53.689288 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-a98489c6-3729-4cbb-8613-17ff9ac9ba77 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7dbe2010330b4c2cba82825b71dae9de'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:54:53.786271 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1343/2664] 10.222.0.102 () {58 vars in 1229 bytes} [Mon Aug 1 15:54:53 2022] DELETE /identity/v3/users/7dbe2010330b4c2cba82825b71dae9de => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:54:54.172925 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5921ac79-74b5-4b5a-b750-246459f59d92 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:54:54.176303 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-5921ac79-74b5-4b5a-b750-246459f59d92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:54:54.192522 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5921ac79-74b5-4b5a-b750-246459f59d92 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:54:54.232784 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:54:54.250909 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd49386-737a-4ad9-aaaa-282e3e2b7cba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:54:54.251543 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd49386-737a-4ad9-aaaa-282e3e2b7cba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:54.251822 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd49386-737a-4ad9-aaaa-282e3e2b7cba admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:54.252092 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd49386-737a-4ad9-aaaa-282e3e2b7cba admin admin] PATH_INFO: `/v3/projects/3622186565c34ab780be41d23672af34` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:54.253271 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd49386-737a-4ad9-aaaa-282e3e2b7cba admin admin] RBAC: Authorizing `identity:delete_project(project_id=3622186565c34ab780be41d23672af34)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:54:54.255185 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd49386-737a-4ad9-aaaa-282e3e2b7cba admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:54:54.349139 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-dfd49386-737a-4ad9-aaaa-282e3e2b7cba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3622186565c34ab780be41d23672af34', 'request_id': 'req-dfd49386-737a-4ad9-aaaa-282e3e2b7cba'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:54:54.410956 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-dfd49386-737a-4ad9-aaaa-282e3e2b7cba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3622186565c34ab780be41d23672af34', 'request_id': 'req-dfd49386-737a-4ad9-aaaa-282e3e2b7cba'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:54:54.417769 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-dfd49386-737a-4ad9-aaaa-282e3e2b7cba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3622186565c34ab780be41d23672af34', 'request_id': 'req-dfd49386-737a-4ad9-aaaa-282e3e2b7cba'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:54:54.429403 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-dfd49386-737a-4ad9-aaaa-282e3e2b7cba admin admin] The token cache is being invalidate because project 3622186565c34ab780be41d23672af34 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80353) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 15:54:54.429788 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-dfd49386-737a-4ad9-aaaa-282e3e2b7cba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:54:54.430515 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-dfd49386-737a-4ad9-aaaa-282e3e2b7cba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:54:54.432088 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1322/2665] 10.222.0.102 () {58 vars in 1238 bytes} [Mon Aug 1 15:54:54 2022] DELETE /identity/v3/projects/3622186565c34ab780be41d23672af34 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:54:54.437941 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4825cfa1-0c66-4f80-89c5-5f27e3376a13 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:54.438442 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4825cfa1-0c66-4f80-89c5-5f27e3376a13 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:54.438668 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4825cfa1-0c66-4f80-89c5-5f27e3376a13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:54.459018 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-4825cfa1-0c66-4f80-89c5-5f27e3376a13 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:54:54.460371 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-4825cfa1-0c66-4f80-89c5-5f27e3376a13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:54:54.524763 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1344/2666] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:54:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:54:54.533206 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286dbedf-1023-4eb5-b884-980b6e672e9e None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:54.535988 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286dbedf-1023-4eb5-b884-980b6e672e9e None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:54.535988 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286dbedf-1023-4eb5-b884-980b6e672e9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:54.554698 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-286dbedf-1023-4eb5-b884-980b6e672e9e None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:54:54.555906 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-286dbedf-1023-4eb5-b884-980b6e672e9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:54:54.564678 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1323/2667] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:54:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:54:54.569078 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4825cfa1-0c66-4f80-89c5-5f27e3376a13 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:54:54.580710 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4825cfa1-0c66-4f80-89c5-5f27e3376a13 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:54:54.586838 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d07c9e-72ac-46fc-8bee-b73d1d52202a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:54:54.587771 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d07c9e-72ac-46fc-8bee-b73d1d52202a admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:54.588121 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d07c9e-72ac-46fc-8bee-b73d1d52202a admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:54.588466 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d07c9e-72ac-46fc-8bee-b73d1d52202a admin admin] PATH_INFO: `/v3/domains` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:54.589326 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d07c9e-72ac-46fc-8bee-b73d1d52202a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:54:54.589630 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d07c9e-72ac-46fc-8bee-b73d1d52202a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:54:54.591290 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d07c9e-72ac-46fc-8bee-b73d1d52202a admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:54:54.603843 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1345/2668] 10.222.0.102 () {58 vars in 1158 bytes} [Mon Aug 1 15:54:54 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:54:54.608239 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286dbedf-1023-4eb5-b884-980b6e672e9e None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:54:54.617613 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286dbedf-1023-4eb5-b884-980b6e672e9e None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:54:54.622952 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2259665-42bf-4103-be2c-600845cb13bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:54:54.623561 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2259665-42bf-4103-be2c-600845cb13bd admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:54.624074 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2259665-42bf-4103-be2c-600845cb13bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:54.624397 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2259665-42bf-4103-be2c-600845cb13bd admin admin] PATH_INFO: `/v3/projects` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:54.625099 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2259665-42bf-4103-be2c-600845cb13bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:54:54.626995 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2259665-42bf-4103-be2c-600845cb13bd admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:54:54.768133 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1324/2669] 10.222.0.102 () {60 vars in 1158 bytes} [Mon Aug 1 15:54:54 2022] POST /identity/v3/projects => generated 388 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:54:54.772395 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d07c9e-72ac-46fc-8bee-b73d1d52202a admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:54:54.782398 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d07c9e-72ac-46fc-8bee-b73d1d52202a admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:54:54.847669 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacb68f6-3ecd-4a6c-b023-2366f6ae53ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:54:54.848284 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacb68f6-3ecd-4a6c-b023-2366f6ae53ad admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:54.848559 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacb68f6-3ecd-4a6c-b023-2366f6ae53ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:54.848834 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacb68f6-3ecd-4a6c-b023-2366f6ae53ad admin admin] PATH_INFO: `/v3/users` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:54.849530 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacb68f6-3ecd-4a6c-b023-2366f6ae53ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:54:54.851482 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacb68f6-3ecd-4a6c-b023-2366f6ae53ad admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:54:54.942214 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1346/2670] 10.222.0.102 () {60 vars in 1149 bytes} [Mon Aug 1 15:54:54 2022] POST /identity/v3/users => generated 295 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:54:54.946208 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2259665-42bf-4103-be2c-600845cb13bd admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:54:54.956777 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2259665-42bf-4103-be2c-600845cb13bd admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:54:54.961404 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc67735-9421-4b0c-88bc-72aea5543e3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:54:54.962010 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc67735-9421-4b0c-88bc-72aea5543e3c admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:54.962292 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc67735-9421-4b0c-88bc-72aea5543e3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:54.962566 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc67735-9421-4b0c-88bc-72aea5543e3c admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:54.963256 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc67735-9421-4b0c-88bc-72aea5543e3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:54:54.964873 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc67735-9421-4b0c-88bc-72aea5543e3c admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:54:54.974855 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1325/2671] 10.222.0.102 () {58 vars in 1127 bytes} [Mon Aug 1 15:54:54 2022] GET /identity/v3/roles => generated 1427 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:54:54.978714 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacb68f6-3ecd-4a6c-b023-2366f6ae53ad admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:54:54.990735 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacb68f6-3ecd-4a6c-b023-2366f6ae53ad admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:54:54.995430 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c03e7c4-ef4a-4557-bf27-bef289160fae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:54:54.996030 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c03e7c4-ef4a-4557-bf27-bef289160fae admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:54.996301 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c03e7c4-ef4a-4557-bf27-bef289160fae admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:54.996570 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c03e7c4-ef4a-4557-bf27-bef289160fae admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:54.998077 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c03e7c4-ef4a-4557-bf27-bef289160fae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:54:54.999661 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c03e7c4-ef4a-4557-bf27-bef289160fae admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:54:55.010522 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1347/2672] 10.222.0.102 () {58 vars in 1127 bytes} [Mon Aug 1 15:54:54 2022] GET /identity/v3/roles => generated 1427 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:54:55.014732 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc67735-9421-4b0c-88bc-72aea5543e3c admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:54:55.025124 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc67735-9421-4b0c-88bc-72aea5543e3c admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:54:55.029750 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042791d4-f07b-40ce-9735-da13f3d2d6c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:54:55.030405 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042791d4-f07b-40ce-9735-da13f3d2d6c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:55.030687 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042791d4-f07b-40ce-9735-da13f3d2d6c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:55.030960 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042791d4-f07b-40ce-9735-da13f3d2d6c0 admin admin] PATH_INFO: `/v3/projects/5d0a8c34aeb84ecb965fc109118745fd/users/9b4dcdde076442f1b764f382a7c3e964/roles/27f5093ac0674d799cdbd17c68482e32` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:55.047144 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042791d4-f07b-40ce-9735-da13f3d2d6c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d0a8c34aeb84ecb965fc109118745fd, user_id=9b4dcdde076442f1b764f382a7c3e964, role_id=27f5093ac0674d799cdbd17c68482e32)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:54:55.049856 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042791d4-f07b-40ce-9735-da13f3d2d6c0 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:54:55.157955 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1326/2673] 10.222.0.102 () {60 vars in 1488 bytes} [Mon Aug 1 15:54:55 2022] PUT /identity/v3/projects/5d0a8c34aeb84ecb965fc109118745fd/users/9b4dcdde076442f1b764f382a7c3e964/roles/27f5093ac0674d799cdbd17c68482e32 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:54:55.169563 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeef782-b18d-4e1c-9935-373d75737ebc None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:55.175609 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeef782-b18d-4e1c-9935-373d75737ebc None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:55.175609 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeef782-b18d-4e1c-9935-373d75737ebc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:55.199726 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-afeef782-b18d-4e1c-9935-373d75737ebc None None] MFA Rules not processed for user `9b4dcdde076442f1b764f382a7c3e964`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:54:55.201463 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-afeef782-b18d-4e1c-9935-373d75737ebc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:54:55.225797 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:DELETE=3,keystone:SELECT=93,keystone:INSERT=4 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:54:55.267716 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1348/2674] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:54:55 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:54:55.272323 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042791d4-f07b-40ce-9735-da13f3d2d6c0 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:54:55.336737 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042791d4-f07b-40ce-9735-da13f3d2d6c0 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:54:55.344008 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8b9e8b-1f3f-4557-831e-0ec5f2aeac91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:54:55.353491 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8b9e8b-1f3f-4557-831e-0ec5f2aeac91 admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:55.353491 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8b9e8b-1f3f-4557-831e-0ec5f2aeac91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:55.353491 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8b9e8b-1f3f-4557-831e-0ec5f2aeac91 admin admin] PATH_INFO: `/v3/projects` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:55.353491 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8b9e8b-1f3f-4557-831e-0ec5f2aeac91 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:54:55.353491 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8b9e8b-1f3f-4557-831e-0ec5f2aeac91 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:54:55.361242 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:54:55.412077 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1327/2675] 10.222.0.102 () {60 vars in 1158 bytes} [Mon Aug 1 15:54:55 2022] POST /identity/v3/projects => generated 388 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:54:55.416993 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afeef782-b18d-4e1c-9935-373d75737ebc None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:54:55.428051 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afeef782-b18d-4e1c-9935-373d75737ebc None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:54:55.485211 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b66bd9-b901-4ae2-aa2c-3a01fab9e56b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:54:55.485879 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b66bd9-b901-4ae2-aa2c-3a01fab9e56b admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:55.486096 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b66bd9-b901-4ae2-aa2c-3a01fab9e56b admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:55.486365 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b66bd9-b901-4ae2-aa2c-3a01fab9e56b admin admin] PATH_INFO: `/v3/users` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:55.487033 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b66bd9-b901-4ae2-aa2c-3a01fab9e56b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:54:55.488975 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b66bd9-b901-4ae2-aa2c-3a01fab9e56b admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:54:55.611784 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1349/2676] 10.222.0.102 () {60 vars in 1149 bytes} [Mon Aug 1 15:54:55 2022] POST /identity/v3/users => generated 301 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 15:54:55.615984 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8b9e8b-1f3f-4557-831e-0ec5f2aeac91 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:54:55.632489 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8b9e8b-1f3f-4557-831e-0ec5f2aeac91 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:54:55.637661 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895f522b-3271-479e-8678-ced1680a74c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:54:55.638885 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895f522b-3271-479e-8678-ced1680a74c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:55.639162 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895f522b-3271-479e-8678-ced1680a74c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:55.639426 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895f522b-3271-479e-8678-ced1680a74c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:55.640112 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895f522b-3271-479e-8678-ced1680a74c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:54:55.641744 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895f522b-3271-479e-8678-ced1680a74c2 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:54:55.652101 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1328/2677] 10.222.0.102 () {58 vars in 1127 bytes} [Mon Aug 1 15:54:55 2022] GET /identity/v3/roles => generated 1427 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:54:55.656910 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b66bd9-b901-4ae2-aa2c-3a01fab9e56b admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:54:55.668228 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b66bd9-b901-4ae2-aa2c-3a01fab9e56b admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:54:55.673695 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b648a74-7d20-4a2f-8d8d-f61ad2a98ef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:54:55.674356 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b648a74-7d20-4a2f-8d8d-f61ad2a98ef3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:55.674631 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b648a74-7d20-4a2f-8d8d-f61ad2a98ef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:55.674899 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b648a74-7d20-4a2f-8d8d-f61ad2a98ef3 admin admin] PATH_INFO: `/v3/projects/bfa8049f112a48b889dfd9653b605cd1/users/a32dc93dd09049f3a759108a6b70d280/roles/de1374f966c04c27b579515b54334fd2` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:55.691176 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b648a74-7d20-4a2f-8d8d-f61ad2a98ef3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bfa8049f112a48b889dfd9653b605cd1, user_id=a32dc93dd09049f3a759108a6b70d280, role_id=de1374f966c04c27b579515b54334fd2)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:54:55.694020 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b648a74-7d20-4a2f-8d8d-f61ad2a98ef3 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:54:55.777080 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1350/2678] 10.222.0.102 () {60 vars in 1488 bytes} [Mon Aug 1 15:54:55 2022] PUT /identity/v3/projects/bfa8049f112a48b889dfd9653b605cd1/users/a32dc93dd09049f3a759108a6b70d280/roles/de1374f966c04c27b579515b54334fd2 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:54:55.781274 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895f522b-3271-479e-8678-ced1680a74c2 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:54:55.791490 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895f522b-3271-479e-8678-ced1680a74c2 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:54:55.848834 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ecc47f-0a39-4a92-8b1d-8e06d5158c13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:54:55.849469 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ecc47f-0a39-4a92-8b1d-8e06d5158c13 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:55.849884 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ecc47f-0a39-4a92-8b1d-8e06d5158c13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:55.850155 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ecc47f-0a39-4a92-8b1d-8e06d5158c13 admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:55.850848 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ecc47f-0a39-4a92-8b1d-8e06d5158c13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:54:55.852438 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ecc47f-0a39-4a92-8b1d-8e06d5158c13 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:54:55.864972 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1329/2679] 10.222.0.102 () {58 vars in 1127 bytes} [Mon Aug 1 15:54:55 2022] GET /identity/v3/roles => generated 1427 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:54:55.867312 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b648a74-7d20-4a2f-8d8d-f61ad2a98ef3 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:54:55.879282 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b648a74-7d20-4a2f-8d8d-f61ad2a98ef3 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:54:55.883986 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9dc75d-ec90-45ce-981a-7506d22f0671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:54:55.884649 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9dc75d-ec90-45ce-981a-7506d22f0671 admin admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:55.884958 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9dc75d-ec90-45ce-981a-7506d22f0671 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:55.885232 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9dc75d-ec90-45ce-981a-7506d22f0671 admin admin] PATH_INFO: `/v3/projects/bfa8049f112a48b889dfd9653b605cd1/users/a32dc93dd09049f3a759108a6b70d280/roles/de1374f966c04c27b579515b54334fd2` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:55.887214 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9dc75d-ec90-45ce-981a-7506d22f0671 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bfa8049f112a48b889dfd9653b605cd1, user_id=a32dc93dd09049f3a759108a6b70d280, role_id=de1374f966c04c27b579515b54334fd2)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:54:55.890651 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9dc75d-ec90-45ce-981a-7506d22f0671 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:54:55.900781 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1351/2680] 10.222.0.102 () {60 vars in 1488 bytes} [Mon Aug 1 15:54:55 2022] PUT /identity/v3/projects/bfa8049f112a48b889dfd9653b605cd1/users/a32dc93dd09049f3a759108a6b70d280/roles/de1374f966c04c27b579515b54334fd2 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:54:55.911151 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187f719c-65a5-4654-bbbc-74bbd09f789a None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:55.913112 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187f719c-65a5-4654-bbbc-74bbd09f789a None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:55.913112 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187f719c-65a5-4654-bbbc-74bbd09f789a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:55.940517 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-187f719c-65a5-4654-bbbc-74bbd09f789a None None] MFA Rules not processed for user `a32dc93dd09049f3a759108a6b70d280`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:54:55.941639 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-187f719c-65a5-4654-bbbc-74bbd09f789a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:54:56.019710 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ac417a-ace6-4fd2-af44-63bdd1766f7e None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:56.020249 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ac417a-ace6-4fd2-af44-63bdd1766f7e None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:56.020837 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ac417a-ace6-4fd2-af44-63bdd1766f7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:56.034551 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1330/2681] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:54:55 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:54:56.051136 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187f719c-65a5-4654-bbbc-74bbd09f789a None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:54:56.053184 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-187f719c-65a5-4654-bbbc-74bbd09f789a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:54:56.060955 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-92ac417a-ace6-4fd2-af44-63bdd1766f7e None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:54:56.064419 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-92ac417a-ace6-4fd2-af44-63bdd1766f7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:54:56.120458 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187f719c-65a5-4654-bbbc-74bbd09f789a None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:54:56.124663 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a239a98b-f5cb-4721-8ccc-fd94b513afd8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff810b37183c4729859c1b05edff1703', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:54:56.125532 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a239a98b-f5cb-4721-8ccc-fd94b513afd8 service cinder] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:56.125654 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a239a98b-f5cb-4721-8ccc-fd94b513afd8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:56.125839 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a239a98b-f5cb-4721-8ccc-fd94b513afd8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:56.128025 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1352/2682] 10.222.0.65 () {58 vars in 1020 bytes} [Mon Aug 1 15:54:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 15:54:56.135217 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a239a98b-f5cb-4721-8ccc-fd94b513afd8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:54:56.136684 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a239a98b-f5cb-4721-8ccc-fd94b513afd8 service cinder] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:54:56.148152 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1331/2683] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:54:56 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 15:54:56.149485 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ac417a-ace6-4fd2-af44-63bdd1766f7e None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:54:56.150863 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-92ac417a-ace6-4fd2-af44-63bdd1766f7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:54:56.171254 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:54:56.230636 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ac417a-ace6-4fd2-af44-63bdd1766f7e None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:54:56.238500 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6acf054-ac95-47a7-98cf-0a98d414d865 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77b43f1ee8cc4be3907a494abe90c1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:54:56.239465 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6acf054-ac95-47a7-98cf-0a98d414d865 service nova] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:56.239819 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6acf054-ac95-47a7-98cf-0a98d414d865 service nova] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:56.240160 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6acf054-ac95-47a7-98cf-0a98d414d865 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:56.254030 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6acf054-ac95-47a7-98cf-0a98d414d865 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:54:56.255792 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6acf054-ac95-47a7-98cf-0a98d414d865 service nova] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:54:56.268070 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1353/2684] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:54:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 15:54:56.305016 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a239a98b-f5cb-4721-8ccc-fd94b513afd8 service cinder] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:54:56.314241 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:54:56.317828 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a239a98b-f5cb-4721-8ccc-fd94b513afd8 service cinder] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:54:56.322647 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bbe857-4fc0-4f8a-ae55-5ece6d20381c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:54:56.323380 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bbe857-4fc0-4f8a-ae55-5ece6d20381c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:56.323662 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bbe857-4fc0-4f8a-ae55-5ece6d20381c admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:56.323931 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bbe857-4fc0-4f8a-ae55-5ece6d20381c admin admin] PATH_INFO: `/v3/users/9b4dcdde076442f1b764f382a7c3e964` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:56.326668 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bbe857-4fc0-4f8a-ae55-5ece6d20381c admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b4dcdde076442f1b764f382a7c3e964)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:54:56.328170 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bbe857-4fc0-4f8a-ae55-5ece6d20381c admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:54:56.509344 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-25bbe857-4fc0-4f8a-ae55-5ece6d20381c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b4dcdde076442f1b764f382a7c3e964'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:54:56.585725 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-25bbe857-4fc0-4f8a-ae55-5ece6d20381c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b4dcdde076442f1b764f382a7c3e964'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:54:56.599072 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-25bbe857-4fc0-4f8a-ae55-5ece6d20381c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b4dcdde076442f1b764f382a7c3e964'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:54:56.599765 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-25bbe857-4fc0-4f8a-ae55-5ece6d20381c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b4dcdde076442f1b764f382a7c3e964'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:54:56.600372 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-25bbe857-4fc0-4f8a-ae55-5ece6d20381c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b4dcdde076442f1b764f382a7c3e964'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:54:56.613322 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1332/2685] 10.222.0.102 () {58 vars in 1229 bytes} [Mon Aug 1 15:54:56 2022] DELETE /identity/v3/users/9b4dcdde076442f1b764f382a7c3e964 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:54:56.618003 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dff1f2f-4111-457d-b954-b17699dbadbb None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:56.618478 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dff1f2f-4111-457d-b954-b17699dbadbb None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:56.618598 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dff1f2f-4111-457d-b954-b17699dbadbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:56.639148 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-2dff1f2f-4111-457d-b954-b17699dbadbb None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:54:56.643007 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-2dff1f2f-4111-457d-b954-b17699dbadbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:54:56.720791 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1354/2686] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:54:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:54:56.730969 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bbe857-4fc0-4f8a-ae55-5ece6d20381c admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:54:56.732382 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-25bbe857-4fc0-4f8a-ae55-5ece6d20381c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:54:56.793027 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bbe857-4fc0-4f8a-ae55-5ece6d20381c admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:54:56.796756 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffe0c88-4a2f-4f79-8b01-fb8ceb8083f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a856a413100443939fe9b10daa868518', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:54:56.797404 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffe0c88-4a2f-4f79-8b01-fb8ceb8083f3 service neutron] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:56.797685 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffe0c88-4a2f-4f79-8b01-fb8ceb8083f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:56.797960 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffe0c88-4a2f-4f79-8b01-fb8ceb8083f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:56.807506 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffe0c88-4a2f-4f79-8b01-fb8ceb8083f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:54:56.809018 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffe0c88-4a2f-4f79-8b01-fb8ceb8083f3 service neutron] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:54:56.819126 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1333/2687] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:54:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:54:57.229552 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dff1f2f-4111-457d-b954-b17699dbadbb None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:54:57.230973 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-2dff1f2f-4111-457d-b954-b17699dbadbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:54:57.245952 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dff1f2f-4111-457d-b954-b17699dbadbb None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:54:57.251241 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55f7d7a-9d6e-429e-820f-68b0bc4b4916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:54:57.251893 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55f7d7a-9d6e-429e-820f-68b0bc4b4916 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:57.252169 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55f7d7a-9d6e-429e-820f-68b0bc4b4916 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:57.252439 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55f7d7a-9d6e-429e-820f-68b0bc4b4916 admin admin] PATH_INFO: `/v3/projects/5d0a8c34aeb84ecb965fc109118745fd` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:57.254730 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55f7d7a-9d6e-429e-820f-68b0bc4b4916 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d0a8c34aeb84ecb965fc109118745fd)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:54:57.256813 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55f7d7a-9d6e-429e-820f-68b0bc4b4916 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:54:57.375247 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-b55f7d7a-9d6e-429e-820f-68b0bc4b4916 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d0a8c34aeb84ecb965fc109118745fd', 'request_id': 'req-b55f7d7a-9d6e-429e-820f-68b0bc4b4916'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:54:57.381869 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-b55f7d7a-9d6e-429e-820f-68b0bc4b4916 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d0a8c34aeb84ecb965fc109118745fd', 'request_id': 'req-b55f7d7a-9d6e-429e-820f-68b0bc4b4916'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:54:57.448392 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-b55f7d7a-9d6e-429e-820f-68b0bc4b4916 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d0a8c34aeb84ecb965fc109118745fd', 'request_id': 'req-b55f7d7a-9d6e-429e-820f-68b0bc4b4916'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:54:57.459563 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-b55f7d7a-9d6e-429e-820f-68b0bc4b4916 admin admin] The token cache is being invalidate because project 5d0a8c34aeb84ecb965fc109118745fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80352) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 15:54:57.459851 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-b55f7d7a-9d6e-429e-820f-68b0bc4b4916 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:54:57.460487 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-b55f7d7a-9d6e-429e-820f-68b0bc4b4916 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:54:57.462038 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1355/2688] 10.222.0.102 () {58 vars in 1238 bytes} [Mon Aug 1 15:54:57 2022] DELETE /identity/v3/projects/5d0a8c34aeb84ecb965fc109118745fd => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:54:57.466036 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffe0c88-4a2f-4f79-8b01-fb8ceb8083f3 service neutron] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:54:57.476304 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffe0c88-4a2f-4f79-8b01-fb8ceb8083f3 service neutron] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:54:57.533186 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab44aa8e-aa70-458f-b68f-d8edd08f107c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:54:57.533829 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab44aa8e-aa70-458f-b68f-d8edd08f107c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:57.534109 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab44aa8e-aa70-458f-b68f-d8edd08f107c admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:57.534384 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab44aa8e-aa70-458f-b68f-d8edd08f107c admin admin] PATH_INFO: `/v3/users/a32dc93dd09049f3a759108a6b70d280` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:57.535544 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab44aa8e-aa70-458f-b68f-d8edd08f107c admin admin] RBAC: Authorizing `identity:delete_user(user_id=a32dc93dd09049f3a759108a6b70d280)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:54:57.537555 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab44aa8e-aa70-458f-b68f-d8edd08f107c admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:54:57.559631 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:54:57.752873 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-ab44aa8e-aa70-458f-b68f-d8edd08f107c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a32dc93dd09049f3a759108a6b70d280'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:54:57.837070 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-ab44aa8e-aa70-458f-b68f-d8edd08f107c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a32dc93dd09049f3a759108a6b70d280'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:54:57.852221 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-ab44aa8e-aa70-458f-b68f-d8edd08f107c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a32dc93dd09049f3a759108a6b70d280'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:54:57.852994 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-ab44aa8e-aa70-458f-b68f-d8edd08f107c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a32dc93dd09049f3a759108a6b70d280'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:54:57.853598 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-ab44aa8e-aa70-458f-b68f-d8edd08f107c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a32dc93dd09049f3a759108a6b70d280'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:54:57.866821 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1334/2689] 10.222.0.102 () {58 vars in 1229 bytes} [Mon Aug 1 15:54:57 2022] DELETE /identity/v3/users/a32dc93dd09049f3a759108a6b70d280 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:54:58.275783 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55f7d7a-9d6e-429e-820f-68b0bc4b4916 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:54:58.277297 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-b55f7d7a-9d6e-429e-820f-68b0bc4b4916 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:54:58.292092 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55f7d7a-9d6e-429e-820f-68b0bc4b4916 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:54:58.319619 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:54:58.352295 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fa0534-9362-47da-978c-845bcff8106c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:54:58.352963 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fa0534-9362-47da-978c-845bcff8106c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:58.353290 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fa0534-9362-47da-978c-845bcff8106c admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:58.353564 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fa0534-9362-47da-978c-845bcff8106c admin admin] PATH_INFO: `/v3/projects/bfa8049f112a48b889dfd9653b605cd1` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:58.354757 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fa0534-9362-47da-978c-845bcff8106c admin admin] RBAC: Authorizing `identity:delete_project(project_id=bfa8049f112a48b889dfd9653b605cd1)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:54:58.357094 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fa0534-9362-47da-978c-845bcff8106c admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:54:58.490281 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-43fa0534-9362-47da-978c-845bcff8106c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bfa8049f112a48b889dfd9653b605cd1', 'request_id': 'req-43fa0534-9362-47da-978c-845bcff8106c'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:54:58.496474 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-43fa0534-9362-47da-978c-845bcff8106c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bfa8049f112a48b889dfd9653b605cd1', 'request_id': 'req-43fa0534-9362-47da-978c-845bcff8106c'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:54:58.574255 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-43fa0534-9362-47da-978c-845bcff8106c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bfa8049f112a48b889dfd9653b605cd1', 'request_id': 'req-43fa0534-9362-47da-978c-845bcff8106c'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:54:58.586791 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-43fa0534-9362-47da-978c-845bcff8106c admin admin] The token cache is being invalidate because project bfa8049f112a48b889dfd9653b605cd1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80352) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 15:54:58.587078 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-43fa0534-9362-47da-978c-845bcff8106c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:54:58.587724 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-43fa0534-9362-47da-978c-845bcff8106c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:54:58.589329 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1356/2690] 10.222.0.102 () {58 vars in 1238 bytes} [Mon Aug 1 15:54:58 2022] DELETE /identity/v3/projects/bfa8049f112a48b889dfd9653b605cd1 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:54:58.594145 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025618d1-c2dd-4254-9b7d-42f3c786a765 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:58.594601 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025618d1-c2dd-4254-9b7d-42f3c786a765 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:58.594746 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025618d1-c2dd-4254-9b7d-42f3c786a765 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:58.614312 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-025618d1-c2dd-4254-9b7d-42f3c786a765 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:54:58.615570 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-025618d1-c2dd-4254-9b7d-42f3c786a765 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:54:58.675870 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1335/2691] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:54:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:54:58.683840 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb977694-e56a-4d6a-86dc-62ffbba36a1b None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:58.684374 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb977694-e56a-4d6a-86dc-62ffbba36a1b None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:58.685297 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb977694-e56a-4d6a-86dc-62ffbba36a1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:58.707439 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-fb977694-e56a-4d6a-86dc-62ffbba36a1b None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:54:58.708655 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-fb977694-e56a-4d6a-86dc-62ffbba36a1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:54:58.716637 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1357/2692] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:54:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:54:58.721099 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025618d1-c2dd-4254-9b7d-42f3c786a765 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:54:58.731196 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025618d1-c2dd-4254-9b7d-42f3c786a765 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:54:58.736305 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e5da50-9c9f-4607-918a-98b2d5bdbf6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:54:58.736946 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e5da50-9c9f-4607-918a-98b2d5bdbf6d admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:58.737228 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e5da50-9c9f-4607-918a-98b2d5bdbf6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:58.737528 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e5da50-9c9f-4607-918a-98b2d5bdbf6d admin admin] PATH_INFO: `/v3/domains` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:58.738249 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e5da50-9c9f-4607-918a-98b2d5bdbf6d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:54:58.738599 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e5da50-9c9f-4607-918a-98b2d5bdbf6d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:54:58.740194 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e5da50-9c9f-4607-918a-98b2d5bdbf6d admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:54:58.752420 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1336/2693] 10.222.0.102 () {58 vars in 1158 bytes} [Mon Aug 1 15:54:58 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:54:58.758227 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb977694-e56a-4d6a-86dc-62ffbba36a1b None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:54:58.767834 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb977694-e56a-4d6a-86dc-62ffbba36a1b None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:54:58.772528 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5438b292-e3fc-4b00-b243-d24a419d692b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:54:58.773157 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5438b292-e3fc-4b00-b243-d24a419d692b admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:58.773436 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5438b292-e3fc-4b00-b243-d24a419d692b admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:58.773709 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5438b292-e3fc-4b00-b243-d24a419d692b admin admin] PATH_INFO: `/v3/projects` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:58.774404 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5438b292-e3fc-4b00-b243-d24a419d692b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:54:58.776301 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5438b292-e3fc-4b00-b243-d24a419d692b admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:54:58.869460 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1358/2694] 10.222.0.102 () {60 vars in 1158 bytes} [Mon Aug 1 15:54:58 2022] POST /identity/v3/projects => generated 374 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:54:58.874541 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e5da50-9c9f-4607-918a-98b2d5bdbf6d admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:54:58.884802 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e5da50-9c9f-4607-918a-98b2d5bdbf6d admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:54:58.942024 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c14a49-2778-4366-a7f4-15bf72357513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:54:58.942638 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c14a49-2778-4366-a7f4-15bf72357513 admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:58.942920 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c14a49-2778-4366-a7f4-15bf72357513 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:58.943192 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c14a49-2778-4366-a7f4-15bf72357513 admin admin] PATH_INFO: `/v3/users` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:58.943856 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c14a49-2778-4366-a7f4-15bf72357513 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:54:58.945804 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c14a49-2778-4366-a7f4-15bf72357513 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:54:59.046100 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1337/2695] 10.222.0.102 () {60 vars in 1149 bytes} [Mon Aug 1 15:54:58 2022] POST /identity/v3/users => generated 288 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:54:59.050235 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5438b292-e3fc-4b00-b243-d24a419d692b admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:54:59.061099 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5438b292-e3fc-4b00-b243-d24a419d692b admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:54:59.065899 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c89745e-8ce6-4bf3-92eb-3350e44e1349 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:54:59.066580 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c89745e-8ce6-4bf3-92eb-3350e44e1349 admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:59.066938 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c89745e-8ce6-4bf3-92eb-3350e44e1349 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:59.067203 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c89745e-8ce6-4bf3-92eb-3350e44e1349 admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:59.067923 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c89745e-8ce6-4bf3-92eb-3350e44e1349 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:54:59.069666 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c89745e-8ce6-4bf3-92eb-3350e44e1349 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:54:59.080724 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1359/2696] 10.222.0.102 () {58 vars in 1127 bytes} [Mon Aug 1 15:54:59 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:54:59.084820 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c14a49-2778-4366-a7f4-15bf72357513 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:54:59.095581 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c14a49-2778-4366-a7f4-15bf72357513 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:54:59.100240 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb03f139-105a-4aa5-9a75-c95682026430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:54:59.100867 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb03f139-105a-4aa5-9a75-c95682026430 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:59.101147 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb03f139-105a-4aa5-9a75-c95682026430 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:59.101421 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb03f139-105a-4aa5-9a75-c95682026430 admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:59.102207 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb03f139-105a-4aa5-9a75-c95682026430 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:54:59.103727 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb03f139-105a-4aa5-9a75-c95682026430 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:54:59.118725 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1338/2697] 10.222.0.102 () {58 vars in 1127 bytes} [Mon Aug 1 15:54:59 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:54:59.119812 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c89745e-8ce6-4bf3-92eb-3350e44e1349 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:54:59.130261 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c89745e-8ce6-4bf3-92eb-3350e44e1349 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:54:59.134897 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c136af15-aede-43a7-9d3e-7610a772488f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:54:59.135547 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c136af15-aede-43a7-9d3e-7610a772488f admin admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:59.135824 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c136af15-aede-43a7-9d3e-7610a772488f admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:59.136099 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c136af15-aede-43a7-9d3e-7610a772488f admin admin] PATH_INFO: `/v3/projects/30486a035e874b26b0ead13de6225e30/users/b2f73e2aa3744667bf16d5a303151284/roles/27f5093ac0674d799cdbd17c68482e32` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:59.150709 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c136af15-aede-43a7-9d3e-7610a772488f admin admin] RBAC: Authorizing `identity:create_grant(project_id=30486a035e874b26b0ead13de6225e30, user_id=b2f73e2aa3744667bf16d5a303151284, role_id=27f5093ac0674d799cdbd17c68482e32)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:54:59.155012 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c136af15-aede-43a7-9d3e-7610a772488f admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:54:59.257366 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1360/2698] 10.222.0.102 () {60 vars in 1488 bytes} [Mon Aug 1 15:54:59 2022] PUT /identity/v3/projects/30486a035e874b26b0ead13de6225e30/users/b2f73e2aa3744667bf16d5a303151284/roles/27f5093ac0674d799cdbd17c68482e32 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 15:54:59.262369 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c135dd53-f2f8-41ee-b17e-7889c6795d8b None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:59.262655 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c135dd53-f2f8-41ee-b17e-7889c6795d8b None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:59.262948 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c135dd53-f2f8-41ee-b17e-7889c6795d8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:59.271063 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:54:59.282151 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-c135dd53-f2f8-41ee-b17e-7889c6795d8b None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:54:59.283484 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-c135dd53-f2f8-41ee-b17e-7889c6795d8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:54:59.342801 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1339/2699] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:54:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:54:59.352561 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c136af15-aede-43a7-9d3e-7610a772488f admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:54:59.354279 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-c136af15-aede-43a7-9d3e-7610a772488f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:54:59.414344 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c136af15-aede-43a7-9d3e-7610a772488f admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:54:59.418423 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df62307-0a1c-4288-866a-fa1ab524156e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a856a413100443939fe9b10daa868518', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:54:59.423572 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df62307-0a1c-4288-866a-fa1ab524156e service neutron] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:59.423572 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df62307-0a1c-4288-866a-fa1ab524156e service neutron] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:59.423572 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df62307-0a1c-4288-866a-fa1ab524156e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:59.427324 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:54:59.429544 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df62307-0a1c-4288-866a-fa1ab524156e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:54:59.430971 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df62307-0a1c-4288-866a-fa1ab524156e service neutron] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:54:59.441128 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1361/2700] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:54:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:54:59.717946 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c135dd53-f2f8-41ee-b17e-7889c6795d8b None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:54:59.720376 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-c135dd53-f2f8-41ee-b17e-7889c6795d8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:54:59.732285 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c135dd53-f2f8-41ee-b17e-7889c6795d8b None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:54:59.737434 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd825c07-3acb-400a-9d1b-20e3edd7af9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:54:59.738205 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd825c07-3acb-400a-9d1b-20e3edd7af9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:54:59.738688 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd825c07-3acb-400a-9d1b-20e3edd7af9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:54:59.743319 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd825c07-3acb-400a-9d1b-20e3edd7af9e admin admin] PATH_INFO: `/v3/users/f9684c6051a0449b9e49ac81c6666ba4` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:54:59.743319 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd825c07-3acb-400a-9d1b-20e3edd7af9e admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9684c6051a0449b9e49ac81c6666ba4)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:54:59.743319 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd825c07-3acb-400a-9d1b-20e3edd7af9e admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:54:59.990553 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-fd825c07-3acb-400a-9d1b-20e3edd7af9e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9684c6051a0449b9e49ac81c6666ba4'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:55:00.085204 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-fd825c07-3acb-400a-9d1b-20e3edd7af9e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9684c6051a0449b9e49ac81c6666ba4'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:55:00.099401 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-fd825c07-3acb-400a-9d1b-20e3edd7af9e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9684c6051a0449b9e49ac81c6666ba4'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:55:00.100122 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-fd825c07-3acb-400a-9d1b-20e3edd7af9e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9684c6051a0449b9e49ac81c6666ba4'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:55:00.100772 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-fd825c07-3acb-400a-9d1b-20e3edd7af9e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9684c6051a0449b9e49ac81c6666ba4'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:55:00.114836 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1340/2701] 10.222.0.102 () {58 vars in 1229 bytes} [Mon Aug 1 15:54:59 2022] DELETE /identity/v3/users/f9684c6051a0449b9e49ac81c6666ba4 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:55:00.119454 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1f09d6-7ff6-4023-9647-790e0c706de6 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:55:00.119734 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1f09d6-7ff6-4023-9647-790e0c706de6 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:55:00.120005 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1f09d6-7ff6-4023-9647-790e0c706de6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:55:00.142981 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-cb1f09d6-7ff6-4023-9647-790e0c706de6 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:55:00.144252 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-cb1f09d6-7ff6-4023-9647-790e0c706de6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:55:00.242263 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1362/2702] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:55:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:55:00.252555 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd825c07-3acb-400a-9d1b-20e3edd7af9e admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:55:00.254005 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-fd825c07-3acb-400a-9d1b-20e3edd7af9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:55:00.314016 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd825c07-3acb-400a-9d1b-20e3edd7af9e admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:55:00.317980 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e354025-cf93-4803-9d00-70dc7e8911a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a856a413100443939fe9b10daa868518', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:55:00.318692 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e354025-cf93-4803-9d00-70dc7e8911a4 service neutron] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:55:00.318983 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e354025-cf93-4803-9d00-70dc7e8911a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:55:00.319258 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e354025-cf93-4803-9d00-70dc7e8911a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:55:00.329831 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e354025-cf93-4803-9d00-70dc7e8911a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:55:00.331336 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e354025-cf93-4803-9d00-70dc7e8911a4 service neutron] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:55:00.341710 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1341/2703] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:55:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:55:00.369214 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05d8a93-3af7-47e6-96c9-ff53ed35b07b None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:55:00.369715 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05d8a93-3af7-47e6-96c9-ff53ed35b07b None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:55:00.369804 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05d8a93-3af7-47e6-96c9-ff53ed35b07b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:55:00.397904 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-b05d8a93-3af7-47e6-96c9-ff53ed35b07b None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:55:00.399401 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-b05d8a93-3af7-47e6-96c9-ff53ed35b07b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:55:00.408203 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1363/2704] 10.222.0.65 () {58 vars in 1020 bytes} [Mon Aug 1 15:55:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:55:00.433295 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e354025-cf93-4803-9d00-70dc7e8911a4 service neutron] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:55:00.436494 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-8e354025-cf93-4803-9d00-70dc7e8911a4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:55:00.479836 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:55:00.533683 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e354025-cf93-4803-9d00-70dc7e8911a4 service neutron] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:55:00.539408 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95311d9-c482-4bf5-a67b-951222fd87a6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77b43f1ee8cc4be3907a494abe90c1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:55:00.540024 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95311d9-c482-4bf5-a67b-951222fd87a6 service nova] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:55:00.540303 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95311d9-c482-4bf5-a67b-951222fd87a6 service nova] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:55:00.540571 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95311d9-c482-4bf5-a67b-951222fd87a6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:55:00.550794 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95311d9-c482-4bf5-a67b-951222fd87a6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:55:00.552643 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95311d9-c482-4bf5-a67b-951222fd87a6 service nova] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:55:00.563701 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1342/2705] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:55:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:55:00.764009 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7583be9e-1f22-4240-9e5d-914270975026 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:55:00.764326 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7583be9e-1f22-4240-9e5d-914270975026 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:55:00.764603 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7583be9e-1f22-4240-9e5d-914270975026 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:55:00.789235 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95311d9-c482-4bf5-a67b-951222fd87a6 service nova] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:55:00.791217 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-d95311d9-c482-4bf5-a67b-951222fd87a6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:55:00.804642 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-7583be9e-1f22-4240-9e5d-914270975026 None None] MFA Rules not processed for user `b2f73e2aa3744667bf16d5a303151284`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:55:00.806007 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-7583be9e-1f22-4240-9e5d-914270975026 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:55:00.806161 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95311d9-c482-4bf5-a67b-951222fd87a6 service nova] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:55:00.812490 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3460c5-29e6-4dfb-b206-a6794ce12d43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:55:00.813370 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3460c5-29e6-4dfb-b206-a6794ce12d43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:55:00.813883 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3460c5-29e6-4dfb-b206-a6794ce12d43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:55:00.814326 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3460c5-29e6-4dfb-b206-a6794ce12d43 admin admin] PATH_INFO: `/v3/projects/ad61839394444e9db32047fa7f6b80b0` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:55:00.816161 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3460c5-29e6-4dfb-b206-a6794ce12d43 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad61839394444e9db32047fa7f6b80b0)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:55:00.818822 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3460c5-29e6-4dfb-b206-a6794ce12d43 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:55:00.881422 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1364/2706] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:55:00 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:55:00.895847 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7583be9e-1f22-4240-9e5d-914270975026 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:55:00.897234 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-7583be9e-1f22-4240-9e5d-914270975026 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:55:00.928767 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-7e3460c5-29e6-4dfb-b206-a6794ce12d43 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad61839394444e9db32047fa7f6b80b0', 'request_id': 'req-7e3460c5-29e6-4dfb-b206-a6794ce12d43'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:55:00.957270 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7583be9e-1f22-4240-9e5d-914270975026 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:55:00.989056 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:55:01.005486 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a03c47a-1363-4220-b221-e67e545d320c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff810b37183c4729859c1b05edff1703', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:55:01.006095 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a03c47a-1363-4220-b221-e67e545d320c service cinder] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:55:01.006367 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a03c47a-1363-4220-b221-e67e545d320c service cinder] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:55:01.006633 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a03c47a-1363-4220-b221-e67e545d320c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:55:01.014526 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-7e3460c5-29e6-4dfb-b206-a6794ce12d43 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad61839394444e9db32047fa7f6b80b0', 'request_id': 'req-7e3460c5-29e6-4dfb-b206-a6794ce12d43'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:55:01.021123 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-7e3460c5-29e6-4dfb-b206-a6794ce12d43 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad61839394444e9db32047fa7f6b80b0', 'request_id': 'req-7e3460c5-29e6-4dfb-b206-a6794ce12d43'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:55:01.032713 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-7e3460c5-29e6-4dfb-b206-a6794ce12d43 admin admin] The token cache is being invalidate because project ad61839394444e9db32047fa7f6b80b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80353) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 15:55:01.033093 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-7e3460c5-29e6-4dfb-b206-a6794ce12d43 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:55:01.033783 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-7e3460c5-29e6-4dfb-b206-a6794ce12d43 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:55:01.035502 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1343/2707] 10.222.0.102 () {58 vars in 1238 bytes} [Mon Aug 1 15:55:00 2022] DELETE /identity/v3/projects/ad61839394444e9db32047fa7f6b80b0 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 15:55:01.039470 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3460c5-29e6-4dfb-b206-a6794ce12d43 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:55:01.041160 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-7e3460c5-29e6-4dfb-b206-a6794ce12d43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:55:01.065636 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a03c47a-1363-4220-b221-e67e545d320c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:55:01.067134 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a03c47a-1363-4220-b221-e67e545d320c service cinder] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:55:01.076739 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1365/2708] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:55:00 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 15:55:01.104223 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3460c5-29e6-4dfb-b206-a6794ce12d43 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:55:01.109039 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2397424-a99b-423c-84f2-89b5975c6377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:55:01.109747 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2397424-a99b-423c-84f2-89b5975c6377 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:55:01.110030 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2397424-a99b-423c-84f2-89b5975c6377 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:55:01.110301 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2397424-a99b-423c-84f2-89b5975c6377 admin admin] PATH_INFO: `/v3/users/8520d0147d2d4f76a5d7eda26a9f44d7` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:55:01.111576 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2397424-a99b-423c-84f2-89b5975c6377 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8520d0147d2d4f76a5d7eda26a9f44d7)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:55:01.113542 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2397424-a99b-423c-84f2-89b5975c6377 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:55:01.291842 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:55:01.304486 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-b2397424-a99b-423c-84f2-89b5975c6377 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8520d0147d2d4f76a5d7eda26a9f44d7'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:55:01.365393 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-b2397424-a99b-423c-84f2-89b5975c6377 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8520d0147d2d4f76a5d7eda26a9f44d7'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:55:01.380254 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-b2397424-a99b-423c-84f2-89b5975c6377 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8520d0147d2d4f76a5d7eda26a9f44d7'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:55:01.381026 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-b2397424-a99b-423c-84f2-89b5975c6377 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8520d0147d2d4f76a5d7eda26a9f44d7'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:55:01.381682 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-b2397424-a99b-423c-84f2-89b5975c6377 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8520d0147d2d4f76a5d7eda26a9f44d7'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:55:01.394790 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1344/2709] 10.222.0.102 () {58 vars in 1229 bytes} [Mon Aug 1 15:55:01 2022] DELETE /identity/v3/users/8520d0147d2d4f76a5d7eda26a9f44d7 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 15:55:01.833533 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a03c47a-1363-4220-b221-e67e545d320c service cinder] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:55:01.844635 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a03c47a-1363-4220-b221-e67e545d320c service cinder] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:55:01.903235 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b320b7d-dcc0-4e1b-8939-d3fa42edfb9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:55:01.903870 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b320b7d-dcc0-4e1b-8939-d3fa42edfb9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:55:01.904144 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b320b7d-dcc0-4e1b-8939-d3fa42edfb9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:55:01.904448 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b320b7d-dcc0-4e1b-8939-d3fa42edfb9b admin admin] PATH_INFO: `/v3/projects/a4259c8518034b9798149a76a3fb3e00` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:55:01.905646 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b320b7d-dcc0-4e1b-8939-d3fa42edfb9b admin admin] RBAC: Authorizing `identity:delete_project(project_id=a4259c8518034b9798149a76a3fb3e00)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:55:01.907530 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b320b7d-dcc0-4e1b-8939-d3fa42edfb9b admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:55:02.014647 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-7b320b7d-dcc0-4e1b-8939-d3fa42edfb9b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a4259c8518034b9798149a76a3fb3e00', 'request_id': 'req-7b320b7d-dcc0-4e1b-8939-d3fa42edfb9b'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:55:02.020784 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-7b320b7d-dcc0-4e1b-8939-d3fa42edfb9b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a4259c8518034b9798149a76a3fb3e00', 'request_id': 'req-7b320b7d-dcc0-4e1b-8939-d3fa42edfb9b'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:55:02.082768 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-7b320b7d-dcc0-4e1b-8939-d3fa42edfb9b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a4259c8518034b9798149a76a3fb3e00', 'request_id': 'req-7b320b7d-dcc0-4e1b-8939-d3fa42edfb9b'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:55:02.093872 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-7b320b7d-dcc0-4e1b-8939-d3fa42edfb9b admin admin] The token cache is being invalidate because project a4259c8518034b9798149a76a3fb3e00 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80352) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 15:55:02.094156 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-7b320b7d-dcc0-4e1b-8939-d3fa42edfb9b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:55:02.095932 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-7b320b7d-dcc0-4e1b-8939-d3fa42edfb9b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:55:02.096277 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1366/2710] 10.222.0.102 () {58 vars in 1238 bytes} [Mon Aug 1 15:55:01 2022] DELETE /identity/v3/projects/a4259c8518034b9798149a76a3fb3e00 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:55:02.101320 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea7cf74-d194-417b-a215-9c20c9cb0b57 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:55:02.101796 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea7cf74-d194-417b-a215-9c20c9cb0b57 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:55:02.101893 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea7cf74-d194-417b-a215-9c20c9cb0b57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:55:02.122161 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-1ea7cf74-d194-417b-a215-9c20c9cb0b57 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:55:02.123363 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-1ea7cf74-d194-417b-a215-9c20c9cb0b57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:55:02.181971 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1345/2711] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:55:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:55:02.191084 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedb310d-013b-4579-87a4-bf56fd6ab7c4 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:55:02.191371 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedb310d-013b-4579-87a4-bf56fd6ab7c4 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:55:02.191756 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedb310d-013b-4579-87a4-bf56fd6ab7c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:55:02.211787 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-fedb310d-013b-4579-87a4-bf56fd6ab7c4 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:55:02.213226 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-fedb310d-013b-4579-87a4-bf56fd6ab7c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:55:02.221827 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1367/2712] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:55:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 15:55:02.226041 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea7cf74-d194-417b-a215-9c20c9cb0b57 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:55:02.236344 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea7cf74-d194-417b-a215-9c20c9cb0b57 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:55:02.240830 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befa8d62-92c3-4538-8441-1643b2ab1132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:55:02.241472 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befa8d62-92c3-4538-8441-1643b2ab1132 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:55:02.241748 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befa8d62-92c3-4538-8441-1643b2ab1132 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:55:02.242020 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befa8d62-92c3-4538-8441-1643b2ab1132 admin admin] PATH_INFO: `/v3/domains` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:55:02.242699 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befa8d62-92c3-4538-8441-1643b2ab1132 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:55:02.242997 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befa8d62-92c3-4538-8441-1643b2ab1132 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:55:02.244577 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befa8d62-92c3-4538-8441-1643b2ab1132 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:55:02.255806 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1346/2713] 10.222.0.102 () {58 vars in 1158 bytes} [Mon Aug 1 15:55:02 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:55:02.260020 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedb310d-013b-4579-87a4-bf56fd6ab7c4 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:55:02.271399 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedb310d-013b-4579-87a4-bf56fd6ab7c4 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:55:02.276059 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be88cba6-6c97-4a22-88e2-0fcdc38b6cd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:55:02.276662 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be88cba6-6c97-4a22-88e2-0fcdc38b6cd6 admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:55:02.276984 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be88cba6-6c97-4a22-88e2-0fcdc38b6cd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:55:02.277307 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be88cba6-6c97-4a22-88e2-0fcdc38b6cd6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:55:02.277968 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be88cba6-6c97-4a22-88e2-0fcdc38b6cd6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:55:02.280480 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be88cba6-6c97-4a22-88e2-0fcdc38b6cd6 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:55:02.291652 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:55:02.360352 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1368/2714] 10.222.0.102 () {60 vars in 1158 bytes} [Mon Aug 1 15:55:02 2022] POST /identity/v3/projects => generated 386 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:55:02.364045 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befa8d62-92c3-4538-8441-1643b2ab1132 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:55:02.376609 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befa8d62-92c3-4538-8441-1643b2ab1132 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:55:02.433568 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01e450e-8d43-4616-8804-da45db575fcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:55:02.434465 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01e450e-8d43-4616-8804-da45db575fcf admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:55:02.434747 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01e450e-8d43-4616-8804-da45db575fcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:55:02.435015 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01e450e-8d43-4616-8804-da45db575fcf admin admin] PATH_INFO: `/v3/users` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:55:02.435680 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01e450e-8d43-4616-8804-da45db575fcf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:55:02.437633 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01e450e-8d43-4616-8804-da45db575fcf admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:55:02.540276 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1347/2715] 10.222.0.102 () {60 vars in 1149 bytes} [Mon Aug 1 15:55:02 2022] POST /identity/v3/users => generated 294 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:55:02.544652 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be88cba6-6c97-4a22-88e2-0fcdc38b6cd6 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:55:02.555032 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be88cba6-6c97-4a22-88e2-0fcdc38b6cd6 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:55:02.560008 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb83536-0c21-4396-9d78-4cd4fcea6cc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:55:02.560606 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb83536-0c21-4396-9d78-4cd4fcea6cc8 admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:55:02.560917 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb83536-0c21-4396-9d78-4cd4fcea6cc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:55:02.561190 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb83536-0c21-4396-9d78-4cd4fcea6cc8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:55:02.561875 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb83536-0c21-4396-9d78-4cd4fcea6cc8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:55:02.563593 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb83536-0c21-4396-9d78-4cd4fcea6cc8 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:55:02.574691 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1369/2716] 10.222.0.102 () {58 vars in 1127 bytes} [Mon Aug 1 15:55:02 2022] GET /identity/v3/roles => generated 1427 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:55:02.583209 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01e450e-8d43-4616-8804-da45db575fcf admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:55:02.594223 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01e450e-8d43-4616-8804-da45db575fcf admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:55:02.599087 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d48a602-d8ca-4e7f-b3e4-f191be7c82cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:55:02.599694 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d48a602-d8ca-4e7f-b3e4-f191be7c82cf admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:55:02.599971 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d48a602-d8ca-4e7f-b3e4-f191be7c82cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:55:02.600244 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d48a602-d8ca-4e7f-b3e4-f191be7c82cf admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:55:02.600974 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d48a602-d8ca-4e7f-b3e4-f191be7c82cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:55:02.602559 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d48a602-d8ca-4e7f-b3e4-f191be7c82cf admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:55:02.618014 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1348/2717] 10.222.0.102 () {58 vars in 1127 bytes} [Mon Aug 1 15:55:02 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:55:02.620991 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb83536-0c21-4396-9d78-4cd4fcea6cc8 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:55:02.631951 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb83536-0c21-4396-9d78-4cd4fcea6cc8 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:55:02.636505 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6806e4f0-721c-4ecb-b347-932fc32bec3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:55:02.637217 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6806e4f0-721c-4ecb-b347-932fc32bec3d admin admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:55:02.638011 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6806e4f0-721c-4ecb-b347-932fc32bec3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:55:02.638289 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6806e4f0-721c-4ecb-b347-932fc32bec3d admin admin] PATH_INFO: `/v3/projects/585ecf68b55442dbaeb54bc4e8cbf82c/users/71a780351827404a9a8b109048dcbc61/roles/27f5093ac0674d799cdbd17c68482e32` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:55:02.653810 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6806e4f0-721c-4ecb-b347-932fc32bec3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=585ecf68b55442dbaeb54bc4e8cbf82c, user_id=71a780351827404a9a8b109048dcbc61, role_id=27f5093ac0674d799cdbd17c68482e32)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:55:02.656487 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6806e4f0-721c-4ecb-b347-932fc32bec3d admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:55:02.767289 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1370/2718] 10.222.0.102 () {60 vars in 1488 bytes} [Mon Aug 1 15:55:02 2022] PUT /identity/v3/projects/585ecf68b55442dbaeb54bc4e8cbf82c/users/71a780351827404a9a8b109048dcbc61/roles/27f5093ac0674d799cdbd17c68482e32 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:55:02.776483 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbee5f7-989f-4006-ac12-0f6841833ea2 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:55:02.776766 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbee5f7-989f-4006-ac12-0f6841833ea2 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:55:02.777128 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbee5f7-989f-4006-ac12-0f6841833ea2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:55:02.786910 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e54f8b9-33cd-4b25-8454-e662c78b6273 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:55:02.787190 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e54f8b9-33cd-4b25-8454-e662c78b6273 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:55:02.790197 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e54f8b9-33cd-4b25-8454-e662c78b6273 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:55:02.805525 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:55:02.806309 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-0e54f8b9-33cd-4b25-8454-e662c78b6273 None None] MFA Rules not processed for user `b2f73e2aa3744667bf16d5a303151284`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:55:02.807646 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-0e54f8b9-33cd-4b25-8454-e662c78b6273 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:55:02.809932 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-ffbee5f7-989f-4006-ac12-0f6841833ea2 None None] MFA Rules not processed for user `71a780351827404a9a8b109048dcbc61`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:55:02.811221 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-ffbee5f7-989f-4006-ac12-0f6841833ea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:55:02.875939 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1371/2719] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:55:02 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 15:55:02.902532 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1349/2720] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:55:02 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:55:02.915392 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e54f8b9-33cd-4b25-8454-e662c78b6273 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:55:02.915669 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbee5f7-989f-4006-ac12-0f6841833ea2 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:55:02.916801 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-0e54f8b9-33cd-4b25-8454-e662c78b6273 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:55:02.917038 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-ffbee5f7-989f-4006-ac12-0f6841833ea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:55:02.975626 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbee5f7-989f-4006-ac12-0f6841833ea2 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:55:02.979372 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44d070d-cf12-441e-b4f5-e265855d8699 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff810b37183c4729859c1b05edff1703', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:55:02.980005 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44d070d-cf12-441e-b4f5-e265855d8699 service cinder] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:55:02.980281 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44d070d-cf12-441e-b4f5-e265855d8699 service cinder] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:55:02.980549 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44d070d-cf12-441e-b4f5-e265855d8699 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:55:02.983405 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e54f8b9-33cd-4b25-8454-e662c78b6273 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:55:02.987114 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc8e61c-baaf-4382-a16c-1ea4b49c7b0c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '613da2657ae34558b355cac53c8bf29a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:55:02.987724 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc8e61c-baaf-4382-a16c-1ea4b49c7b0c service glance] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:55:02.988003 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc8e61c-baaf-4382-a16c-1ea4b49c7b0c service glance] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:55:02.988276 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc8e61c-baaf-4382-a16c-1ea4b49c7b0c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:55:02.989454 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44d070d-cf12-441e-b4f5-e265855d8699 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:55:02.990236 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-afc8e61c-baaf-4382-a16c-1ea4b49c7b0c service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:55:02.990883 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44d070d-cf12-441e-b4f5-e265855d8699 service cinder] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:55:03.000188 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1350/2721] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:55:02 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 15:55:03.065073 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc8e61c-baaf-4382-a16c-1ea4b49c7b0c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:55:03.066523 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc8e61c-baaf-4382-a16c-1ea4b49c7b0c service glance] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:55:03.078705 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1372/2722] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:55:02 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:55:03.294297 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44d070d-cf12-441e-b4f5-e265855d8699 service cinder] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:55:03.295808 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-d44d070d-cf12-441e-b4f5-e265855d8699 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:55:03.353570 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44d070d-cf12-441e-b4f5-e265855d8699 service cinder] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:55:03.357698 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a6147d-c9a8-4599-9a7b-98bc93173ce9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a856a413100443939fe9b10daa868518', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:55:03.358315 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a6147d-c9a8-4599-9a7b-98bc93173ce9 service neutron] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:55:03.358595 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a6147d-c9a8-4599-9a7b-98bc93173ce9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:55:03.358869 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a6147d-c9a8-4599-9a7b-98bc93173ce9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:55:03.360626 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-a4a6147d-c9a8-4599-9a7b-98bc93173ce9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:55:03.370276 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a6147d-c9a8-4599-9a7b-98bc93173ce9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:55:03.371704 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a6147d-c9a8-4599-9a7b-98bc93173ce9 service neutron] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:55:03.380369 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1351/2723] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:55:03 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:55:03.840092 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc8e61c-baaf-4382-a16c-1ea4b49c7b0c service glance] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:55:03.845493 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:55:03.851075 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc8e61c-baaf-4382-a16c-1ea4b49c7b0c service glance] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:55:03.854691 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cfb1da-a9d4-4835-adbd-8786d729eeb3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a856a413100443939fe9b10daa868518', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:55:03.855287 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cfb1da-a9d4-4835-adbd-8786d729eeb3 service neutron] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:55:03.855621 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cfb1da-a9d4-4835-adbd-8786d729eeb3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:55:03.855892 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cfb1da-a9d4-4835-adbd-8786d729eeb3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:55:03.858297 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-72cfb1da-a9d4-4835-adbd-8786d729eeb3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:55:03.873231 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cfb1da-a9d4-4835-adbd-8786d729eeb3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:55:03.874734 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cfb1da-a9d4-4835-adbd-8786d729eeb3 service neutron] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:55:03.887183 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1373/2724] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:55:03 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:55:10.003591 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a6147d-c9a8-4599-9a7b-98bc93173ce9 service neutron] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:55:10.051652 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:55:10.065966 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a6147d-c9a8-4599-9a7b-98bc93173ce9 service neutron] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:55:10.070460 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0047001e-d551-4bdc-b0b3-03173a757c0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:55:10.071088 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0047001e-d551-4bdc-b0b3-03173a757c0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:55:10.071364 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0047001e-d551-4bdc-b0b3-03173a757c0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:55:10.071658 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0047001e-d551-4bdc-b0b3-03173a757c0f admin admin] PATH_INFO: `/v3/users/71a780351827404a9a8b109048dcbc61` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:55:10.072824 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0047001e-d551-4bdc-b0b3-03173a757c0f admin admin] RBAC: Authorizing `identity:delete_user(user_id=71a780351827404a9a8b109048dcbc61)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:55:10.074766 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0047001e-d551-4bdc-b0b3-03173a757c0f admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:55:10.261636 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-0047001e-d551-4bdc-b0b3-03173a757c0f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71a780351827404a9a8b109048dcbc61'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:55:10.322462 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-0047001e-d551-4bdc-b0b3-03173a757c0f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71a780351827404a9a8b109048dcbc61'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:55:10.335247 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-0047001e-d551-4bdc-b0b3-03173a757c0f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71a780351827404a9a8b109048dcbc61'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:55:10.335875 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-0047001e-d551-4bdc-b0b3-03173a757c0f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71a780351827404a9a8b109048dcbc61'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:55:10.336478 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-0047001e-d551-4bdc-b0b3-03173a757c0f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71a780351827404a9a8b109048dcbc61'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:55:10.349838 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1352/2725] 10.222.0.102 () {58 vars in 1229 bytes} [Mon Aug 1 15:55:10 2022] DELETE /identity/v3/users/71a780351827404a9a8b109048dcbc61 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:55:10.354445 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c1761b-f09d-4f9f-bf68-e2329080a273 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:55:10.354949 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c1761b-f09d-4f9f-bf68-e2329080a273 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:55:10.355140 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c1761b-f09d-4f9f-bf68-e2329080a273 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:55:10.374744 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-74c1761b-f09d-4f9f-bf68-e2329080a273 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:55:10.375940 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-74c1761b-f09d-4f9f-bf68-e2329080a273 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:55:10.434428 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1374/2726] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:55:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:55:10.444760 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0047001e-d551-4bdc-b0b3-03173a757c0f admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:55:10.446225 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-0047001e-d551-4bdc-b0b3-03173a757c0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:55:10.503078 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0047001e-d551-4bdc-b0b3-03173a757c0f admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:55:10.506696 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4c9148-5dc6-4fd2-95b5-c1889272e733 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a856a413100443939fe9b10daa868518', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:55:10.507307 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4c9148-5dc6-4fd2-95b5-c1889272e733 service neutron] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:55:10.507589 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4c9148-5dc6-4fd2-95b5-c1889272e733 service neutron] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:55:10.507863 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4c9148-5dc6-4fd2-95b5-c1889272e733 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:55:10.517539 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4c9148-5dc6-4fd2-95b5-c1889272e733 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:55:10.518913 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4c9148-5dc6-4fd2-95b5-c1889272e733 service neutron] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:55:10.528402 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1353/2727] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:55:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:55:11.118195 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c1761b-f09d-4f9f-bf68-e2329080a273 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:55:11.119694 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-74c1761b-f09d-4f9f-bf68-e2329080a273 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:55:11.132375 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c1761b-f09d-4f9f-bf68-e2329080a273 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:55:11.137106 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b6658e-f0a0-46e6-ba1c-e2c589b1f5c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:55:11.137753 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b6658e-f0a0-46e6-ba1c-e2c589b1f5c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:55:11.138675 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b6658e-f0a0-46e6-ba1c-e2c589b1f5c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:55:11.138955 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b6658e-f0a0-46e6-ba1c-e2c589b1f5c1 admin admin] PATH_INFO: `/v3/projects/585ecf68b55442dbaeb54bc4e8cbf82c` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:55:11.140346 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b6658e-f0a0-46e6-ba1c-e2c589b1f5c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=585ecf68b55442dbaeb54bc4e8cbf82c)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:55:11.142312 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b6658e-f0a0-46e6-ba1c-e2c589b1f5c1 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:55:11.281507 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-a7b6658e-f0a0-46e6-ba1c-e2c589b1f5c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '585ecf68b55442dbaeb54bc4e8cbf82c', 'request_id': 'req-a7b6658e-f0a0-46e6-ba1c-e2c589b1f5c1'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:55:11.287869 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-a7b6658e-f0a0-46e6-ba1c-e2c589b1f5c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '585ecf68b55442dbaeb54bc4e8cbf82c', 'request_id': 'req-a7b6658e-f0a0-46e6-ba1c-e2c589b1f5c1'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:55:11.358784 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-a7b6658e-f0a0-46e6-ba1c-e2c589b1f5c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '585ecf68b55442dbaeb54bc4e8cbf82c', 'request_id': 'req-a7b6658e-f0a0-46e6-ba1c-e2c589b1f5c1'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:55:11.369374 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-a7b6658e-f0a0-46e6-ba1c-e2c589b1f5c1 admin admin] The token cache is being invalidate because project 585ecf68b55442dbaeb54bc4e8cbf82c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80352) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 15:55:11.369657 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-a7b6658e-f0a0-46e6-ba1c-e2c589b1f5c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:55:11.370271 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-a7b6658e-f0a0-46e6-ba1c-e2c589b1f5c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:55:11.371898 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1375/2728] 10.222.0.102 () {58 vars in 1238 bytes} [Mon Aug 1 15:55:11 2022] DELETE /identity/v3/projects/585ecf68b55442dbaeb54bc4e8cbf82c => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:55:11.377434 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2ec259-05c5-4278-a52b-82e7cedb9314 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:55:11.378970 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2ec259-05c5-4278-a52b-82e7cedb9314 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:55:11.378970 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2ec259-05c5-4278-a52b-82e7cedb9314 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:55:11.398617 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-bc2ec259-05c5-4278-a52b-82e7cedb9314 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:55:11.399858 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-bc2ec259-05c5-4278-a52b-82e7cedb9314 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:55:11.458100 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1354/2729] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:55:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:55:11.466766 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15d7d90-d0ae-4e64-828f-38b7c5892c78 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:55:11.467046 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15d7d90-d0ae-4e64-828f-38b7c5892c78 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:55:11.467313 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15d7d90-d0ae-4e64-828f-38b7c5892c78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:55:11.487434 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-b15d7d90-d0ae-4e64-828f-38b7c5892c78 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:55:11.488636 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-b15d7d90-d0ae-4e64-828f-38b7c5892c78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:55:11.496522 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1376/2730] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:55:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:55:11.501213 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2ec259-05c5-4278-a52b-82e7cedb9314 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:55:11.510860 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2ec259-05c5-4278-a52b-82e7cedb9314 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:55:11.515351 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92f0733-fb0d-4d66-b289-5e16ae3f5869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:55:11.515954 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92f0733-fb0d-4d66-b289-5e16ae3f5869 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:55:11.516233 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92f0733-fb0d-4d66-b289-5e16ae3f5869 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:55:11.516528 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92f0733-fb0d-4d66-b289-5e16ae3f5869 admin admin] PATH_INFO: `/v3/domains` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:55:11.517247 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92f0733-fb0d-4d66-b289-5e16ae3f5869 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:55:11.517551 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92f0733-fb0d-4d66-b289-5e16ae3f5869 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:55:11.519142 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92f0733-fb0d-4d66-b289-5e16ae3f5869 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:55:11.525717 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:55:11.530677 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1355/2731] 10.222.0.102 () {58 vars in 1158 bytes} [Mon Aug 1 15:55:11 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:55:11.540040 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15d7d90-d0ae-4e64-828f-38b7c5892c78 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:55:11.545241 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15d7d90-d0ae-4e64-828f-38b7c5892c78 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:55:11.554333 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d19eb0b-3f92-4723-9523-00c9e735cb94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:55:11.554942 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d19eb0b-3f92-4723-9523-00c9e735cb94 admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:55:11.555239 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d19eb0b-3f92-4723-9523-00c9e735cb94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:55:11.555504 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d19eb0b-3f92-4723-9523-00c9e735cb94 admin admin] PATH_INFO: `/v3/projects` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:55:11.556169 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d19eb0b-3f92-4723-9523-00c9e735cb94 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:55:11.558206 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d19eb0b-3f92-4723-9523-00c9e735cb94 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:55:11.664222 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1377/2732] 10.222.0.102 () {60 vars in 1158 bytes} [Mon Aug 1 15:55:11 2022] POST /identity/v3/projects => generated 384 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 15:55:11.668603 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92f0733-fb0d-4d66-b289-5e16ae3f5869 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:55:11.679739 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92f0733-fb0d-4d66-b289-5e16ae3f5869 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:55:11.737839 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530c2e3d-ddae-4e7b-9c2e-db2e132a8753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:55:11.738451 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530c2e3d-ddae-4e7b-9c2e-db2e132a8753 admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:55:11.738729 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530c2e3d-ddae-4e7b-9c2e-db2e132a8753 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:55:11.738997 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530c2e3d-ddae-4e7b-9c2e-db2e132a8753 admin admin] PATH_INFO: `/v3/users` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:55:11.739648 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530c2e3d-ddae-4e7b-9c2e-db2e132a8753 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:55:11.741606 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530c2e3d-ddae-4e7b-9c2e-db2e132a8753 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:55:11.889956 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1356/2733] 10.222.0.102 () {60 vars in 1149 bytes} [Mon Aug 1 15:55:11 2022] POST /identity/v3/users => generated 293 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:55:11.893825 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d19eb0b-3f92-4723-9523-00c9e735cb94 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:55:11.905196 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d19eb0b-3f92-4723-9523-00c9e735cb94 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:55:11.909997 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e382723f-ee35-410a-896d-3831b8dc7bdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:55:11.910607 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e382723f-ee35-410a-896d-3831b8dc7bdc admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:55:11.910888 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e382723f-ee35-410a-896d-3831b8dc7bdc admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:55:11.911158 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e382723f-ee35-410a-896d-3831b8dc7bdc admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:55:11.911855 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e382723f-ee35-410a-896d-3831b8dc7bdc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:55:11.913662 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e382723f-ee35-410a-896d-3831b8dc7bdc admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:55:11.925422 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1378/2734] 10.222.0.102 () {58 vars in 1127 bytes} [Mon Aug 1 15:55:11 2022] GET /identity/v3/roles => generated 1427 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:55:11.930712 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530c2e3d-ddae-4e7b-9c2e-db2e132a8753 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:55:11.941628 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530c2e3d-ddae-4e7b-9c2e-db2e132a8753 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:55:11.950743 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1174df66-8e53-4b24-823f-0dc5acf9ab97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:55:11.951457 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1174df66-8e53-4b24-823f-0dc5acf9ab97 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:55:11.951765 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1174df66-8e53-4b24-823f-0dc5acf9ab97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:55:11.952041 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1174df66-8e53-4b24-823f-0dc5acf9ab97 admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:55:11.952749 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1174df66-8e53-4b24-823f-0dc5acf9ab97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:55:11.954373 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1174df66-8e53-4b24-823f-0dc5acf9ab97 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:55:11.967051 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1357/2735] 10.222.0.102 () {58 vars in 1127 bytes} [Mon Aug 1 15:55:11 2022] GET /identity/v3/roles => generated 1427 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 15:55:11.971531 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e382723f-ee35-410a-896d-3831b8dc7bdc admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:55:11.984597 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e382723f-ee35-410a-896d-3831b8dc7bdc admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:55:11.989217 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1de2302-d03d-4233-9811-1890984020ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:55:11.989872 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1de2302-d03d-4233-9811-1890984020ed admin admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:55:11.990148 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1de2302-d03d-4233-9811-1890984020ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:55:11.990418 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1de2302-d03d-4233-9811-1890984020ed admin admin] PATH_INFO: `/v3/projects/dc92609503734c96950cabf1ed9fc770/users/b669d552709d449f93e23dbdd260b46f/roles/27f5093ac0674d799cdbd17c68482e32` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:55:12.004870 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1de2302-d03d-4233-9811-1890984020ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc92609503734c96950cabf1ed9fc770, user_id=b669d552709d449f93e23dbdd260b46f, role_id=27f5093ac0674d799cdbd17c68482e32)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:55:12.007528 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1de2302-d03d-4233-9811-1890984020ed admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:55:12.094442 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1174df66-8e53-4b24-823f-0dc5acf9ab97 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:55:12.096187 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-1174df66-8e53-4b24-823f-0dc5acf9ab97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:55:12.113047 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1379/2736] 10.222.0.102 () {60 vars in 1488 bytes} [Mon Aug 1 15:55:11 2022] PUT /identity/v3/projects/dc92609503734c96950cabf1ed9fc770/users/b669d552709d449f93e23dbdd260b46f/roles/27f5093ac0674d799cdbd17c68482e32 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:55:12.166604 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1174df66-8e53-4b24-823f-0dc5acf9ab97 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:55:12.186778 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6525fad5-93f2-40e4-8bfa-23e700cd89b5 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:55:12.187071 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6525fad5-93f2-40e4-8bfa-23e700cd89b5 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:55:12.187347 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6525fad5-93f2-40e4-8bfa-23e700cd89b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:55:12.207986 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:55:12.217016 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-6525fad5-93f2-40e4-8bfa-23e700cd89b5 None None] MFA Rules not processed for user `b669d552709d449f93e23dbdd260b46f`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:55:12.218253 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-6525fad5-93f2-40e4-8bfa-23e700cd89b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:55:12.225359 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91e9ded-cfcd-4f87-973a-4bbf66652f95 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a856a413100443939fe9b10daa868518', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:55:12.226023 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91e9ded-cfcd-4f87-973a-4bbf66652f95 service neutron] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:55:12.226319 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91e9ded-cfcd-4f87-973a-4bbf66652f95 service neutron] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:55:12.226686 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91e9ded-cfcd-4f87-973a-4bbf66652f95 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:55:12.228468 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-d91e9ded-cfcd-4f87-973a-4bbf66652f95 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:55:12.240012 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91e9ded-cfcd-4f87-973a-4bbf66652f95 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:55:12.241509 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91e9ded-cfcd-4f87-973a-4bbf66652f95 service neutron] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:55:12.265990 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1358/2737] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:55:12 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 15:55:12.298645 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1380/2738] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:55:12 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 15:55:12.303272 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91e9ded-cfcd-4f87-973a-4bbf66652f95 service neutron] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:55:12.344743 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:55:12.370399 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91e9ded-cfcd-4f87-973a-4bbf66652f95 service neutron] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:55:12.376451 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4add1a33-6635-4c3d-bc76-5d247cc62134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:55:12.377436 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4add1a33-6635-4c3d-bc76-5d247cc62134 admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:55:12.378032 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4add1a33-6635-4c3d-bc76-5d247cc62134 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:55:12.378673 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4add1a33-6635-4c3d-bc76-5d247cc62134 admin admin] PATH_INFO: `/v3/projects` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:55:12.379304 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4add1a33-6635-4c3d-bc76-5d247cc62134 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:55:12.381260 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4add1a33-6635-4c3d-bc76-5d247cc62134 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:55:12.492401 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1359/2739] 10.222.0.102 () {60 vars in 1158 bytes} [Mon Aug 1 15:55:12 2022] POST /identity/v3/projects => generated 386 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:55:12.496453 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6525fad5-93f2-40e4-8bfa-23e700cd89b5 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:55:12.515193 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6525fad5-93f2-40e4-8bfa-23e700cd89b5 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:55:12.575997 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8d30f6-05f9-49e0-9a49-3530e5f7857e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:55:12.576624 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8d30f6-05f9-49e0-9a49-3530e5f7857e admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:55:12.576936 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8d30f6-05f9-49e0-9a49-3530e5f7857e admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:55:12.577210 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8d30f6-05f9-49e0-9a49-3530e5f7857e admin admin] PATH_INFO: `/v3/users` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:55:12.577917 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8d30f6-05f9-49e0-9a49-3530e5f7857e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:55:12.579880 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8d30f6-05f9-49e0-9a49-3530e5f7857e admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:55:12.682808 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1381/2740] 10.222.0.102 () {60 vars in 1149 bytes} [Mon Aug 1 15:55:12 2022] POST /identity/v3/users => generated 294 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:55:12.684332 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4add1a33-6635-4c3d-bc76-5d247cc62134 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:55:12.695310 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4add1a33-6635-4c3d-bc76-5d247cc62134 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:55:12.699944 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28e6142-c94c-4ee8-aa50-a396950f10bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:55:12.703026 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28e6142-c94c-4ee8-aa50-a396950f10bf admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:55:12.703026 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28e6142-c94c-4ee8-aa50-a396950f10bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:55:12.703026 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28e6142-c94c-4ee8-aa50-a396950f10bf admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:55:12.703026 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28e6142-c94c-4ee8-aa50-a396950f10bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:55:12.703493 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28e6142-c94c-4ee8-aa50-a396950f10bf admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:55:12.714326 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1360/2741] 10.222.0.102 () {58 vars in 1127 bytes} [Mon Aug 1 15:55:12 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:55:12.718953 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8d30f6-05f9-49e0-9a49-3530e5f7857e admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:55:12.729078 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8d30f6-05f9-49e0-9a49-3530e5f7857e admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:55:12.734353 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0893f0-3223-45db-9dee-3399cf8bac6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:55:12.734955 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0893f0-3223-45db-9dee-3399cf8bac6c admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:55:12.737439 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0893f0-3223-45db-9dee-3399cf8bac6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:55:12.737439 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0893f0-3223-45db-9dee-3399cf8bac6c admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:55:12.737439 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0893f0-3223-45db-9dee-3399cf8bac6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:55:12.737830 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0893f0-3223-45db-9dee-3399cf8bac6c admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:55:12.747831 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1382/2742] 10.222.0.102 () {58 vars in 1127 bytes} [Mon Aug 1 15:55:12 2022] GET /identity/v3/roles => generated 1427 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:55:12.751889 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28e6142-c94c-4ee8-aa50-a396950f10bf admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:55:12.761976 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28e6142-c94c-4ee8-aa50-a396950f10bf admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:55:12.766629 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5ac8a7-dd35-46d9-b770-b6a3f1ef320d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:55:12.767277 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5ac8a7-dd35-46d9-b770-b6a3f1ef320d admin admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:55:12.767554 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5ac8a7-dd35-46d9-b770-b6a3f1ef320d admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:55:12.767826 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5ac8a7-dd35-46d9-b770-b6a3f1ef320d admin admin] PATH_INFO: `/v3/projects/daf1e5d2629749c3a919238a613c34e4/users/0e548e011cfb44b8a36981b165011b8f/roles/27f5093ac0674d799cdbd17c68482e32` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:55:12.782801 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5ac8a7-dd35-46d9-b770-b6a3f1ef320d admin admin] RBAC: Authorizing `identity:create_grant(project_id=daf1e5d2629749c3a919238a613c34e4, user_id=0e548e011cfb44b8a36981b165011b8f, role_id=27f5093ac0674d799cdbd17c68482e32)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:55:12.785562 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5ac8a7-dd35-46d9-b770-b6a3f1ef320d admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:55:12.892422 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1361/2743] 10.222.0.102 () {60 vars in 1488 bytes} [Mon Aug 1 15:55:12 2022] PUT /identity/v3/projects/daf1e5d2629749c3a919238a613c34e4/users/0e548e011cfb44b8a36981b165011b8f/roles/27f5093ac0674d799cdbd17c68482e32 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:55:12.903098 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a8cf53-6dda-4ae8-820f-89a0085d8c2e None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:55:12.903383 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a8cf53-6dda-4ae8-820f-89a0085d8c2e None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:55:12.904791 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a8cf53-6dda-4ae8-820f-89a0085d8c2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:55:12.941222 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-65a8cf53-6dda-4ae8-820f-89a0085d8c2e None None] MFA Rules not processed for user `0e548e011cfb44b8a36981b165011b8f`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:55:12.942354 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-65a8cf53-6dda-4ae8-820f-89a0085d8c2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:55:13.015675 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1383/2744] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:55:12 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:55:13.020350 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5ac8a7-dd35-46d9-b770-b6a3f1ef320d admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:55:13.093846 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5ac8a7-dd35-46d9-b770-b6a3f1ef320d admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:55:13.100818 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f19adf-0953-479b-9f76-f5038091b07e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:55:13.101858 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f19adf-0953-479b-9f76-f5038091b07e admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:55:13.102410 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f19adf-0953-479b-9f76-f5038091b07e admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:55:13.103446 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f19adf-0953-479b-9f76-f5038091b07e admin admin] PATH_INFO: `/v3/projects` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:55:13.104438 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f19adf-0953-479b-9f76-f5038091b07e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:55:13.110463 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f19adf-0953-479b-9f76-f5038091b07e admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:55:13.216525 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1362/2745] 10.222.0.102 () {60 vars in 1158 bytes} [Mon Aug 1 15:55:13 2022] POST /identity/v3/projects => generated 384 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:55:13.217814 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a8cf53-6dda-4ae8-820f-89a0085d8c2e None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:55:13.230673 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a8cf53-6dda-4ae8-820f-89a0085d8c2e None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:55:13.235444 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:55:13.300544 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5343ae85-470e-45c0-beb6-d6b313d13e51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:55:13.300818 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5343ae85-470e-45c0-beb6-d6b313d13e51 admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:55:13.301104 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5343ae85-470e-45c0-beb6-d6b313d13e51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:55:13.301383 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5343ae85-470e-45c0-beb6-d6b313d13e51 admin admin] PATH_INFO: `/v3/users` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:55:13.302066 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5343ae85-470e-45c0-beb6-d6b313d13e51 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:55:13.304112 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5343ae85-470e-45c0-beb6-d6b313d13e51 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:55:13.400363 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1384/2746] 10.222.0.102 () {60 vars in 1149 bytes} [Mon Aug 1 15:55:13 2022] POST /identity/v3/users => generated 299 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 15:55:13.404346 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f19adf-0953-479b-9f76-f5038091b07e admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:55:13.415194 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f19adf-0953-479b-9f76-f5038091b07e admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:55:13.420905 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52a1081-1371-42db-a2f3-9535bb4a6c3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:55:13.421930 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52a1081-1371-42db-a2f3-9535bb4a6c3c admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:55:13.422315 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52a1081-1371-42db-a2f3-9535bb4a6c3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:55:13.422711 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52a1081-1371-42db-a2f3-9535bb4a6c3c admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:55:13.423523 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52a1081-1371-42db-a2f3-9535bb4a6c3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:55:13.444087 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52a1081-1371-42db-a2f3-9535bb4a6c3c admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:55:13.475092 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1363/2747] 10.222.0.102 () {58 vars in 1127 bytes} [Mon Aug 1 15:55:13 2022] GET /identity/v3/roles => generated 1427 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:55:13.479236 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5343ae85-470e-45c0-beb6-d6b313d13e51 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:55:13.493251 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5343ae85-470e-45c0-beb6-d6b313d13e51 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:55:13.499541 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b2c0f9-b3b6-4887-b0bc-6ce355d79f7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:55:13.500441 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b2c0f9-b3b6-4887-b0bc-6ce355d79f7b admin admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:55:13.500798 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b2c0f9-b3b6-4887-b0bc-6ce355d79f7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:55:13.501177 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b2c0f9-b3b6-4887-b0bc-6ce355d79f7b admin admin] PATH_INFO: `/v3/projects/f44faa33c9684c56a3bf262204bf062d/users/6f73319019e24d73b68e006c45d4d752/roles/de1374f966c04c27b579515b54334fd2` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:55:13.526930 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b2c0f9-b3b6-4887-b0bc-6ce355d79f7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f44faa33c9684c56a3bf262204bf062d, user_id=6f73319019e24d73b68e006c45d4d752, role_id=de1374f966c04c27b579515b54334fd2)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:55:13.531582 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b2c0f9-b3b6-4887-b0bc-6ce355d79f7b admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:55:13.638723 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1385/2748] 10.222.0.102 () {60 vars in 1488 bytes} [Mon Aug 1 15:55:13 2022] PUT /identity/v3/projects/f44faa33c9684c56a3bf262204bf062d/users/6f73319019e24d73b68e006c45d4d752/roles/de1374f966c04c27b579515b54334fd2 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:55:13.642332 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52a1081-1371-42db-a2f3-9535bb4a6c3c admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:55:13.652756 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52a1081-1371-42db-a2f3-9535bb4a6c3c admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:55:13.715597 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d81747-66ac-4891-af2c-7ddf10b5d9bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:55:13.716910 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d81747-66ac-4891-af2c-7ddf10b5d9bd admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:55:13.717315 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d81747-66ac-4891-af2c-7ddf10b5d9bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:55:13.717758 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d81747-66ac-4891-af2c-7ddf10b5d9bd admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:55:13.718590 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d81747-66ac-4891-af2c-7ddf10b5d9bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:55:13.720277 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d81747-66ac-4891-af2c-7ddf10b5d9bd admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:55:13.721738 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:55:13.736358 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1364/2749] 10.222.0.102 () {58 vars in 1127 bytes} [Mon Aug 1 15:55:13 2022] GET /identity/v3/roles => generated 1427 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:55:13.737163 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b2c0f9-b3b6-4887-b0bc-6ce355d79f7b admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:55:13.749669 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b2c0f9-b3b6-4887-b0bc-6ce355d79f7b admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:55:13.755744 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558473ea-deae-49a4-a18e-a5f16700de5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:55:13.756813 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558473ea-deae-49a4-a18e-a5f16700de5b admin admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:55:13.757376 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558473ea-deae-49a4-a18e-a5f16700de5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:55:13.757835 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558473ea-deae-49a4-a18e-a5f16700de5b admin admin] PATH_INFO: `/v3/projects/f44faa33c9684c56a3bf262204bf062d/users/6f73319019e24d73b68e006c45d4d752/roles/de1374f966c04c27b579515b54334fd2` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:55:13.771325 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558473ea-deae-49a4-a18e-a5f16700de5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f44faa33c9684c56a3bf262204bf062d, user_id=6f73319019e24d73b68e006c45d4d752, role_id=de1374f966c04c27b579515b54334fd2)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:55:13.771325 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558473ea-deae-49a4-a18e-a5f16700de5b admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:55:13.783436 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1386/2750] 10.222.0.102 () {60 vars in 1488 bytes} [Mon Aug 1 15:55:13 2022] PUT /identity/v3/projects/f44faa33c9684c56a3bf262204bf062d/users/6f73319019e24d73b68e006c45d4d752/roles/de1374f966c04c27b579515b54334fd2 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:55:13.794934 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3e7a49-4b6f-4839-85f3-49482e8fffca None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:55:13.795314 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3e7a49-4b6f-4839-85f3-49482e8fffca None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:55:13.795733 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3e7a49-4b6f-4839-85f3-49482e8fffca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:55:13.823979 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-dd3e7a49-4b6f-4839-85f3-49482e8fffca None None] MFA Rules not processed for user `6f73319019e24d73b68e006c45d4d752`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:55:13.825281 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-dd3e7a49-4b6f-4839-85f3-49482e8fffca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:55:13.910521 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1365/2751] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:55:13 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:55:13.922188 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558473ea-deae-49a4-a18e-a5f16700de5b admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:55:13.924306 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-558473ea-deae-49a4-a18e-a5f16700de5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:55:13.987910 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558473ea-deae-49a4-a18e-a5f16700de5b admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:55:13.991584 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa25a41-1717-4778-9eed-11a9d2899bd8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff810b37183c4729859c1b05edff1703', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:55:13.992234 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa25a41-1717-4778-9eed-11a9d2899bd8 service cinder] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:55:13.992512 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa25a41-1717-4778-9eed-11a9d2899bd8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:55:13.992789 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa25a41-1717-4778-9eed-11a9d2899bd8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:55:14.051070 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa25a41-1717-4778-9eed-11a9d2899bd8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:55:14.052518 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa25a41-1717-4778-9eed-11a9d2899bd8 service cinder] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:55:14.062023 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1387/2752] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:55:13 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:55:15.960158 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3e7a49-4b6f-4839-85f3-49482e8fffca None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:55:15.961562 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-dd3e7a49-4b6f-4839-85f3-49482e8fffca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:55:15.974192 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3e7a49-4b6f-4839-85f3-49482e8fffca None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:55:15.977762 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c097f644-db04-4333-b198-76b1d74f909b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff810b37183c4729859c1b05edff1703', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:55:15.978372 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c097f644-db04-4333-b198-76b1d74f909b service cinder] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:55:15.978651 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c097f644-db04-4333-b198-76b1d74f909b service cinder] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:55:15.978923 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c097f644-db04-4333-b198-76b1d74f909b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:55:16.048551 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c097f644-db04-4333-b198-76b1d74f909b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:55:16.050053 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c097f644-db04-4333-b198-76b1d74f909b service cinder] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:55:16.070618 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1366/2753] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:55:15 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:55:17.889685 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa25a41-1717-4778-9eed-11a9d2899bd8 service cinder] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:55:17.898536 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa25a41-1717-4778-9eed-11a9d2899bd8 service cinder] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:55:17.902555 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d292e45c-0c0c-4c93-bc68-c5dc490c7bc9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff810b37183c4729859c1b05edff1703', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:55:17.903167 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d292e45c-0c0c-4c93-bc68-c5dc490c7bc9 service cinder] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:55:17.903473 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d292e45c-0c0c-4c93-bc68-c5dc490c7bc9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:55:17.903771 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d292e45c-0c0c-4c93-bc68-c5dc490c7bc9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:55:17.925260 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d292e45c-0c0c-4c93-bc68-c5dc490c7bc9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:55:17.929072 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d292e45c-0c0c-4c93-bc68-c5dc490c7bc9 service cinder] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:55:17.932062 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:55:17.937458 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1388/2754] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:55:17 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:55:19.858334 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c097f644-db04-4333-b198-76b1d74f909b service cinder] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:55:19.859753 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-c097f644-db04-4333-b198-76b1d74f909b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:55:19.985736 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c097f644-db04-4333-b198-76b1d74f909b service cinder] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:55:19.995500 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4519b9-9731-4c6e-b4eb-dc06d9460bf5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77b43f1ee8cc4be3907a494abe90c1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:55:19.996251 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4519b9-9731-4c6e-b4eb-dc06d9460bf5 service nova] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:55:19.996538 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4519b9-9731-4c6e-b4eb-dc06d9460bf5 service nova] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:55:19.996826 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4519b9-9731-4c6e-b4eb-dc06d9460bf5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:55:19.999458 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-5b4519b9-9731-4c6e-b4eb-dc06d9460bf5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:55:20.014565 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4519b9-9731-4c6e-b4eb-dc06d9460bf5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:55:20.016308 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4519b9-9731-4c6e-b4eb-dc06d9460bf5 service nova] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:55:20.046927 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1367/2755] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:55:19 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:55:22.483237 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00708efb-b046-4b03-8183-cbaea0ef0f9e None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:55:22.485348 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00708efb-b046-4b03-8183-cbaea0ef0f9e None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:55:22.485348 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00708efb-b046-4b03-8183-cbaea0ef0f9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:55:22.506347 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-00708efb-b046-4b03-8183-cbaea0ef0f9e None None] MFA Rules not processed for user `1a12e93026eb42849e473fe8d82e2a5e`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:55:22.507603 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-00708efb-b046-4b03-8183-cbaea0ef0f9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:55:22.567180 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1389/2756] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:55:22 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:55:23.826903 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4519b9-9731-4c6e-b4eb-dc06d9460bf5 service nova] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:55:23.832770 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:55:23.910008 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4519b9-9731-4c6e-b4eb-dc06d9460bf5 service nova] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:55:23.911595 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc4c736-a3a3-4ea7-9066-20a17f8d0ee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:55:23.912235 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc4c736-a3a3-4ea7-9066-20a17f8d0ee3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:55:23.912514 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc4c736-a3a3-4ea7-9066-20a17f8d0ee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:55:23.912787 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc4c736-a3a3-4ea7-9066-20a17f8d0ee3 admin admin] PATH_INFO: `/v3/users/b669d552709d449f93e23dbdd260b46f` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:55:23.913990 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc4c736-a3a3-4ea7-9066-20a17f8d0ee3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b669d552709d449f93e23dbdd260b46f)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:55:23.915965 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc4c736-a3a3-4ea7-9066-20a17f8d0ee3 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:55:24.096003 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-ddc4c736-a3a3-4ea7-9066-20a17f8d0ee3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b669d552709d449f93e23dbdd260b46f'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:55:24.196355 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-ddc4c736-a3a3-4ea7-9066-20a17f8d0ee3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b669d552709d449f93e23dbdd260b46f'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:55:24.211694 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-ddc4c736-a3a3-4ea7-9066-20a17f8d0ee3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b669d552709d449f93e23dbdd260b46f'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:55:24.212484 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-ddc4c736-a3a3-4ea7-9066-20a17f8d0ee3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b669d552709d449f93e23dbdd260b46f'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:55:24.213231 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-ddc4c736-a3a3-4ea7-9066-20a17f8d0ee3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b669d552709d449f93e23dbdd260b46f'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:55:24.226329 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1368/2757] 10.222.0.102 () {58 vars in 1229 bytes} [Mon Aug 1 15:55:23 2022] DELETE /identity/v3/users/b669d552709d449f93e23dbdd260b46f => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:55:24.230543 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4d0e43-9093-4740-987b-ac7061317bce None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:55:24.234686 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4d0e43-9093-4740-987b-ac7061317bce None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:55:24.234686 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4d0e43-9093-4740-987b-ac7061317bce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:55:24.252161 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-ea4d0e43-9093-4740-987b-ac7061317bce None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:55:24.257494 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-ea4d0e43-9093-4740-987b-ac7061317bce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:55:24.314201 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1390/2758] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:55:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 15:55:24.323543 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc4c736-a3a3-4ea7-9066-20a17f8d0ee3 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:55:24.324983 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-ddc4c736-a3a3-4ea7-9066-20a17f8d0ee3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:55:24.385454 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc4c736-a3a3-4ea7-9066-20a17f8d0ee3 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:55:24.391448 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5f23b5-5793-4add-931b-6fc0d3903b70 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a856a413100443939fe9b10daa868518', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:55:24.392250 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5f23b5-5793-4add-931b-6fc0d3903b70 service neutron] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:55:24.392577 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5f23b5-5793-4add-931b-6fc0d3903b70 service neutron] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:55:24.392981 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5f23b5-5793-4add-931b-6fc0d3903b70 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:55:24.403243 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5f23b5-5793-4add-931b-6fc0d3903b70 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:55:24.404713 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5f23b5-5793-4add-931b-6fc0d3903b70 service neutron] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:55:24.416052 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1369/2759] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:55:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:55:24.932064 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4d0e43-9093-4740-987b-ac7061317bce None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:55:24.933997 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-ea4d0e43-9093-4740-987b-ac7061317bce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:55:24.957065 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4d0e43-9093-4740-987b-ac7061317bce None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:55:24.964797 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5033fc88-e6ec-4500-b9d4-3c0da2c43708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:55:24.965621 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5033fc88-e6ec-4500-b9d4-3c0da2c43708 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:55:24.965963 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5033fc88-e6ec-4500-b9d4-3c0da2c43708 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:55:24.966244 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5033fc88-e6ec-4500-b9d4-3c0da2c43708 admin admin] PATH_INFO: `/v3/projects/dc92609503734c96950cabf1ed9fc770` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:55:24.971310 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5033fc88-e6ec-4500-b9d4-3c0da2c43708 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc92609503734c96950cabf1ed9fc770)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:55:24.971310 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5033fc88-e6ec-4500-b9d4-3c0da2c43708 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:55:25.007307 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5f23b5-5793-4add-931b-6fc0d3903b70 service neutron] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:55:25.016573 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5f23b5-5793-4add-931b-6fc0d3903b70 service neutron] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:55:25.020353 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1105f5e-7184-48eb-959c-3aaa1c787f6b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a856a413100443939fe9b10daa868518', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:55:25.022497 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1105f5e-7184-48eb-959c-3aaa1c787f6b service neutron] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:55:25.022497 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1105f5e-7184-48eb-959c-3aaa1c787f6b service neutron] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:55:25.022497 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1105f5e-7184-48eb-959c-3aaa1c787f6b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:55:25.023502 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-f1105f5e-7184-48eb-959c-3aaa1c787f6b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:55:25.036381 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1105f5e-7184-48eb-959c-3aaa1c787f6b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:55:25.037830 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1105f5e-7184-48eb-959c-3aaa1c787f6b service neutron] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:55:25.047469 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1370/2760] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:55:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 15:55:25.089847 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-5033fc88-e6ec-4500-b9d4-3c0da2c43708 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc92609503734c96950cabf1ed9fc770', 'request_id': 'req-5033fc88-e6ec-4500-b9d4-3c0da2c43708'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:55:25.097071 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-5033fc88-e6ec-4500-b9d4-3c0da2c43708 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc92609503734c96950cabf1ed9fc770', 'request_id': 'req-5033fc88-e6ec-4500-b9d4-3c0da2c43708'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:55:25.162213 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-5033fc88-e6ec-4500-b9d4-3c0da2c43708 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc92609503734c96950cabf1ed9fc770', 'request_id': 'req-5033fc88-e6ec-4500-b9d4-3c0da2c43708'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:55:25.173331 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-5033fc88-e6ec-4500-b9d4-3c0da2c43708 admin admin] The token cache is being invalidate because project dc92609503734c96950cabf1ed9fc770 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80352) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 15:55:25.173618 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-5033fc88-e6ec-4500-b9d4-3c0da2c43708 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:55:25.174274 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-5033fc88-e6ec-4500-b9d4-3c0da2c43708 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:55:25.176067 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1391/2761] 10.222.0.102 () {58 vars in 1238 bytes} [Mon Aug 1 15:55:24 2022] DELETE /identity/v3/projects/dc92609503734c96950cabf1ed9fc770 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:55:25.179888 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1105f5e-7184-48eb-959c-3aaa1c787f6b service neutron] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:55:25.190331 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1105f5e-7184-48eb-959c-3aaa1c787f6b service neutron] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:55:25.199148 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:55:25.246293 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf2f501-fa93-45c6-b9cf-5dc6e7f2dbbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:55:25.246986 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf2f501-fa93-45c6-b9cf-5dc6e7f2dbbc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:55:25.248187 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf2f501-fa93-45c6-b9cf-5dc6e7f2dbbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:55:25.248892 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf2f501-fa93-45c6-b9cf-5dc6e7f2dbbc admin admin] PATH_INFO: `/v3/users/0e548e011cfb44b8a36981b165011b8f` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:55:25.250782 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf2f501-fa93-45c6-b9cf-5dc6e7f2dbbc admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e548e011cfb44b8a36981b165011b8f)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:55:25.252693 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf2f501-fa93-45c6-b9cf-5dc6e7f2dbbc admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:55:25.402748 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-9bf2f501-fa93-45c6-b9cf-5dc6e7f2dbbc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e548e011cfb44b8a36981b165011b8f'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:55:25.473305 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-9bf2f501-fa93-45c6-b9cf-5dc6e7f2dbbc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e548e011cfb44b8a36981b165011b8f'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:55:25.486731 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-9bf2f501-fa93-45c6-b9cf-5dc6e7f2dbbc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e548e011cfb44b8a36981b165011b8f'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:55:25.488085 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-9bf2f501-fa93-45c6-b9cf-5dc6e7f2dbbc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e548e011cfb44b8a36981b165011b8f'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:55:25.488901 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-9bf2f501-fa93-45c6-b9cf-5dc6e7f2dbbc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e548e011cfb44b8a36981b165011b8f'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:55:25.506567 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1371/2762] 10.222.0.102 () {58 vars in 1229 bytes} [Mon Aug 1 15:55:25 2022] DELETE /identity/v3/users/0e548e011cfb44b8a36981b165011b8f => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:55:25.946954 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5033fc88-e6ec-4500-b9d4-3c0da2c43708 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:55:25.949445 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-5033fc88-e6ec-4500-b9d4-3c0da2c43708 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:55:25.963344 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5033fc88-e6ec-4500-b9d4-3c0da2c43708 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:55:25.993847 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:55:26.029967 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a541e14c-2bd9-4c89-9b39-b7e7e891e7ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:55:26.030616 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a541e14c-2bd9-4c89-9b39-b7e7e891e7ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:55:26.030895 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a541e14c-2bd9-4c89-9b39-b7e7e891e7ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:55:26.031167 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a541e14c-2bd9-4c89-9b39-b7e7e891e7ee admin admin] PATH_INFO: `/v3/projects/daf1e5d2629749c3a919238a613c34e4` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:55:26.032719 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a541e14c-2bd9-4c89-9b39-b7e7e891e7ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=daf1e5d2629749c3a919238a613c34e4)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:55:26.035837 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a541e14c-2bd9-4c89-9b39-b7e7e891e7ee admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:55:26.160060 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-a541e14c-2bd9-4c89-9b39-b7e7e891e7ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'daf1e5d2629749c3a919238a613c34e4', 'request_id': 'req-a541e14c-2bd9-4c89-9b39-b7e7e891e7ee'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:55:26.167262 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-a541e14c-2bd9-4c89-9b39-b7e7e891e7ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'daf1e5d2629749c3a919238a613c34e4', 'request_id': 'req-a541e14c-2bd9-4c89-9b39-b7e7e891e7ee'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:55:26.233971 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-a541e14c-2bd9-4c89-9b39-b7e7e891e7ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'daf1e5d2629749c3a919238a613c34e4', 'request_id': 'req-a541e14c-2bd9-4c89-9b39-b7e7e891e7ee'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:55:26.247574 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-a541e14c-2bd9-4c89-9b39-b7e7e891e7ee admin admin] The token cache is being invalidate because project daf1e5d2629749c3a919238a613c34e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80352) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 15:55:26.247895 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-a541e14c-2bd9-4c89-9b39-b7e7e891e7ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:55:26.248666 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-a541e14c-2bd9-4c89-9b39-b7e7e891e7ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:55:26.250285 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1392/2763] 10.222.0.102 () {58 vars in 1238 bytes} [Mon Aug 1 15:55:25 2022] DELETE /identity/v3/projects/daf1e5d2629749c3a919238a613c34e4 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:55:26.254511 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf2f501-fa93-45c6-b9cf-5dc6e7f2dbbc admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:55:26.255996 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-9bf2f501-fa93-45c6-b9cf-5dc6e7f2dbbc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:55:26.269534 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf2f501-fa93-45c6-b9cf-5dc6e7f2dbbc admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:55:26.332734 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1b2dd2-9277-4b35-bab7-66f8290daa53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:55:26.333852 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1b2dd2-9277-4b35-bab7-66f8290daa53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:55:26.334570 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1b2dd2-9277-4b35-bab7-66f8290daa53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:55:26.335030 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1b2dd2-9277-4b35-bab7-66f8290daa53 admin admin] PATH_INFO: `/v3/users/6f73319019e24d73b68e006c45d4d752` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:55:26.337207 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1b2dd2-9277-4b35-bab7-66f8290daa53 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f73319019e24d73b68e006c45d4d752)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:55:26.340612 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1b2dd2-9277-4b35-bab7-66f8290daa53 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:55:26.492058 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:55:26.532972 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-8e1b2dd2-9277-4b35-bab7-66f8290daa53 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f73319019e24d73b68e006c45d4d752'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:55:26.599433 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-8e1b2dd2-9277-4b35-bab7-66f8290daa53 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f73319019e24d73b68e006c45d4d752'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:55:26.615368 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-8e1b2dd2-9277-4b35-bab7-66f8290daa53 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f73319019e24d73b68e006c45d4d752'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:55:26.616104 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-8e1b2dd2-9277-4b35-bab7-66f8290daa53 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f73319019e24d73b68e006c45d4d752'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:55:26.616785 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-8e1b2dd2-9277-4b35-bab7-66f8290daa53 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f73319019e24d73b68e006c45d4d752'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:55:26.632285 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1372/2764] 10.222.0.102 () {58 vars in 1229 bytes} [Mon Aug 1 15:55:26 2022] DELETE /identity/v3/users/6f73319019e24d73b68e006c45d4d752 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:55:27.895468 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a541e14c-2bd9-4c89-9b39-b7e7e891e7ee admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:55:27.900703 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-a541e14c-2bd9-4c89-9b39-b7e7e891e7ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:55:27.919981 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a541e14c-2bd9-4c89-9b39-b7e7e891e7ee admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:55:28.024675 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61c446f-6dec-4a12-8554-44c96f83afdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:55:28.025473 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61c446f-6dec-4a12-8554-44c96f83afdf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:55:28.025825 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61c446f-6dec-4a12-8554-44c96f83afdf admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:55:28.026172 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61c446f-6dec-4a12-8554-44c96f83afdf admin admin] PATH_INFO: `/v3/projects/f44faa33c9684c56a3bf262204bf062d` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:55:28.027630 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61c446f-6dec-4a12-8554-44c96f83afdf admin admin] RBAC: Authorizing `identity:delete_project(project_id=f44faa33c9684c56a3bf262204bf062d)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:55:28.030560 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61c446f-6dec-4a12-8554-44c96f83afdf admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:55:28.162600 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-d61c446f-6dec-4a12-8554-44c96f83afdf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f44faa33c9684c56a3bf262204bf062d', 'request_id': 'req-d61c446f-6dec-4a12-8554-44c96f83afdf'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:55:28.184954 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-d61c446f-6dec-4a12-8554-44c96f83afdf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f44faa33c9684c56a3bf262204bf062d', 'request_id': 'req-d61c446f-6dec-4a12-8554-44c96f83afdf'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:55:28.236757 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-d61c446f-6dec-4a12-8554-44c96f83afdf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f44faa33c9684c56a3bf262204bf062d', 'request_id': 'req-d61c446f-6dec-4a12-8554-44c96f83afdf'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:55:28.238604 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:55:28.251422 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-d61c446f-6dec-4a12-8554-44c96f83afdf admin admin] The token cache is being invalidate because project f44faa33c9684c56a3bf262204bf062d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80352) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 15:55:28.251994 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-d61c446f-6dec-4a12-8554-44c96f83afdf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:55:28.252966 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-d61c446f-6dec-4a12-8554-44c96f83afdf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:55:28.258448 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1393/2765] 10.222.0.102 () {58 vars in 1238 bytes} [Mon Aug 1 15:55:27 2022] DELETE /identity/v3/projects/f44faa33c9684c56a3bf262204bf062d => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:55:28.260161 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a609a118-d2e4-476d-b2a0-7ac5e6a8bda8 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:55:28.260161 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a609a118-d2e4-476d-b2a0-7ac5e6a8bda8 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:55:28.260705 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a609a118-d2e4-476d-b2a0-7ac5e6a8bda8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:55:28.285837 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-a609a118-d2e4-476d-b2a0-7ac5e6a8bda8 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:55:28.287097 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-a609a118-d2e4-476d-b2a0-7ac5e6a8bda8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:55:28.377145 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1373/2766] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:55:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:55:28.384570 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f337f67-3bcd-41fa-9342-138f00d3e96e None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:55:28.384881 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f337f67-3bcd-41fa-9342-138f00d3e96e None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:55:28.385186 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f337f67-3bcd-41fa-9342-138f00d3e96e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:55:28.411141 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-2f337f67-3bcd-41fa-9342-138f00d3e96e None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:55:28.412288 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-2f337f67-3bcd-41fa-9342-138f00d3e96e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:55:28.434001 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1394/2767] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:55:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:55:28.438985 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a609a118-d2e4-476d-b2a0-7ac5e6a8bda8 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:55:28.459466 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a609a118-d2e4-476d-b2a0-7ac5e6a8bda8 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:55:28.466148 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c924298-d7d0-400a-8797-3ba9dbfe552b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:55:28.467489 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c924298-d7d0-400a-8797-3ba9dbfe552b admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:55:28.467686 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c924298-d7d0-400a-8797-3ba9dbfe552b admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:55:28.467976 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c924298-d7d0-400a-8797-3ba9dbfe552b admin admin] PATH_INFO: `/v3/domains` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:55:28.469044 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c924298-d7d0-400a-8797-3ba9dbfe552b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:55:28.469543 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c924298-d7d0-400a-8797-3ba9dbfe552b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:55:28.472132 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c924298-d7d0-400a-8797-3ba9dbfe552b admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:55:28.492814 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1374/2768] 10.222.0.102 () {58 vars in 1158 bytes} [Mon Aug 1 15:55:28 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:55:28.498011 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f337f67-3bcd-41fa-9342-138f00d3e96e None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:55:28.516717 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f337f67-3bcd-41fa-9342-138f00d3e96e None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:55:28.524154 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e420622b-1da3-49e1-9bf3-d6e6491920f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:55:28.527091 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e420622b-1da3-49e1-9bf3-d6e6491920f6 admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:55:28.527716 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e420622b-1da3-49e1-9bf3-d6e6491920f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:55:28.529701 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e420622b-1da3-49e1-9bf3-d6e6491920f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:55:28.530683 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e420622b-1da3-49e1-9bf3-d6e6491920f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:55:28.533983 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e420622b-1da3-49e1-9bf3-d6e6491920f6 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:55:28.664501 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1395/2769] 10.222.0.102 () {60 vars in 1158 bytes} [Mon Aug 1 15:55:28 2022] POST /identity/v3/projects => generated 374 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 15:55:28.666309 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c924298-d7d0-400a-8797-3ba9dbfe552b admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:55:28.678902 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c924298-d7d0-400a-8797-3ba9dbfe552b admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:55:28.791270 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71b3c1f-59b4-4703-a56e-dc8b182c8e4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:55:28.792060 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71b3c1f-59b4-4703-a56e-dc8b182c8e4f admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:55:28.792442 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71b3c1f-59b4-4703-a56e-dc8b182c8e4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:55:28.792750 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71b3c1f-59b4-4703-a56e-dc8b182c8e4f admin admin] PATH_INFO: `/v3/users` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:55:28.793539 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71b3c1f-59b4-4703-a56e-dc8b182c8e4f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:55:28.796291 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71b3c1f-59b4-4703-a56e-dc8b182c8e4f admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:55:28.952408 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1375/2770] 10.222.0.102 () {60 vars in 1149 bytes} [Mon Aug 1 15:55:28 2022] POST /identity/v3/users => generated 288 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 15:55:28.956570 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e420622b-1da3-49e1-9bf3-d6e6491920f6 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:55:28.969735 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e420622b-1da3-49e1-9bf3-d6e6491920f6 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:55:28.974785 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e21b449-ac8a-40be-b207-730f386b42a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:55:28.975827 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e21b449-ac8a-40be-b207-730f386b42a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:55:28.975827 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e21b449-ac8a-40be-b207-730f386b42a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:55:28.976058 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e21b449-ac8a-40be-b207-730f386b42a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:55:28.976646 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e21b449-ac8a-40be-b207-730f386b42a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:55:28.978462 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e21b449-ac8a-40be-b207-730f386b42a4 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:55:28.991382 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1396/2771] 10.222.0.102 () {58 vars in 1127 bytes} [Mon Aug 1 15:55:28 2022] GET /identity/v3/roles => generated 1427 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:55:28.994880 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71b3c1f-59b4-4703-a56e-dc8b182c8e4f admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:55:29.010236 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71b3c1f-59b4-4703-a56e-dc8b182c8e4f admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:55:29.019363 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0db7479-0101-40f1-90d7-0562fc200e98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:55:29.020774 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0db7479-0101-40f1-90d7-0562fc200e98 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:55:29.021371 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0db7479-0101-40f1-90d7-0562fc200e98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:55:29.021852 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0db7479-0101-40f1-90d7-0562fc200e98 admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:55:29.022793 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0db7479-0101-40f1-90d7-0562fc200e98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:55:29.025538 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0db7479-0101-40f1-90d7-0562fc200e98 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:55:29.039466 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1376/2772] 10.222.0.102 () {58 vars in 1127 bytes} [Mon Aug 1 15:55:28 2022] GET /identity/v3/roles => generated 1427 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:55:29.043725 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e21b449-ac8a-40be-b207-730f386b42a4 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:55:29.056595 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e21b449-ac8a-40be-b207-730f386b42a4 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:55:29.063001 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8c6193-dd9a-464d-a4e8-dcc9cc50d9a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:55:29.063804 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8c6193-dd9a-464d-a4e8-dcc9cc50d9a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:55:29.064086 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8c6193-dd9a-464d-a4e8-dcc9cc50d9a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:55:29.064514 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8c6193-dd9a-464d-a4e8-dcc9cc50d9a4 admin admin] PATH_INFO: `/v3/projects/f52ffa471cdc4f4aa652facb29b5526f/users/e12cb37988234aecb973ba456dc1044d/roles/27f5093ac0674d799cdbd17c68482e32` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:55:29.086128 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8c6193-dd9a-464d-a4e8-dcc9cc50d9a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f52ffa471cdc4f4aa652facb29b5526f, user_id=e12cb37988234aecb973ba456dc1044d, role_id=27f5093ac0674d799cdbd17c68482e32)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:55:29.088876 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8c6193-dd9a-464d-a4e8-dcc9cc50d9a4 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:55:29.199643 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b624e32-5a1e-4f2a-986a-5d57a059327e None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:55:29.199884 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b624e32-5a1e-4f2a-986a-5d57a059327e None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:55:29.200155 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b624e32-5a1e-4f2a-986a-5d57a059327e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:55:29.202996 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1397/2773] 10.222.0.102 () {60 vars in 1488 bytes} [Mon Aug 1 15:55:29 2022] PUT /identity/v3/projects/f52ffa471cdc4f4aa652facb29b5526f/users/e12cb37988234aecb973ba456dc1044d/roles/27f5093ac0674d799cdbd17c68482e32 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:55:29.220645 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-7b624e32-5a1e-4f2a-986a-5d57a059327e None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:55:29.221953 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-7b624e32-5a1e-4f2a-986a-5d57a059327e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:55:29.239108 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:55:29.299150 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1377/2774] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:55:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:55:29.307751 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8c6193-dd9a-464d-a4e8-dcc9cc50d9a4 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:55:29.310704 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-df8c6193-dd9a-464d-a4e8-dcc9cc50d9a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:55:29.384371 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8c6193-dd9a-464d-a4e8-dcc9cc50d9a4 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:55:29.389079 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4d8aae-f734-4003-8e29-66c76af1445e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a856a413100443939fe9b10daa868518', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:55:29.389312 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4d8aae-f734-4003-8e29-66c76af1445e service neutron] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:55:29.389586 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4d8aae-f734-4003-8e29-66c76af1445e service neutron] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:55:29.389871 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4d8aae-f734-4003-8e29-66c76af1445e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:55:29.399713 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4d8aae-f734-4003-8e29-66c76af1445e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:55:29.401196 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4d8aae-f734-4003-8e29-66c76af1445e service neutron] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:55:29.411493 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1398/2775] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:55:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:55:29.745173 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b05262b-bcf4-4271-a795-5d2e212aab9f None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:55:29.746639 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b05262b-bcf4-4271-a795-5d2e212aab9f None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:55:29.746929 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b05262b-bcf4-4271-a795-5d2e212aab9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:55:29.778163 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-0b05262b-bcf4-4271-a795-5d2e212aab9f None None] MFA Rules not processed for user `b2f73e2aa3744667bf16d5a303151284`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:55:29.779699 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-0b05262b-bcf4-4271-a795-5d2e212aab9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:55:29.845919 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1378/2776] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:55:29 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:55:30.774866 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4d8aae-f734-4003-8e29-66c76af1445e service neutron] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:55:30.776456 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-0c4d8aae-f734-4003-8e29-66c76af1445e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:55:30.790431 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4d8aae-f734-4003-8e29-66c76af1445e service neutron] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:55:30.797135 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473784c1-d52d-4c26-988a-994135be6f68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:55:30.797718 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473784c1-d52d-4c26-988a-994135be6f68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:55:30.798003 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473784c1-d52d-4c26-988a-994135be6f68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:55:30.798279 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473784c1-d52d-4c26-988a-994135be6f68 admin admin] PATH_INFO: `/v3/users/5a0bf81bcf784878acabeb03ccddcd1b` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:55:30.799553 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473784c1-d52d-4c26-988a-994135be6f68 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a0bf81bcf784878acabeb03ccddcd1b)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:55:30.801777 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473784c1-d52d-4c26-988a-994135be6f68 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:55:30.983870 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-473784c1-d52d-4c26-988a-994135be6f68 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a0bf81bcf784878acabeb03ccddcd1b'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:55:30.996054 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-473784c1-d52d-4c26-988a-994135be6f68 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a0bf81bcf784878acabeb03ccddcd1b'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:55:31.003210 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-473784c1-d52d-4c26-988a-994135be6f68 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a0bf81bcf784878acabeb03ccddcd1b'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:55:31.003918 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-473784c1-d52d-4c26-988a-994135be6f68 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a0bf81bcf784878acabeb03ccddcd1b'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:55:31.004530 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-473784c1-d52d-4c26-988a-994135be6f68 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a0bf81bcf784878acabeb03ccddcd1b'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:55:31.092091 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:DELETE=12,keystone:SELECT=85,keystone:INSERT=3 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:55:31.097685 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1399/2777] 10.222.0.102 () {58 vars in 1229 bytes} [Mon Aug 1 15:55:30 2022] DELETE /identity/v3/users/5a0bf81bcf784878acabeb03ccddcd1b => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:55:31.627499 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b05262b-bcf4-4271-a795-5d2e212aab9f None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:55:31.648225 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b05262b-bcf4-4271-a795-5d2e212aab9f None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:55:31.747561 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1f2286-656a-48d0-a1ac-fd12eb92d605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:55:31.748972 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1f2286-656a-48d0-a1ac-fd12eb92d605 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:55:31.749573 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1f2286-656a-48d0-a1ac-fd12eb92d605 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:55:31.751362 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1f2286-656a-48d0-a1ac-fd12eb92d605 admin admin] PATH_INFO: `/v3/projects/5fc13acbed3d4c56bd14a9d7044ce89b` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:55:31.757200 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1f2286-656a-48d0-a1ac-fd12eb92d605 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5fc13acbed3d4c56bd14a9d7044ce89b)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:55:31.759424 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1f2286-656a-48d0-a1ac-fd12eb92d605 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:55:31.930285 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-dc1f2286-656a-48d0-a1ac-fd12eb92d605 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5fc13acbed3d4c56bd14a9d7044ce89b', 'request_id': 'req-dc1f2286-656a-48d0-a1ac-fd12eb92d605'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:55:32.021534 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-dc1f2286-656a-48d0-a1ac-fd12eb92d605 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5fc13acbed3d4c56bd14a9d7044ce89b', 'request_id': 'req-dc1f2286-656a-48d0-a1ac-fd12eb92d605'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:55:32.033778 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-dc1f2286-656a-48d0-a1ac-fd12eb92d605 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5fc13acbed3d4c56bd14a9d7044ce89b', 'request_id': 'req-dc1f2286-656a-48d0-a1ac-fd12eb92d605'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:55:32.047810 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:55:32.070550 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-dc1f2286-656a-48d0-a1ac-fd12eb92d605 admin admin] The token cache is being invalidate because project 5fc13acbed3d4c56bd14a9d7044ce89b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80353) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 15:55:32.070550 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-dc1f2286-656a-48d0-a1ac-fd12eb92d605 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:55:32.070550 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-dc1f2286-656a-48d0-a1ac-fd12eb92d605 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:55:32.070550 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1379/2778] 10.222.0.102 () {58 vars in 1238 bytes} [Mon Aug 1 15:55:31 2022] DELETE /identity/v3/projects/5fc13acbed3d4c56bd14a9d7044ce89b => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:55:32.074290 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4d7f48-f4c2-46d8-8f1f-117051719cf2 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:55:32.075381 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4d7f48-f4c2-46d8-8f1f-117051719cf2 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:55:32.075862 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4d7f48-f4c2-46d8-8f1f-117051719cf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:55:32.103352 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-3d4d7f48-f4c2-46d8-8f1f-117051719cf2 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:55:32.104977 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-3d4d7f48-f4c2-46d8-8f1f-117051719cf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:55:32.172322 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1400/2779] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:55:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:55:32.183934 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8ad680-d23b-4136-9121-a07847f1ccfa None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:55:32.184218 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8ad680-d23b-4136-9121-a07847f1ccfa None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:55:32.188251 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8ad680-d23b-4136-9121-a07847f1ccfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:55:32.206268 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-2b8ad680-d23b-4136-9121-a07847f1ccfa None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:55:32.207502 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-2b8ad680-d23b-4136-9121-a07847f1ccfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:55:32.218552 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1380/2780] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:55:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:55:32.222487 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4d7f48-f4c2-46d8-8f1f-117051719cf2 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:55:32.233588 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4d7f48-f4c2-46d8-8f1f-117051719cf2 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:55:32.238454 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3e01fb-7a4e-47b7-b1c7-b799722bc62b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:55:32.243030 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3e01fb-7a4e-47b7-b1c7-b799722bc62b admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:55:32.243030 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3e01fb-7a4e-47b7-b1c7-b799722bc62b admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:55:32.243030 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3e01fb-7a4e-47b7-b1c7-b799722bc62b admin admin] PATH_INFO: `/v3/domains` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:55:32.243030 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3e01fb-7a4e-47b7-b1c7-b799722bc62b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:55:32.243030 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3e01fb-7a4e-47b7-b1c7-b799722bc62b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:55:32.243030 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3e01fb-7a4e-47b7-b1c7-b799722bc62b admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:55:32.254236 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1401/2781] 10.222.0.102 () {58 vars in 1158 bytes} [Mon Aug 1 15:55:32 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:55:32.258581 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8ad680-d23b-4136-9121-a07847f1ccfa None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:55:32.268787 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8ad680-d23b-4136-9121-a07847f1ccfa None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:55:32.275418 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8765f93f-90bb-48a4-b032-dde912013ec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:55:32.276164 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8765f93f-90bb-48a4-b032-dde912013ec7 admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:55:32.276548 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8765f93f-90bb-48a4-b032-dde912013ec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:55:32.276966 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8765f93f-90bb-48a4-b032-dde912013ec7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:55:32.278101 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8765f93f-90bb-48a4-b032-dde912013ec7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:55:32.280749 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8765f93f-90bb-48a4-b032-dde912013ec7 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:55:32.390589 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1381/2782] 10.222.0.102 () {60 vars in 1158 bytes} [Mon Aug 1 15:55:32 2022] POST /identity/v3/projects => generated 404 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:55:32.394017 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3e01fb-7a4e-47b7-b1c7-b799722bc62b admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:55:32.411213 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3e01fb-7a4e-47b7-b1c7-b799722bc62b admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:55:32.496083 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048fb7db-3767-465e-ace6-fcb91f3ffb76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:55:32.497106 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048fb7db-3767-465e-ace6-fcb91f3ffb76 admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:55:32.497481 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048fb7db-3767-465e-ace6-fcb91f3ffb76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:55:32.499739 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048fb7db-3767-465e-ace6-fcb91f3ffb76 admin admin] PATH_INFO: `/v3/users` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:55:32.499739 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048fb7db-3767-465e-ace6-fcb91f3ffb76 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:55:32.501052 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048fb7db-3767-465e-ace6-fcb91f3ffb76 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:55:32.629799 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1402/2783] 10.222.0.102 () {60 vars in 1149 bytes} [Mon Aug 1 15:55:32 2022] POST /identity/v3/users => generated 303 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:55:32.633946 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8765f93f-90bb-48a4-b032-dde912013ec7 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:55:32.650038 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8765f93f-90bb-48a4-b032-dde912013ec7 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:55:32.656689 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd5373e-b4ab-4df6-926d-e19bc2cca9a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:55:32.659058 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd5373e-b4ab-4df6-926d-e19bc2cca9a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:55:32.659058 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd5373e-b4ab-4df6-926d-e19bc2cca9a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:55:32.659058 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd5373e-b4ab-4df6-926d-e19bc2cca9a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:55:32.659571 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd5373e-b4ab-4df6-926d-e19bc2cca9a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:55:32.661755 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd5373e-b4ab-4df6-926d-e19bc2cca9a0 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:55:32.675438 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1382/2784] 10.222.0.102 () {58 vars in 1127 bytes} [Mon Aug 1 15:55:32 2022] GET /identity/v3/roles => generated 1427 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:55:32.680185 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048fb7db-3767-465e-ace6-fcb91f3ffb76 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:55:32.695699 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048fb7db-3767-465e-ace6-fcb91f3ffb76 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:55:32.704570 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e7f650-ef1a-4ab8-adbf-af3f71949637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:55:32.705263 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e7f650-ef1a-4ab8-adbf-af3f71949637 admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:55:32.705544 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e7f650-ef1a-4ab8-adbf-af3f71949637 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:55:32.705820 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e7f650-ef1a-4ab8-adbf-af3f71949637 admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:55:32.706675 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e7f650-ef1a-4ab8-adbf-af3f71949637 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:55:32.708434 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e7f650-ef1a-4ab8-adbf-af3f71949637 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:55:32.733360 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1403/2785] 10.222.0.102 () {58 vars in 1127 bytes} [Mon Aug 1 15:55:32 2022] GET /identity/v3/roles => generated 1427 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:55:32.734283 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd5373e-b4ab-4df6-926d-e19bc2cca9a0 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:55:32.751162 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd5373e-b4ab-4df6-926d-e19bc2cca9a0 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:55:32.762478 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caf969f-f718-4a86-9056-1fbd519bed24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:55:32.763423 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caf969f-f718-4a86-9056-1fbd519bed24 admin admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:55:32.763834 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caf969f-f718-4a86-9056-1fbd519bed24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:55:32.764194 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caf969f-f718-4a86-9056-1fbd519bed24 admin admin] PATH_INFO: `/v3/projects/f61af10ba521488d92c7c4bee3340fe2/users/b7ce878254d84fadb7f7d2ac6b345213/roles/27f5093ac0674d799cdbd17c68482e32` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:55:32.782854 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6caf969f-f718-4a86-9056-1fbd519bed24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f61af10ba521488d92c7c4bee3340fe2, user_id=b7ce878254d84fadb7f7d2ac6b345213, role_id=27f5093ac0674d799cdbd17c68482e32)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:55:32.785905 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6caf969f-f718-4a86-9056-1fbd519bed24 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:55:32.881430 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1383/2786] 10.222.0.102 () {60 vars in 1488 bytes} [Mon Aug 1 15:55:32 2022] PUT /identity/v3/projects/f61af10ba521488d92c7c4bee3340fe2/users/b7ce878254d84fadb7f7d2ac6b345213/roles/27f5093ac0674d799cdbd17c68482e32 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 15:55:32.889584 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b195e1b-5eae-43ee-ac17-9f53164831ed None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:55:32.889887 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b195e1b-5eae-43ee-ac17-9f53164831ed None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:55:32.890143 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b195e1b-5eae-43ee-ac17-9f53164831ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:55:32.912236 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-4b195e1b-5eae-43ee-ac17-9f53164831ed None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:55:32.913495 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-4b195e1b-5eae-43ee-ac17-9f53164831ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:55:32.986214 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1404/2787] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:55:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:55:32.995752 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caf969f-f718-4a86-9056-1fbd519bed24 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:55:32.997601 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-6caf969f-f718-4a86-9056-1fbd519bed24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:55:33.069150 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caf969f-f718-4a86-9056-1fbd519bed24 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:55:33.073571 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e45eca3-4f65-48b6-8296-361f95fc0e57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a856a413100443939fe9b10daa868518', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:55:33.074681 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e45eca3-4f65-48b6-8296-361f95fc0e57 service neutron] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:55:33.074681 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e45eca3-4f65-48b6-8296-361f95fc0e57 service neutron] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:55:33.075102 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e45eca3-4f65-48b6-8296-361f95fc0e57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:55:33.088211 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e45eca3-4f65-48b6-8296-361f95fc0e57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:55:33.090092 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e45eca3-4f65-48b6-8296-361f95fc0e57 service neutron] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:55:33.114838 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1384/2788] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:55:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:55:35.036039 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1975e81-f18a-4dc5-851b-eec53c106e06 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:55:35.036628 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1975e81-f18a-4dc5-851b-eec53c106e06 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:55:35.036628 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1975e81-f18a-4dc5-851b-eec53c106e06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:55:35.052438 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:55:35.068317 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-b1975e81-f18a-4dc5-851b-eec53c106e06 None None] MFA Rules not processed for user `b7ce878254d84fadb7f7d2ac6b345213`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:55:35.071877 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-b1975e81-f18a-4dc5-851b-eec53c106e06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:55:35.166319 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1405/2789] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:55:35 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:55:35.170297 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e45eca3-4f65-48b6-8296-361f95fc0e57 service neutron] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:55:35.191037 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e45eca3-4f65-48b6-8296-361f95fc0e57 service neutron] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:55:35.203029 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227b63c9-15a2-4625-86bc-359bbb1f18fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:55:35.203820 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227b63c9-15a2-4625-86bc-359bbb1f18fb admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:55:35.204170 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227b63c9-15a2-4625-86bc-359bbb1f18fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:55:35.204570 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227b63c9-15a2-4625-86bc-359bbb1f18fb admin admin] PATH_INFO: `/v3/projects` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:55:35.205590 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227b63c9-15a2-4625-86bc-359bbb1f18fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:55:35.207579 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227b63c9-15a2-4625-86bc-359bbb1f18fb admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:55:35.312283 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1385/2790] 10.222.0.102 () {60 vars in 1158 bytes} [Mon Aug 1 15:55:35 2022] POST /identity/v3/projects => generated 404 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:55:35.315998 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1975e81-f18a-4dc5-851b-eec53c106e06 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:55:35.333773 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1975e81-f18a-4dc5-851b-eec53c106e06 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:55:35.436810 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afb6968-671f-436d-a87b-edec42d8e2ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:55:35.437853 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afb6968-671f-436d-a87b-edec42d8e2ff admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:55:35.438294 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afb6968-671f-436d-a87b-edec42d8e2ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:55:35.441540 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afb6968-671f-436d-a87b-edec42d8e2ff admin admin] PATH_INFO: `/v3/users` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:55:35.441540 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afb6968-671f-436d-a87b-edec42d8e2ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:55:35.441911 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afb6968-671f-436d-a87b-edec42d8e2ff admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:55:35.556111 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1406/2791] 10.222.0.102 () {60 vars in 1149 bytes} [Mon Aug 1 15:55:35 2022] POST /identity/v3/users => generated 309 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:55:35.560611 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227b63c9-15a2-4625-86bc-359bbb1f18fb admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:55:35.574697 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227b63c9-15a2-4625-86bc-359bbb1f18fb admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:55:35.580886 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f45de1-5805-494f-bd0c-246db40e3632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:55:35.581772 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f45de1-5805-494f-bd0c-246db40e3632 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:55:35.582346 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f45de1-5805-494f-bd0c-246db40e3632 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:55:35.582772 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f45de1-5805-494f-bd0c-246db40e3632 admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:55:35.583705 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f45de1-5805-494f-bd0c-246db40e3632 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:55:35.585946 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f45de1-5805-494f-bd0c-246db40e3632 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:55:35.608863 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1386/2792] 10.222.0.102 () {58 vars in 1127 bytes} [Mon Aug 1 15:55:35 2022] GET /identity/v3/roles => generated 1427 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:55:35.609890 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afb6968-671f-436d-a87b-edec42d8e2ff admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:55:35.623027 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afb6968-671f-436d-a87b-edec42d8e2ff admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:55:35.633976 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d630cb-e314-4b58-8177-ee8f0519e517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:55:35.634672 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d630cb-e314-4b58-8177-ee8f0519e517 admin admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:55:35.634956 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d630cb-e314-4b58-8177-ee8f0519e517 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:55:35.635233 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d630cb-e314-4b58-8177-ee8f0519e517 admin admin] PATH_INFO: `/v3/projects/3ec3b5b169d340209d5ba194dd244331/users/3e41cae767a14c218c72b9d4b994afcd/roles/de1374f966c04c27b579515b54334fd2` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:55:35.652890 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d630cb-e314-4b58-8177-ee8f0519e517 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ec3b5b169d340209d5ba194dd244331, user_id=3e41cae767a14c218c72b9d4b994afcd, role_id=de1374f966c04c27b579515b54334fd2)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:55:35.656632 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d630cb-e314-4b58-8177-ee8f0519e517 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:55:35.757770 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1407/2793] 10.222.0.102 () {60 vars in 1488 bytes} [Mon Aug 1 15:55:35 2022] PUT /identity/v3/projects/3ec3b5b169d340209d5ba194dd244331/users/3e41cae767a14c218c72b9d4b994afcd/roles/de1374f966c04c27b579515b54334fd2 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 15:55:35.764301 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f45de1-5805-494f-bd0c-246db40e3632 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:55:35.775580 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f45de1-5805-494f-bd0c-246db40e3632 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:55:35.861539 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3086814-0565-42bc-83f0-c7f5722f1f14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:55:35.862427 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3086814-0565-42bc-83f0-c7f5722f1f14 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:55:35.863314 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3086814-0565-42bc-83f0-c7f5722f1f14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:55:35.863664 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3086814-0565-42bc-83f0-c7f5722f1f14 admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:55:35.864487 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3086814-0565-42bc-83f0-c7f5722f1f14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:55:35.866713 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3086814-0565-42bc-83f0-c7f5722f1f14 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:55:35.868539 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:55:35.882485 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1387/2794] 10.222.0.102 () {58 vars in 1127 bytes} [Mon Aug 1 15:55:35 2022] GET /identity/v3/roles => generated 1427 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:55:35.883541 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d630cb-e314-4b58-8177-ee8f0519e517 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:55:35.899287 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d630cb-e314-4b58-8177-ee8f0519e517 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:55:35.904671 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37170fa0-a517-4d4b-a419-f09972ffeb99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:55:35.905650 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37170fa0-a517-4d4b-a419-f09972ffeb99 admin admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:55:35.905936 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37170fa0-a517-4d4b-a419-f09972ffeb99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:55:35.906209 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37170fa0-a517-4d4b-a419-f09972ffeb99 admin admin] PATH_INFO: `/v3/projects/3ec3b5b169d340209d5ba194dd244331/users/3e41cae767a14c218c72b9d4b994afcd/roles/de1374f966c04c27b579515b54334fd2` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:55:35.908621 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37170fa0-a517-4d4b-a419-f09972ffeb99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ec3b5b169d340209d5ba194dd244331, user_id=3e41cae767a14c218c72b9d4b994afcd, role_id=de1374f966c04c27b579515b54334fd2)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:55:35.911359 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37170fa0-a517-4d4b-a419-f09972ffeb99 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:55:35.927284 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1408/2795] 10.222.0.102 () {60 vars in 1488 bytes} [Mon Aug 1 15:55:35 2022] PUT /identity/v3/projects/3ec3b5b169d340209d5ba194dd244331/users/3e41cae767a14c218c72b9d4b994afcd/roles/de1374f966c04c27b579515b54334fd2 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:55:36.502787 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d9e649-04ee-4eb5-bd2a-4a98183321b1 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:55:36.503332 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d9e649-04ee-4eb5-bd2a-4a98183321b1 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:55:36.503332 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d9e649-04ee-4eb5-bd2a-4a98183321b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:55:36.539154 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-39d9e649-04ee-4eb5-bd2a-4a98183321b1 None None] MFA Rules not processed for user `e12cb37988234aecb973ba456dc1044d`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:55:36.540583 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-39d9e649-04ee-4eb5-bd2a-4a98183321b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:55:36.619356 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1388/2796] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:55:36 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:55:36.619626 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37170fa0-a517-4d4b-a419-f09972ffeb99 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:55:36.621455 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-37170fa0-a517-4d4b-a419-f09972ffeb99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:55:36.714975 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37170fa0-a517-4d4b-a419-f09972ffeb99 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:55:36.720507 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310e4eb9-40ee-4a02-8c66-e32a2034cad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:55:36.721170 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310e4eb9-40ee-4a02-8c66-e32a2034cad6 admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:55:36.721469 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310e4eb9-40ee-4a02-8c66-e32a2034cad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:55:36.721725 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310e4eb9-40ee-4a02-8c66-e32a2034cad6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:55:36.722401 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310e4eb9-40ee-4a02-8c66-e32a2034cad6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:55:36.724372 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310e4eb9-40ee-4a02-8c66-e32a2034cad6 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:55:36.799037 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:55:36.883781 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1409/2797] 10.222.0.102 () {60 vars in 1158 bytes} [Mon Aug 1 15:55:36 2022] POST /identity/v3/projects => generated 372 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:55:36.885627 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d9e649-04ee-4eb5-bd2a-4a98183321b1 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:55:36.909985 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d9e649-04ee-4eb5-bd2a-4a98183321b1 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:55:36.986609 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed001f7-e1f2-4093-b7b2-632b7285b244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:55:36.987248 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed001f7-e1f2-4093-b7b2-632b7285b244 admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:55:36.987534 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed001f7-e1f2-4093-b7b2-632b7285b244 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:55:36.987834 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed001f7-e1f2-4093-b7b2-632b7285b244 admin admin] PATH_INFO: `/v3/users` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:55:36.988502 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed001f7-e1f2-4093-b7b2-632b7285b244 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:55:36.990529 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed001f7-e1f2-4093-b7b2-632b7285b244 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:55:37.105813 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1389/2798] 10.222.0.102 () {60 vars in 1149 bytes} [Mon Aug 1 15:55:36 2022] POST /identity/v3/users => generated 293 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:55:37.110215 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310e4eb9-40ee-4a02-8c66-e32a2034cad6 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:55:37.125417 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310e4eb9-40ee-4a02-8c66-e32a2034cad6 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:55:37.131054 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf69b6b-40bb-4a51-babf-4ecce974b352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:55:37.133353 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf69b6b-40bb-4a51-babf-4ecce974b352 admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:55:37.133353 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf69b6b-40bb-4a51-babf-4ecce974b352 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:55:37.133353 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf69b6b-40bb-4a51-babf-4ecce974b352 admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:55:37.133649 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf69b6b-40bb-4a51-babf-4ecce974b352 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:55:37.135045 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf69b6b-40bb-4a51-babf-4ecce974b352 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:55:37.148111 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1410/2799] 10.222.0.102 () {58 vars in 1127 bytes} [Mon Aug 1 15:55:37 2022] GET /identity/v3/roles => generated 1427 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:55:37.152221 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed001f7-e1f2-4093-b7b2-632b7285b244 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:55:37.164414 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed001f7-e1f2-4093-b7b2-632b7285b244 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:55:37.170373 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4035be23-1554-4e31-8734-0ee4249c6718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:55:37.171205 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4035be23-1554-4e31-8734-0ee4249c6718 admin admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:55:37.173618 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4035be23-1554-4e31-8734-0ee4249c6718 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:55:37.173618 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4035be23-1554-4e31-8734-0ee4249c6718 admin admin] PATH_INFO: `/v3/projects/481d13e6162c49f3a37b11ca5cc9e7ed/users/356251660a26431e95b2e9fd450ad5e1/roles/de1374f966c04c27b579515b54334fd2` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:55:37.211936 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4035be23-1554-4e31-8734-0ee4249c6718 admin admin] RBAC: Authorizing `identity:create_grant(project_id=481d13e6162c49f3a37b11ca5cc9e7ed, user_id=356251660a26431e95b2e9fd450ad5e1, role_id=de1374f966c04c27b579515b54334fd2)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:55:37.216936 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4035be23-1554-4e31-8734-0ee4249c6718 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:55:37.297892 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1390/2800] 10.222.0.102 () {60 vars in 1488 bytes} [Mon Aug 1 15:55:37 2022] PUT /identity/v3/projects/481d13e6162c49f3a37b11ca5cc9e7ed/users/356251660a26431e95b2e9fd450ad5e1/roles/de1374f966c04c27b579515b54334fd2 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:55:37.303090 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf69b6b-40bb-4a51-babf-4ecce974b352 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:55:37.315819 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf69b6b-40bb-4a51-babf-4ecce974b352 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:55:37.410034 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51a5cd3-2fa9-4510-b695-a00b67e2dc5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:55:37.410659 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51a5cd3-2fa9-4510-b695-a00b67e2dc5e admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:55:37.411267 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51a5cd3-2fa9-4510-b695-a00b67e2dc5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:55:37.411582 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51a5cd3-2fa9-4510-b695-a00b67e2dc5e admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:55:37.412293 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51a5cd3-2fa9-4510-b695-a00b67e2dc5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:55:37.413950 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51a5cd3-2fa9-4510-b695-a00b67e2dc5e admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:55:37.426857 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1411/2801] 10.222.0.102 () {58 vars in 1127 bytes} [Mon Aug 1 15:55:37 2022] GET /identity/v3/roles => generated 1427 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:55:37.431765 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4035be23-1554-4e31-8734-0ee4249c6718 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:55:37.443756 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4035be23-1554-4e31-8734-0ee4249c6718 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:55:37.449171 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b577af-d132-48bb-98ce-a698885a8804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:55:37.449950 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b577af-d132-48bb-98ce-a698885a8804 admin admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:55:37.450231 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b577af-d132-48bb-98ce-a698885a8804 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:55:37.451361 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b577af-d132-48bb-98ce-a698885a8804 admin admin] PATH_INFO: `/v3/projects/481d13e6162c49f3a37b11ca5cc9e7ed/users/356251660a26431e95b2e9fd450ad5e1/roles/de1374f966c04c27b579515b54334fd2` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:55:37.453745 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b577af-d132-48bb-98ce-a698885a8804 admin admin] RBAC: Authorizing `identity:create_grant(project_id=481d13e6162c49f3a37b11ca5cc9e7ed, user_id=356251660a26431e95b2e9fd450ad5e1, role_id=de1374f966c04c27b579515b54334fd2)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:55:37.456419 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b577af-d132-48bb-98ce-a698885a8804 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:55:37.469687 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1391/2802] 10.222.0.102 () {60 vars in 1488 bytes} [Mon Aug 1 15:55:37 2022] PUT /identity/v3/projects/481d13e6162c49f3a37b11ca5cc9e7ed/users/356251660a26431e95b2e9fd450ad5e1/roles/de1374f966c04c27b579515b54334fd2 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:55:37.731370 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ceec59-5869-4f01-a212-45a95e945598 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:55:37.732609 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ceec59-5869-4f01-a212-45a95e945598 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:55:37.732609 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ceec59-5869-4f01-a212-45a95e945598 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:55:37.775181 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-15ceec59-5869-4f01-a212-45a95e945598 None None] MFA Rules not processed for user `3e41cae767a14c218c72b9d4b994afcd`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:55:37.776523 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-15ceec59-5869-4f01-a212-45a95e945598 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:55:37.852984 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1412/2803] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:55:37 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:55:39.911053 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b577af-d132-48bb-98ce-a698885a8804 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:55:39.998706 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:55:40.032208 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b577af-d132-48bb-98ce-a698885a8804 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:55:40.043320 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871bcfa8-8459-4069-b6d4-cfc933caeb8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:55:40.044554 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871bcfa8-8459-4069-b6d4-cfc933caeb8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:55:40.045122 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871bcfa8-8459-4069-b6d4-cfc933caeb8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:55:40.045626 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871bcfa8-8459-4069-b6d4-cfc933caeb8c admin admin] PATH_INFO: `/v3/users/b7ce878254d84fadb7f7d2ac6b345213` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:55:40.047264 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871bcfa8-8459-4069-b6d4-cfc933caeb8c admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7ce878254d84fadb7f7d2ac6b345213)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:55:40.049471 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871bcfa8-8459-4069-b6d4-cfc933caeb8c admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:55:40.275863 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-871bcfa8-8459-4069-b6d4-cfc933caeb8c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7ce878254d84fadb7f7d2ac6b345213'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:55:40.364064 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-871bcfa8-8459-4069-b6d4-cfc933caeb8c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7ce878254d84fadb7f7d2ac6b345213'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:55:40.379409 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-871bcfa8-8459-4069-b6d4-cfc933caeb8c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7ce878254d84fadb7f7d2ac6b345213'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:55:40.380233 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-871bcfa8-8459-4069-b6d4-cfc933caeb8c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7ce878254d84fadb7f7d2ac6b345213'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:55:40.380887 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-871bcfa8-8459-4069-b6d4-cfc933caeb8c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7ce878254d84fadb7f7d2ac6b345213'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:55:40.394530 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1392/2804] 10.222.0.102 () {58 vars in 1229 bytes} [Mon Aug 1 15:55:39 2022] DELETE /identity/v3/users/b7ce878254d84fadb7f7d2ac6b345213 => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:55:40.766525 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ceec59-5869-4f01-a212-45a95e945598 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:55:40.792879 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ceec59-5869-4f01-a212-45a95e945598 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:55:40.886621 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:55:40.910320 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0ba3ac-9821-40e7-968d-ca6a5aa2391e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:55:40.911181 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0ba3ac-9821-40e7-968d-ca6a5aa2391e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:55:40.911678 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0ba3ac-9821-40e7-968d-ca6a5aa2391e admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:55:40.912051 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0ba3ac-9821-40e7-968d-ca6a5aa2391e admin admin] PATH_INFO: `/v3/projects/f61af10ba521488d92c7c4bee3340fe2` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:55:40.913380 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0ba3ac-9821-40e7-968d-ca6a5aa2391e admin admin] RBAC: Authorizing `identity:delete_project(project_id=f61af10ba521488d92c7c4bee3340fe2)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:55:40.915458 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0ba3ac-9821-40e7-968d-ca6a5aa2391e admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:55:41.065618 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-af0ba3ac-9821-40e7-968d-ca6a5aa2391e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f61af10ba521488d92c7c4bee3340fe2', 'request_id': 'req-af0ba3ac-9821-40e7-968d-ca6a5aa2391e'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:55:41.075344 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-af0ba3ac-9821-40e7-968d-ca6a5aa2391e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f61af10ba521488d92c7c4bee3340fe2', 'request_id': 'req-af0ba3ac-9821-40e7-968d-ca6a5aa2391e'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:55:41.141870 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-af0ba3ac-9821-40e7-968d-ca6a5aa2391e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f61af10ba521488d92c7c4bee3340fe2', 'request_id': 'req-af0ba3ac-9821-40e7-968d-ca6a5aa2391e'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:55:41.155176 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-af0ba3ac-9821-40e7-968d-ca6a5aa2391e admin admin] The token cache is being invalidate because project f61af10ba521488d92c7c4bee3340fe2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80352) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 15:55:41.156554 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-af0ba3ac-9821-40e7-968d-ca6a5aa2391e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:55:41.161905 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-af0ba3ac-9821-40e7-968d-ca6a5aa2391e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:55:41.164764 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1413/2805] 10.222.0.102 () {58 vars in 1238 bytes} [Mon Aug 1 15:55:40 2022] DELETE /identity/v3/projects/f61af10ba521488d92c7c4bee3340fe2 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:55:41.169219 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871bcfa8-8459-4069-b6d4-cfc933caeb8c admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:55:41.176014 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-871bcfa8-8459-4069-b6d4-cfc933caeb8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:55:41.186920 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871bcfa8-8459-4069-b6d4-cfc933caeb8c admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:55:41.257293 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b715704-0e96-4166-a5c8-54923151b15d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:55:41.257949 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b715704-0e96-4166-a5c8-54923151b15d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:55:41.258227 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b715704-0e96-4166-a5c8-54923151b15d admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:55:41.258507 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b715704-0e96-4166-a5c8-54923151b15d admin admin] PATH_INFO: `/v3/users/3e41cae767a14c218c72b9d4b994afcd` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:55:41.259739 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b715704-0e96-4166-a5c8-54923151b15d admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e41cae767a14c218c72b9d4b994afcd)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:55:41.261739 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b715704-0e96-4166-a5c8-54923151b15d admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:55:41.445235 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-5b715704-0e96-4166-a5c8-54923151b15d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e41cae767a14c218c72b9d4b994afcd'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:55:41.545565 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-5b715704-0e96-4166-a5c8-54923151b15d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e41cae767a14c218c72b9d4b994afcd'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:55:41.551424 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:55:41.561447 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-5b715704-0e96-4166-a5c8-54923151b15d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e41cae767a14c218c72b9d4b994afcd'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:55:41.562265 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-5b715704-0e96-4166-a5c8-54923151b15d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e41cae767a14c218c72b9d4b994afcd'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:55:41.562961 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-5b715704-0e96-4166-a5c8-54923151b15d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e41cae767a14c218c72b9d4b994afcd'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:55:41.579674 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1393/2806] 10.222.0.102 () {58 vars in 1229 bytes} [Mon Aug 1 15:55:41 2022] DELETE /identity/v3/users/3e41cae767a14c218c72b9d4b994afcd => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:55:41.930080 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0ba3ac-9821-40e7-968d-ca6a5aa2391e admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:55:41.932154 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-af0ba3ac-9821-40e7-968d-ca6a5aa2391e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:55:41.955349 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0ba3ac-9821-40e7-968d-ca6a5aa2391e admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:55:42.041134 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a95f24c-9662-4948-9f64-1022d745997f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:55:42.042685 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a95f24c-9662-4948-9f64-1022d745997f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:55:42.042685 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a95f24c-9662-4948-9f64-1022d745997f admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:55:42.042685 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a95f24c-9662-4948-9f64-1022d745997f admin admin] PATH_INFO: `/v3/projects/3ec3b5b169d340209d5ba194dd244331` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:55:42.043788 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a95f24c-9662-4948-9f64-1022d745997f admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ec3b5b169d340209d5ba194dd244331)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:55:42.047153 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a95f24c-9662-4948-9f64-1022d745997f admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:55:42.161144 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-4a95f24c-9662-4948-9f64-1022d745997f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ec3b5b169d340209d5ba194dd244331', 'request_id': 'req-4a95f24c-9662-4948-9f64-1022d745997f'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:55:42.167723 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-4a95f24c-9662-4948-9f64-1022d745997f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ec3b5b169d340209d5ba194dd244331', 'request_id': 'req-4a95f24c-9662-4948-9f64-1022d745997f'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:55:42.239366 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-4a95f24c-9662-4948-9f64-1022d745997f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ec3b5b169d340209d5ba194dd244331', 'request_id': 'req-4a95f24c-9662-4948-9f64-1022d745997f'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:55:42.264594 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-4a95f24c-9662-4948-9f64-1022d745997f admin admin] The token cache is being invalidate because project 3ec3b5b169d340209d5ba194dd244331 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80352) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 15:55:42.264949 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-4a95f24c-9662-4948-9f64-1022d745997f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:55:42.265574 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-4a95f24c-9662-4948-9f64-1022d745997f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:55:42.267438 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1414/2807] 10.222.0.102 () {58 vars in 1238 bytes} [Mon Aug 1 15:55:41 2022] DELETE /identity/v3/projects/3ec3b5b169d340209d5ba194dd244331 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:55:42.272129 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54e7919-96ef-493c-8bc7-16015cbd08e0 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:55:42.273026 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54e7919-96ef-493c-8bc7-16015cbd08e0 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:55:42.273490 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54e7919-96ef-493c-8bc7-16015cbd08e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:55:42.302357 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-e54e7919-96ef-493c-8bc7-16015cbd08e0 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:55:42.302357 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-e54e7919-96ef-493c-8bc7-16015cbd08e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:55:42.414099 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1394/2808] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:55:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:55:42.421974 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610eac01-fa15-4807-b4a5-6c982faacc0a None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:55:42.422376 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610eac01-fa15-4807-b4a5-6c982faacc0a None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:55:42.422751 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610eac01-fa15-4807-b4a5-6c982faacc0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:55:42.434569 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:55:42.482246 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-610eac01-fa15-4807-b4a5-6c982faacc0a None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:55:42.484443 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-610eac01-fa15-4807-b4a5-6c982faacc0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:55:42.498750 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1415/2809] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:55:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 15:55:42.507363 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54e7919-96ef-493c-8bc7-16015cbd08e0 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:55:42.519145 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54e7919-96ef-493c-8bc7-16015cbd08e0 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:55:42.545055 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158eeae8-d3f7-4054-b83d-c53f1575283c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:55:42.545629 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158eeae8-d3f7-4054-b83d-c53f1575283c admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:55:42.550518 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158eeae8-d3f7-4054-b83d-c53f1575283c admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:55:42.551889 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158eeae8-d3f7-4054-b83d-c53f1575283c admin admin] PATH_INFO: `/v3/domains` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:55:42.553170 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158eeae8-d3f7-4054-b83d-c53f1575283c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:55:42.553636 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158eeae8-d3f7-4054-b83d-c53f1575283c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:55:42.555517 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158eeae8-d3f7-4054-b83d-c53f1575283c admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:55:42.576665 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1395/2810] 10.222.0.102 () {58 vars in 1158 bytes} [Mon Aug 1 15:55:42 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:55:42.580760 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610eac01-fa15-4807-b4a5-6c982faacc0a None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:55:42.594144 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610eac01-fa15-4807-b4a5-6c982faacc0a None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:55:42.605675 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4802a692-bba0-498e-9f0a-063464d39dc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:55:42.606344 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4802a692-bba0-498e-9f0a-063464d39dc5 admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:55:42.606655 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4802a692-bba0-498e-9f0a-063464d39dc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:55:42.606934 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4802a692-bba0-498e-9f0a-063464d39dc5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:55:42.607681 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4802a692-bba0-498e-9f0a-063464d39dc5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:55:42.610076 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4802a692-bba0-498e-9f0a-063464d39dc5 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:55:42.736904 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1416/2811] 10.222.0.102 () {60 vars in 1158 bytes} [Mon Aug 1 15:55:42 2022] POST /identity/v3/projects => generated 366 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:55:42.741013 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158eeae8-d3f7-4054-b83d-c53f1575283c admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:55:42.762591 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158eeae8-d3f7-4054-b83d-c53f1575283c admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:55:42.866293 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96917548-e72e-45f6-bd22-e095a773ff7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:55:42.867612 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96917548-e72e-45f6-bd22-e095a773ff7d admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:55:42.868000 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96917548-e72e-45f6-bd22-e095a773ff7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:55:42.868378 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96917548-e72e-45f6-bd22-e095a773ff7d admin admin] PATH_INFO: `/v3/users` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:55:42.869221 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96917548-e72e-45f6-bd22-e095a773ff7d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:55:42.871903 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96917548-e72e-45f6-bd22-e095a773ff7d admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:55:43.047102 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1396/2812] 10.222.0.102 () {60 vars in 1149 bytes} [Mon Aug 1 15:55:42 2022] POST /identity/v3/users => generated 284 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:55:43.050448 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4802a692-bba0-498e-9f0a-063464d39dc5 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:55:43.070755 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4802a692-bba0-498e-9f0a-063464d39dc5 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:55:43.083976 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825136bb-60e6-4f81-bbe5-7cd4ffdfc116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:55:43.084775 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825136bb-60e6-4f81-bbe5-7cd4ffdfc116 admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:55:43.085177 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825136bb-60e6-4f81-bbe5-7cd4ffdfc116 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:55:43.085686 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825136bb-60e6-4f81-bbe5-7cd4ffdfc116 admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:55:43.088805 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825136bb-60e6-4f81-bbe5-7cd4ffdfc116 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:55:43.091956 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825136bb-60e6-4f81-bbe5-7cd4ffdfc116 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:55:43.113888 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1417/2813] 10.222.0.102 () {58 vars in 1127 bytes} [Mon Aug 1 15:55:43 2022] GET /identity/v3/roles => generated 1427 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:55:43.118632 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96917548-e72e-45f6-bd22-e095a773ff7d admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:55:43.148999 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96917548-e72e-45f6-bd22-e095a773ff7d admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:55:43.158000 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c887ef-bec8-43f6-b068-d1a384b4faf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:55:43.160164 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c887ef-bec8-43f6-b068-d1a384b4faf3 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:55:43.160465 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c887ef-bec8-43f6-b068-d1a384b4faf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:55:43.160782 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c887ef-bec8-43f6-b068-d1a384b4faf3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:55:43.162087 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c887ef-bec8-43f6-b068-d1a384b4faf3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:55:43.164068 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c887ef-bec8-43f6-b068-d1a384b4faf3 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:55:43.180969 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1397/2814] 10.222.0.102 () {58 vars in 1127 bytes} [Mon Aug 1 15:55:43 2022] GET /identity/v3/roles => generated 1427 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:55:43.185801 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825136bb-60e6-4f81-bbe5-7cd4ffdfc116 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:55:43.196688 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825136bb-60e6-4f81-bbe5-7cd4ffdfc116 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:55:43.202707 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba110be-1a35-484e-8967-ea47d57bdd6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:55:43.203838 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba110be-1a35-484e-8967-ea47d57bdd6e admin admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:55:43.205326 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba110be-1a35-484e-8967-ea47d57bdd6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:55:43.205326 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba110be-1a35-484e-8967-ea47d57bdd6e admin admin] PATH_INFO: `/v3/projects/24060d06276d4e299ddb7712f3a3a72a/users/77e340ac59194ebab0e3fac08c6d71e3/roles/27f5093ac0674d799cdbd17c68482e32` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:55:43.232424 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba110be-1a35-484e-8967-ea47d57bdd6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=24060d06276d4e299ddb7712f3a3a72a, user_id=77e340ac59194ebab0e3fac08c6d71e3, role_id=27f5093ac0674d799cdbd17c68482e32)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:55:43.239442 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba110be-1a35-484e-8967-ea47d57bdd6e admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:55:43.343794 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1418/2815] 10.222.0.102 () {60 vars in 1488 bytes} [Mon Aug 1 15:55:43 2022] PUT /identity/v3/projects/24060d06276d4e299ddb7712f3a3a72a/users/77e340ac59194ebab0e3fac08c6d71e3/roles/27f5093ac0674d799cdbd17c68482e32 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:55:43.352639 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9161752e-520f-4266-b742-85e99a46ec41 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:55:43.353087 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9161752e-520f-4266-b742-85e99a46ec41 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:55:43.353235 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9161752e-520f-4266-b742-85e99a46ec41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:55:43.383073 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-9161752e-520f-4266-b742-85e99a46ec41 None None] MFA Rules not processed for user `77e340ac59194ebab0e3fac08c6d71e3`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:55:43.384304 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-9161752e-520f-4266-b742-85e99a46ec41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:55:43.421872 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:DELETE=2,keystone:SELECT=95,keystone:INSERT=3 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:55:43.468085 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1398/2816] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:55:43 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:55:43.472667 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba110be-1a35-484e-8967-ea47d57bdd6e admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:55:43.543559 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba110be-1a35-484e-8967-ea47d57bdd6e admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:55:43.550144 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b15050-b480-490c-9328-9b82736f455b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:55:43.550874 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b15050-b480-490c-9328-9b82736f455b admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:55:43.551038 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b15050-b480-490c-9328-9b82736f455b admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:55:43.551332 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b15050-b480-490c-9328-9b82736f455b admin admin] PATH_INFO: `/v3/projects` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:55:43.551975 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b15050-b480-490c-9328-9b82736f455b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:55:43.554050 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b15050-b480-490c-9328-9b82736f455b admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:55:43.690656 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1419/2817] 10.222.0.102 () {60 vars in 1158 bytes} [Mon Aug 1 15:55:43 2022] POST /identity/v3/projects => generated 366 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 15:55:43.694540 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9161752e-520f-4266-b742-85e99a46ec41 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:55:43.706320 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9161752e-520f-4266-b742-85e99a46ec41 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:55:43.781900 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8a2a71-26b0-44eb-9a08-0543912e06cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:55:43.785939 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8a2a71-26b0-44eb-9a08-0543912e06cc admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:55:43.785939 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8a2a71-26b0-44eb-9a08-0543912e06cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:55:43.785939 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8a2a71-26b0-44eb-9a08-0543912e06cc admin admin] PATH_INFO: `/v3/users` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:55:43.785939 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8a2a71-26b0-44eb-9a08-0543912e06cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:55:43.788054 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8a2a71-26b0-44eb-9a08-0543912e06cc admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:55:43.902699 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1399/2818] 10.222.0.102 () {60 vars in 1149 bytes} [Mon Aug 1 15:55:43 2022] POST /identity/v3/users => generated 290 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:55:43.907136 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b15050-b480-490c-9328-9b82736f455b admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:55:43.918499 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b15050-b480-490c-9328-9b82736f455b admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:55:43.923572 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd4269d-67cd-4439-b28b-a737d0b365ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:55:43.924143 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd4269d-67cd-4439-b28b-a737d0b365ae admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:55:43.924419 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd4269d-67cd-4439-b28b-a737d0b365ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:55:43.924685 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd4269d-67cd-4439-b28b-a737d0b365ae admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:55:43.925611 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd4269d-67cd-4439-b28b-a737d0b365ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:55:43.927019 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd4269d-67cd-4439-b28b-a737d0b365ae admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:55:43.951406 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1420/2819] 10.222.0.102 () {58 vars in 1127 bytes} [Mon Aug 1 15:55:43 2022] GET /identity/v3/roles => generated 1427 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:55:43.958851 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8a2a71-26b0-44eb-9a08-0543912e06cc admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:55:43.973321 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8a2a71-26b0-44eb-9a08-0543912e06cc admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:55:43.995029 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c38fd7-0630-4184-a8a1-7fcbb644eea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:55:43.995799 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c38fd7-0630-4184-a8a1-7fcbb644eea2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:55:43.996092 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c38fd7-0630-4184-a8a1-7fcbb644eea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:55:43.996372 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c38fd7-0630-4184-a8a1-7fcbb644eea2 admin admin] PATH_INFO: `/v3/projects/6ff6cc4dfb5f46078a1930f2f1c0640a/users/48cfa7b1db4d44e1a4eae3adc18d02fd/roles/de1374f966c04c27b579515b54334fd2` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:55:44.022728 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c38fd7-0630-4184-a8a1-7fcbb644eea2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ff6cc4dfb5f46078a1930f2f1c0640a, user_id=48cfa7b1db4d44e1a4eae3adc18d02fd, role_id=de1374f966c04c27b579515b54334fd2)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:55:44.025669 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c38fd7-0630-4184-a8a1-7fcbb644eea2 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:55:44.065544 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdaedd0-b14d-43d9-91dd-f3cc5c755689 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:55:44.066097 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdaedd0-b14d-43d9-91dd-f3cc5c755689 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:55:44.066184 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdaedd0-b14d-43d9-91dd-f3cc5c755689 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:55:44.091768 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-1cdaedd0-b14d-43d9-91dd-f3cc5c755689 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:55:44.093378 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-1cdaedd0-b14d-43d9-91dd-f3cc5c755689 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:55:44.104108 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1421/2820] 10.222.0.65 () {58 vars in 1020 bytes} [Mon Aug 1 15:55:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 15:55:44.124449 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdaedd0-b14d-43d9-91dd-f3cc5c755689 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:55:44.126494 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-1cdaedd0-b14d-43d9-91dd-f3cc5c755689 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:55:44.129594 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1400/2821] 10.222.0.102 () {60 vars in 1488 bytes} [Mon Aug 1 15:55:43 2022] PUT /identity/v3/projects/6ff6cc4dfb5f46078a1930f2f1c0640a/users/48cfa7b1db4d44e1a4eae3adc18d02fd/roles/de1374f966c04c27b579515b54334fd2 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:55:44.134232 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c38fd7-0630-4184-a8a1-7fcbb644eea2 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:55:44.251359 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c38fd7-0630-4184-a8a1-7fcbb644eea2 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:55:44.262192 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdaedd0-b14d-43d9-91dd-f3cc5c755689 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:55:44.263554 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca64c7ae-2cad-4a95-ba37-9610875cb0a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:55:44.266627 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca64c7ae-2cad-4a95-ba37-9610875cb0a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:55:44.266880 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca64c7ae-2cad-4a95-ba37-9610875cb0a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:55:44.267158 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca64c7ae-2cad-4a95-ba37-9610875cb0a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:55:44.267870 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca64c7ae-2cad-4a95-ba37-9610875cb0a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:55:44.269567 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca64c7ae-2cad-4a95-ba37-9610875cb0a9 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:55:44.336622 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1401/2822] 10.222.0.102 () {58 vars in 1127 bytes} [Mon Aug 1 15:55:44 2022] GET /identity/v3/roles => generated 1427 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:55:44.342034 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca64c7ae-2cad-4a95-ba37-9610875cb0a9 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:55:44.358699 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca64c7ae-2cad-4a95-ba37-9610875cb0a9 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:55:44.365511 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6051c199-2689-4f39-82dc-76e1d1f848d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:55:44.366305 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6051c199-2689-4f39-82dc-76e1d1f848d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:55:44.366655 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6051c199-2689-4f39-82dc-76e1d1f848d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:55:44.367008 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6051c199-2689-4f39-82dc-76e1d1f848d0 admin admin] PATH_INFO: `/v3/projects/6ff6cc4dfb5f46078a1930f2f1c0640a/users/48cfa7b1db4d44e1a4eae3adc18d02fd/roles/de1374f966c04c27b579515b54334fd2` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:55:44.381879 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6051c199-2689-4f39-82dc-76e1d1f848d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ff6cc4dfb5f46078a1930f2f1c0640a, user_id=48cfa7b1db4d44e1a4eae3adc18d02fd, role_id=de1374f966c04c27b579515b54334fd2)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:55:44.386607 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6051c199-2689-4f39-82dc-76e1d1f848d0 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:55:44.414648 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1402/2823] 10.222.0.102 () {60 vars in 1488 bytes} [Mon Aug 1 15:55:44 2022] PUT /identity/v3/projects/6ff6cc4dfb5f46078a1930f2f1c0640a/users/48cfa7b1db4d44e1a4eae3adc18d02fd/roles/de1374f966c04c27b579515b54334fd2 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:55:44.425447 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66a9d8b-6cc6-4da3-a496-dcb0e4b544cb None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:55:44.425840 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66a9d8b-6cc6-4da3-a496-dcb0e4b544cb None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:55:44.426094 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66a9d8b-6cc6-4da3-a496-dcb0e4b544cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:55:44.433651 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8a577e-6134-499d-bdc6-995b59f8395f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77b43f1ee8cc4be3907a494abe90c1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:55:44.435865 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8a577e-6134-499d-bdc6-995b59f8395f service nova] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:55:44.437789 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8a577e-6134-499d-bdc6-995b59f8395f service nova] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:55:44.438083 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8a577e-6134-499d-bdc6-995b59f8395f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:55:44.458385 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8a577e-6134-499d-bdc6-995b59f8395f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:55:44.460022 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8a577e-6134-499d-bdc6-995b59f8395f service nova] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:55:44.461518 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-b66a9d8b-6cc6-4da3-a496-dcb0e4b544cb None None] MFA Rules not processed for user `48cfa7b1db4d44e1a4eae3adc18d02fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:55:44.462787 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-b66a9d8b-6cc6-4da3-a496-dcb0e4b544cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:55:44.477019 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1422/2824] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:55:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:55:44.545466 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:55:44.573052 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1403/2825] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:55:44 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:55:44.582439 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8a577e-6134-499d-bdc6-995b59f8395f service nova] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:55:44.583962 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-db8a577e-6134-499d-bdc6-995b59f8395f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:55:44.668404 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8a577e-6134-499d-bdc6-995b59f8395f service nova] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:55:44.756572 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaa4ed9-fc77-48a0-b76a-b438297d07a5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff810b37183c4729859c1b05edff1703', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:55:44.757314 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaa4ed9-fc77-48a0-b76a-b438297d07a5 service cinder] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:55:44.757909 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaa4ed9-fc77-48a0-b76a-b438297d07a5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:55:44.758171 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaa4ed9-fc77-48a0-b76a-b438297d07a5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:55:44.771962 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aaa4ed9-fc77-48a0-b76a-b438297d07a5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:55:44.773550 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aaa4ed9-fc77-48a0-b76a-b438297d07a5 service cinder] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:55:44.797117 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1423/2826] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:55:44 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:55:45.065107 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66a9d8b-6cc6-4da3-a496-dcb0e4b544cb None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:55:45.077623 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66a9d8b-6cc6-4da3-a496-dcb0e4b544cb None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:55:45.083273 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7369f17-ac15-4e84-b38b-916475af1545 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff810b37183c4729859c1b05edff1703', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:55:45.083918 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7369f17-ac15-4e84-b38b-916475af1545 service cinder] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:55:45.084201 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7369f17-ac15-4e84-b38b-916475af1545 service cinder] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:55:45.084476 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7369f17-ac15-4e84-b38b-916475af1545 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:55:45.166603 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7369f17-ac15-4e84-b38b-916475af1545 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:55:45.168202 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7369f17-ac15-4e84-b38b-916475af1545 service cinder] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:55:45.176265 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d1ce6f-fa9b-4820-8c8c-69f64f55638f None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:55:45.177430 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d1ce6f-fa9b-4820-8c8c-69f64f55638f None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:55:45.177929 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d1ce6f-fa9b-4820-8c8c-69f64f55638f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:55:45.182304 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:55:45.183582 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1404/2827] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:55:45 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:55:45.218166 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-c5d1ce6f-fa9b-4820-8c8c-69f64f55638f None None] MFA Rules not processed for user `356251660a26431e95b2e9fd450ad5e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:55:45.218166 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-c5d1ce6f-fa9b-4820-8c8c-69f64f55638f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:55:45.259347 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:55:45.287856 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1424/2828] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:55:45 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 15:55:45.302678 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7369f17-ac15-4e84-b38b-916475af1545 service cinder] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:55:45.374747 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7369f17-ac15-4e84-b38b-916475af1545 service cinder] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:55:45.388280 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a7d4b8-cab4-4045-a62c-1d4eca2b234f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77b43f1ee8cc4be3907a494abe90c1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:55:45.388970 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a7d4b8-cab4-4045-a62c-1d4eca2b234f service nova] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:55:45.389256 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a7d4b8-cab4-4045-a62c-1d4eca2b234f service nova] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:55:45.389530 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a7d4b8-cab4-4045-a62c-1d4eca2b234f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:55:45.393283 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-a0a7d4b8-cab4-4045-a62c-1d4eca2b234f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:55:45.451701 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a7d4b8-cab4-4045-a62c-1d4eca2b234f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:55:45.453252 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a7d4b8-cab4-4045-a62c-1d4eca2b234f service nova] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:55:45.462162 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1405/2829] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:55:45 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:55:45.655916 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:55:48.220744 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d4ba57-ef00-4a48-be7a-f8b205421804 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:55:48.244174 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d4ba57-ef00-4a48-be7a-f8b205421804 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:55:48.244174 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d4ba57-ef00-4a48-be7a-f8b205421804 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:55:48.246772 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-72d4ba57-ef00-4a48-be7a-f8b205421804 None None] MFA Rules not processed for user `e12cb37988234aecb973ba456dc1044d`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:55:48.249133 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-72d4ba57-ef00-4a48-be7a-f8b205421804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:55:48.263731 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1425/2830] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:55:48 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:55:50.357070 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf24893-1eea-4fea-a7e1-3c8ca66d2f49 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:55:50.358978 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf24893-1eea-4fea-a7e1-3c8ca66d2f49 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:55:50.358978 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf24893-1eea-4fea-a7e1-3c8ca66d2f49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:55:50.383917 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-bbf24893-1eea-4fea-a7e1-3c8ca66d2f49 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:55:50.385313 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-bbf24893-1eea-4fea-a7e1-3c8ca66d2f49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:55:50.469606 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1406/2831] 10.222.0.65 () {58 vars in 1020 bytes} [Mon Aug 1 15:55:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:55:50.491934 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d4ba57-ef00-4a48-be7a-f8b205421804 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:55:50.521933 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d4ba57-ef00-4a48-be7a-f8b205421804 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:55:50.531140 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faff5e70-42cc-4e5f-8c76-e9a8a374d609 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77b43f1ee8cc4be3907a494abe90c1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:55:50.531140 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faff5e70-42cc-4e5f-8c76-e9a8a374d609 service nova] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:55:50.531358 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faff5e70-42cc-4e5f-8c76-e9a8a374d609 service nova] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:55:50.531578 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faff5e70-42cc-4e5f-8c76-e9a8a374d609 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:55:50.550732 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faff5e70-42cc-4e5f-8c76-e9a8a374d609 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:55:50.552775 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faff5e70-42cc-4e5f-8c76-e9a8a374d609 service nova] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:55:50.564306 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1426/2832] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:55:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:55:52.711752 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf24893-1eea-4fea-a7e1-3c8ca66d2f49 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:55:52.724865 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf24893-1eea-4fea-a7e1-3c8ca66d2f49 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:55:52.730716 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055fa8d3-20ab-45cf-a595-59215f97eabc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:55:52.731679 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055fa8d3-20ab-45cf-a595-59215f97eabc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:55:52.731964 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055fa8d3-20ab-45cf-a595-59215f97eabc admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:55:52.732233 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055fa8d3-20ab-45cf-a595-59215f97eabc admin admin] PATH_INFO: `/v3/users/77e340ac59194ebab0e3fac08c6d71e3` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:55:52.733454 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055fa8d3-20ab-45cf-a595-59215f97eabc admin admin] RBAC: Authorizing `identity:delete_user(user_id=77e340ac59194ebab0e3fac08c6d71e3)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:55:52.736319 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055fa8d3-20ab-45cf-a595-59215f97eabc admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:55:52.933438 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-055fa8d3-20ab-45cf-a595-59215f97eabc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77e340ac59194ebab0e3fac08c6d71e3'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:55:53.019424 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-055fa8d3-20ab-45cf-a595-59215f97eabc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77e340ac59194ebab0e3fac08c6d71e3'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:55:53.033440 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-055fa8d3-20ab-45cf-a595-59215f97eabc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77e340ac59194ebab0e3fac08c6d71e3'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:55:53.034117 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-055fa8d3-20ab-45cf-a595-59215f97eabc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77e340ac59194ebab0e3fac08c6d71e3'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:55:53.034717 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-055fa8d3-20ab-45cf-a595-59215f97eabc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77e340ac59194ebab0e3fac08c6d71e3'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:55:53.050338 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1407/2833] 10.222.0.102 () {58 vars in 1229 bytes} [Mon Aug 1 15:55:52 2022] DELETE /identity/v3/users/77e340ac59194ebab0e3fac08c6d71e3 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:55:53.056136 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038e7f6a-0e92-456b-bb4b-a05d1d04b368 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:55:53.056677 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038e7f6a-0e92-456b-bb4b-a05d1d04b368 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:55:53.057157 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038e7f6a-0e92-456b-bb4b-a05d1d04b368 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:55:53.092589 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-038e7f6a-0e92-456b-bb4b-a05d1d04b368 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:55:53.095215 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-038e7f6a-0e92-456b-bb4b-a05d1d04b368 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:55:53.159298 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1427/2834] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:55:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:55:53.169008 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055fa8d3-20ab-45cf-a595-59215f97eabc admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:55:53.170467 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-055fa8d3-20ab-45cf-a595-59215f97eabc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:55:53.229382 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055fa8d3-20ab-45cf-a595-59215f97eabc admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:55:53.233058 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda3282b-50b3-4115-9adc-c9c6d279c345 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a856a413100443939fe9b10daa868518', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:55:53.233674 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda3282b-50b3-4115-9adc-c9c6d279c345 service neutron] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:55:53.233955 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda3282b-50b3-4115-9adc-c9c6d279c345 service neutron] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:55:53.234227 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda3282b-50b3-4115-9adc-c9c6d279c345 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:55:53.243287 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:55:53.246182 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda3282b-50b3-4115-9adc-c9c6d279c345 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:55:53.248562 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda3282b-50b3-4115-9adc-c9c6d279c345 service neutron] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:55:53.260304 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1408/2835] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:55:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:55:53.725826 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038e7f6a-0e92-456b-bb4b-a05d1d04b368 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:55:53.727531 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-038e7f6a-0e92-456b-bb4b-a05d1d04b368 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:55:53.743076 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038e7f6a-0e92-456b-bb4b-a05d1d04b368 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:55:53.751257 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882567a4-7e78-49b7-92d5-da04a2b4eba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:55:53.752431 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882567a4-7e78-49b7-92d5-da04a2b4eba4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:55:53.752431 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882567a4-7e78-49b7-92d5-da04a2b4eba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:55:53.752646 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882567a4-7e78-49b7-92d5-da04a2b4eba4 admin admin] PATH_INFO: `/v3/projects/24060d06276d4e299ddb7712f3a3a72a` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:55:53.754117 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882567a4-7e78-49b7-92d5-da04a2b4eba4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=24060d06276d4e299ddb7712f3a3a72a)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:55:53.756197 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882567a4-7e78-49b7-92d5-da04a2b4eba4 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:55:53.984769 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-882567a4-7e78-49b7-92d5-da04a2b4eba4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24060d06276d4e299ddb7712f3a3a72a', 'request_id': 'req-882567a4-7e78-49b7-92d5-da04a2b4eba4'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:55:53.991756 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-882567a4-7e78-49b7-92d5-da04a2b4eba4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24060d06276d4e299ddb7712f3a3a72a', 'request_id': 'req-882567a4-7e78-49b7-92d5-da04a2b4eba4'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:55:54.061262 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-882567a4-7e78-49b7-92d5-da04a2b4eba4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24060d06276d4e299ddb7712f3a3a72a', 'request_id': 'req-882567a4-7e78-49b7-92d5-da04a2b4eba4'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:55:54.073213 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-882567a4-7e78-49b7-92d5-da04a2b4eba4 admin admin] The token cache is being invalidate because project 24060d06276d4e299ddb7712f3a3a72a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80352) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 15:55:54.073506 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-882567a4-7e78-49b7-92d5-da04a2b4eba4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:55:54.074349 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-882567a4-7e78-49b7-92d5-da04a2b4eba4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:55:54.076016 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1428/2836] 10.222.0.102 () {58 vars in 1238 bytes} [Mon Aug 1 15:55:53 2022] DELETE /identity/v3/projects/24060d06276d4e299ddb7712f3a3a72a => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:55:54.080917 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda3282b-50b3-4115-9adc-c9c6d279c345 service neutron] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:55:54.095609 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda3282b-50b3-4115-9adc-c9c6d279c345 service neutron] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:55:54.157648 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d486547-fa3d-473c-849d-53abf06a85c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:55:54.158289 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d486547-fa3d-473c-849d-53abf06a85c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:55:54.158572 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d486547-fa3d-473c-849d-53abf06a85c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:55:54.158847 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d486547-fa3d-473c-849d-53abf06a85c4 admin admin] PATH_INFO: `/v3/users/48cfa7b1db4d44e1a4eae3adc18d02fd` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:55:54.160043 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d486547-fa3d-473c-849d-53abf06a85c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=48cfa7b1db4d44e1a4eae3adc18d02fd)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:55:54.162037 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d486547-fa3d-473c-849d-53abf06a85c4 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:55:54.356559 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-3d486547-fa3d-473c-849d-53abf06a85c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48cfa7b1db4d44e1a4eae3adc18d02fd'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:55:54.421061 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-3d486547-fa3d-473c-849d-53abf06a85c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48cfa7b1db4d44e1a4eae3adc18d02fd'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:55:54.434520 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-3d486547-fa3d-473c-849d-53abf06a85c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48cfa7b1db4d44e1a4eae3adc18d02fd'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:55:54.435259 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-3d486547-fa3d-473c-849d-53abf06a85c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48cfa7b1db4d44e1a4eae3adc18d02fd'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:55:54.435874 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-3d486547-fa3d-473c-849d-53abf06a85c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48cfa7b1db4d44e1a4eae3adc18d02fd'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:55:54.448772 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1409/2837] 10.222.0.102 () {58 vars in 1229 bytes} [Mon Aug 1 15:55:54 2022] DELETE /identity/v3/users/48cfa7b1db4d44e1a4eae3adc18d02fd => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:55:54.919923 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882567a4-7e78-49b7-92d5-da04a2b4eba4 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:55:54.921384 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-882567a4-7e78-49b7-92d5-da04a2b4eba4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:55:54.936045 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882567a4-7e78-49b7-92d5-da04a2b4eba4 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:55:54.988563 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:55:55.007459 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2a5e2b-1c2f-4d50-a3f1-e17adda2d4ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:55:55.008229 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2a5e2b-1c2f-4d50-a3f1-e17adda2d4ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:55:55.008576 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2a5e2b-1c2f-4d50-a3f1-e17adda2d4ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:55:55.008948 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2a5e2b-1c2f-4d50-a3f1-e17adda2d4ac admin admin] PATH_INFO: `/v3/projects/6ff6cc4dfb5f46078a1930f2f1c0640a` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:55:55.010192 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2a5e2b-1c2f-4d50-a3f1-e17adda2d4ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ff6cc4dfb5f46078a1930f2f1c0640a)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:55:55.012173 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2a5e2b-1c2f-4d50-a3f1-e17adda2d4ac admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:55:55.134020 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-5e2a5e2b-1c2f-4d50-a3f1-e17adda2d4ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ff6cc4dfb5f46078a1930f2f1c0640a', 'request_id': 'req-5e2a5e2b-1c2f-4d50-a3f1-e17adda2d4ac'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:55:55.138970 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-5e2a5e2b-1c2f-4d50-a3f1-e17adda2d4ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ff6cc4dfb5f46078a1930f2f1c0640a', 'request_id': 'req-5e2a5e2b-1c2f-4d50-a3f1-e17adda2d4ac'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:55:55.201435 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-5e2a5e2b-1c2f-4d50-a3f1-e17adda2d4ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ff6cc4dfb5f46078a1930f2f1c0640a', 'request_id': 'req-5e2a5e2b-1c2f-4d50-a3f1-e17adda2d4ac'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:55:55.212467 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-5e2a5e2b-1c2f-4d50-a3f1-e17adda2d4ac admin admin] The token cache is being invalidate because project 6ff6cc4dfb5f46078a1930f2f1c0640a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80352) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 15:55:55.212745 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-5e2a5e2b-1c2f-4d50-a3f1-e17adda2d4ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:55:55.213459 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-5e2a5e2b-1c2f-4d50-a3f1-e17adda2d4ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:55:55.214955 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1429/2838] 10.222.0.102 () {58 vars in 1238 bytes} [Mon Aug 1 15:55:54 2022] DELETE /identity/v3/projects/6ff6cc4dfb5f46078a1930f2f1c0640a => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 15:55:55.221179 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc7d262-b269-4fcd-ad61-d900f251a0dd None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:55:55.221651 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc7d262-b269-4fcd-ad61-d900f251a0dd None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:55:55.221768 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc7d262-b269-4fcd-ad61-d900f251a0dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:55:55.242575 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-ddc7d262-b269-4fcd-ad61-d900f251a0dd None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:55:55.243800 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-ddc7d262-b269-4fcd-ad61-d900f251a0dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:55:55.308282 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1410/2839] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:55:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:55:55.316950 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d293f82a-2352-4ad3-9d00-aa5e44f26401 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:55:55.317238 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d293f82a-2352-4ad3-9d00-aa5e44f26401 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:55:55.317514 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d293f82a-2352-4ad3-9d00-aa5e44f26401 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:55:55.337895 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-d293f82a-2352-4ad3-9d00-aa5e44f26401 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:55:55.339106 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-d293f82a-2352-4ad3-9d00-aa5e44f26401 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:55:55.347714 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1430/2840] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:55:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:55:55.351811 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc7d262-b269-4fcd-ad61-d900f251a0dd None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:55:55.362437 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc7d262-b269-4fcd-ad61-d900f251a0dd None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:55:55.367367 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8608db94-2ba2-48d6-9c0e-8a576322188d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:55:55.368010 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8608db94-2ba2-48d6-9c0e-8a576322188d admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:55:55.368291 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8608db94-2ba2-48d6-9c0e-8a576322188d admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:55:55.368599 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8608db94-2ba2-48d6-9c0e-8a576322188d admin admin] PATH_INFO: `/v3/domains` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:55:55.369401 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8608db94-2ba2-48d6-9c0e-8a576322188d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:55:55.369731 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8608db94-2ba2-48d6-9c0e-8a576322188d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:55:55.371301 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8608db94-2ba2-48d6-9c0e-8a576322188d admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:55:55.383837 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1411/2841] 10.222.0.102 () {58 vars in 1158 bytes} [Mon Aug 1 15:55:55 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:55:55.391438 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d293f82a-2352-4ad3-9d00-aa5e44f26401 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:55:55.403065 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d293f82a-2352-4ad3-9d00-aa5e44f26401 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:55:55.408380 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f2151e-783b-45db-8709-da8a8a1e60a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:55:55.409039 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f2151e-783b-45db-8709-da8a8a1e60a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:55:55.409320 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f2151e-783b-45db-8709-da8a8a1e60a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:55:55.409593 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f2151e-783b-45db-8709-da8a8a1e60a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:55:55.410270 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f2151e-783b-45db-8709-da8a8a1e60a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:55:55.412195 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f2151e-783b-45db-8709-da8a8a1e60a8 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:55:55.508513 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1431/2842] 10.222.0.102 () {60 vars in 1158 bytes} [Mon Aug 1 15:55:55 2022] POST /identity/v3/projects => generated 378 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:55:55.512711 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8608db94-2ba2-48d6-9c0e-8a576322188d admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:55:55.517972 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:55:55.523309 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8608db94-2ba2-48d6-9c0e-8a576322188d admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:55:55.579273 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd4e6e3-757c-4d5f-b543-e6eafab60b75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:55:55.579891 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd4e6e3-757c-4d5f-b543-e6eafab60b75 admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:55:55.580234 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd4e6e3-757c-4d5f-b543-e6eafab60b75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:55:55.580508 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd4e6e3-757c-4d5f-b543-e6eafab60b75 admin admin] PATH_INFO: `/v3/users` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:55:55.581212 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd4e6e3-757c-4d5f-b543-e6eafab60b75 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:55:55.583128 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd4e6e3-757c-4d5f-b543-e6eafab60b75 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:55:55.684866 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1412/2843] 10.222.0.102 () {60 vars in 1149 bytes} [Mon Aug 1 15:55:55 2022] POST /identity/v3/users => generated 290 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:55:55.689043 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f2151e-783b-45db-8709-da8a8a1e60a8 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:55:55.699713 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f2151e-783b-45db-8709-da8a8a1e60a8 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:55:55.704882 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad95a92-2f60-415d-b669-64f27408fac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:55:55.705495 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad95a92-2f60-415d-b669-64f27408fac4 admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:55:55.711078 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad95a92-2f60-415d-b669-64f27408fac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:55:55.711078 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad95a92-2f60-415d-b669-64f27408fac4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:55:55.711078 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad95a92-2f60-415d-b669-64f27408fac4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:55:55.711078 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad95a92-2f60-415d-b669-64f27408fac4 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:55:55.718836 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1432/2844] 10.222.0.102 () {58 vars in 1127 bytes} [Mon Aug 1 15:55:55 2022] GET /identity/v3/roles => generated 1427 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:55:55.722716 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd4e6e3-757c-4d5f-b543-e6eafab60b75 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:55:55.732647 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd4e6e3-757c-4d5f-b543-e6eafab60b75 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:55:55.737226 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60456b90-e2c7-46d6-8731-a47b86069817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:55:55.737824 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60456b90-e2c7-46d6-8731-a47b86069817 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:55:55.738104 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60456b90-e2c7-46d6-8731-a47b86069817 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:55:55.738377 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60456b90-e2c7-46d6-8731-a47b86069817 admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:55:55.739065 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60456b90-e2c7-46d6-8731-a47b86069817 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:55:55.740651 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60456b90-e2c7-46d6-8731-a47b86069817 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:55:55.751176 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1413/2845] 10.222.0.102 () {58 vars in 1127 bytes} [Mon Aug 1 15:55:55 2022] GET /identity/v3/roles => generated 1427 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:55:55.755217 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad95a92-2f60-415d-b669-64f27408fac4 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:55:55.765710 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad95a92-2f60-415d-b669-64f27408fac4 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:55:55.770259 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00bdec6-e477-48e9-836a-fdd3bea3dd1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:55:55.770916 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00bdec6-e477-48e9-836a-fdd3bea3dd1e admin admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:55:55.771179 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00bdec6-e477-48e9-836a-fdd3bea3dd1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:55:55.771457 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00bdec6-e477-48e9-836a-fdd3bea3dd1e admin admin] PATH_INFO: `/v3/projects/214b46800fd24cd99743af3cb7804ded/users/d6abe7b0d6e148ddbe3c4e725c2c1613/roles/27f5093ac0674d799cdbd17c68482e32` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:55:55.786916 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00bdec6-e477-48e9-836a-fdd3bea3dd1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=214b46800fd24cd99743af3cb7804ded, user_id=d6abe7b0d6e148ddbe3c4e725c2c1613, role_id=27f5093ac0674d799cdbd17c68482e32)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:55:55.789626 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00bdec6-e477-48e9-836a-fdd3bea3dd1e admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:55:55.855800 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1433/2846] 10.222.0.102 () {60 vars in 1488 bytes} [Mon Aug 1 15:55:55 2022] PUT /identity/v3/projects/214b46800fd24cd99743af3cb7804ded/users/d6abe7b0d6e148ddbe3c4e725c2c1613/roles/27f5093ac0674d799cdbd17c68482e32 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:55:55.866139 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87842784-2acb-40e2-b9b6-a367d9ae8e78 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:55:55.866426 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87842784-2acb-40e2-b9b6-a367d9ae8e78 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:55:55.866701 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87842784-2acb-40e2-b9b6-a367d9ae8e78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:55:55.895338 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-87842784-2acb-40e2-b9b6-a367d9ae8e78 None None] MFA Rules not processed for user `d6abe7b0d6e148ddbe3c4e725c2c1613`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:55:55.896480 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-87842784-2acb-40e2-b9b6-a367d9ae8e78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:55:55.972737 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1414/2847] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:55:55 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:55:55.984911 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00bdec6-e477-48e9-836a-fdd3bea3dd1e admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:55:55.986611 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-f00bdec6-e477-48e9-836a-fdd3bea3dd1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:55:56.045022 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00bdec6-e477-48e9-836a-fdd3bea3dd1e admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:55:56.048741 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ffceb2-7da2-4e64-a3bd-1a4047f42af1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '613da2657ae34558b355cac53c8bf29a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:55:56.049391 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ffceb2-7da2-4e64-a3bd-1a4047f42af1 service glance] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:55:56.049671 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ffceb2-7da2-4e64-a3bd-1a4047f42af1 service glance] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:55:56.049942 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ffceb2-7da2-4e64-a3bd-1a4047f42af1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:55:56.058591 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ffceb2-7da2-4e64-a3bd-1a4047f42af1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:55:56.060021 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ffceb2-7da2-4e64-a3bd-1a4047f42af1 service glance] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:55:56.071197 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1434/2848] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:55:55 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:55:56.124794 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ea01e1-a93f-4f6e-b541-90bd0e08ab56 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:55:56.125201 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ea01e1-a93f-4f6e-b541-90bd0e08ab56 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:55:56.125583 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ea01e1-a93f-4f6e-b541-90bd0e08ab56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:55:56.149000 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-92ea01e1-a93f-4f6e-b541-90bd0e08ab56 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:55:56.150692 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-92ea01e1-a93f-4f6e-b541-90bd0e08ab56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:55:56.227066 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1415/2849] 10.222.0.65 () {58 vars in 1020 bytes} [Mon Aug 1 15:55:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 15:55:56.249109 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ffceb2-7da2-4e64-a3bd-1a4047f42af1 service glance] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:55:56.250638 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-83ffceb2-7da2-4e64-a3bd-1a4047f42af1 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:55:56.263262 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:55:56.335715 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ffceb2-7da2-4e64-a3bd-1a4047f42af1 service glance] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:55:56.342382 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5609cda-3f4f-4198-bae8-780b7751945b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77b43f1ee8cc4be3907a494abe90c1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:55:56.343560 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5609cda-3f4f-4198-bae8-780b7751945b service nova] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:55:56.343841 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5609cda-3f4f-4198-bae8-780b7751945b service nova] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:55:56.344114 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5609cda-3f4f-4198-bae8-780b7751945b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:55:56.353457 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5609cda-3f4f-4198-bae8-780b7751945b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:55:56.355799 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5609cda-3f4f-4198-bae8-780b7751945b service nova] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:55:56.369397 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1435/2850] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:55:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:56:00.367242 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61b9b73-3e23-47a4-88c1-f6a504f52ead None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:56:00.367728 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61b9b73-3e23-47a4-88c1-f6a504f52ead None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:56:00.367866 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61b9b73-3e23-47a4-88c1-f6a504f52ead None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:56:00.387002 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-a61b9b73-3e23-47a4-88c1-f6a504f52ead None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:56:00.388147 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-a61b9b73-3e23-47a4-88c1-f6a504f52ead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:56:00.395984 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1416/2851] 10.222.0.65 () {58 vars in 1020 bytes} [Mon Aug 1 15:56:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:56:00.420583 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5609cda-3f4f-4198-bae8-780b7751945b service nova] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:56:00.422094 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-c5609cda-3f4f-4198-bae8-780b7751945b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:56:00.438545 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5609cda-3f4f-4198-bae8-780b7751945b service nova] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:56:00.444351 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13187cee-810c-4935-9bbd-69b94953559c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77b43f1ee8cc4be3907a494abe90c1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:56:00.445019 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13187cee-810c-4935-9bbd-69b94953559c service nova] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:56:00.445302 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13187cee-810c-4935-9bbd-69b94953559c service nova] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:56:00.445578 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13187cee-810c-4935-9bbd-69b94953559c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:56:00.455356 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13187cee-810c-4935-9bbd-69b94953559c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:56:00.457024 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13187cee-810c-4935-9bbd-69b94953559c service nova] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:56:00.466659 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1436/2852] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:56:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:56:03.215652 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99591736-42d1-4584-ad62-d0591fb4872f None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:56:03.216122 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99591736-42d1-4584-ad62-d0591fb4872f None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:56:03.216219 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99591736-42d1-4584-ad62-d0591fb4872f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:56:03.226091 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:56:03.265393 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-99591736-42d1-4584-ad62-d0591fb4872f None None] MFA Rules not processed for user `ae8514df55144c9086ed98ba44efbbd4`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:56:03.267162 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-99591736-42d1-4584-ad62-d0591fb4872f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:56:03.340543 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1417/2853] 10.222.0.102 () {58 vars in 1014 bytes} [Mon Aug 1 15:56:03 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:56:03.496768 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13187cee-810c-4935-9bbd-69b94953559c service nova] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:56:03.498342 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-13187cee-810c-4935-9bbd-69b94953559c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:56:03.595226 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13187cee-810c-4935-9bbd-69b94953559c service nova] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:56:03.600311 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad7fc6e-fa38-40ec-b0f0-b4fa5c46ab79 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90673f47354f4403aa0e12e3658441c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:56:03.600937 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad7fc6e-fa38-40ec-b0f0-b4fa5c46ab79 service swift] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:56:03.601221 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad7fc6e-fa38-40ec-b0f0-b4fa5c46ab79 service swift] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:56:03.601495 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad7fc6e-fa38-40ec-b0f0-b4fa5c46ab79 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:56:03.610203 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad7fc6e-fa38-40ec-b0f0-b4fa5c46ab79 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:56:03.611795 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad7fc6e-fa38-40ec-b0f0-b4fa5c46ab79 service swift] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:56:03.619947 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1437/2854] 10.222.0.102 () {60 vars in 1389 bytes} [Mon Aug 1 15:56:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 01 15:56:04.648453 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bbb57d-3e44-4343-a7f7-8cd19ba88d03 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:56:04.648990 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bbb57d-3e44-4343-a7f7-8cd19ba88d03 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:56:04.649124 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bbb57d-3e44-4343-a7f7-8cd19ba88d03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:56:04.671373 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-49bbb57d-3e44-4343-a7f7-8cd19ba88d03 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:56:04.672736 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-49bbb57d-3e44-4343-a7f7-8cd19ba88d03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:56:04.682317 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1418/2855] 10.222.0.65 () {58 vars in 1020 bytes} [Mon Aug 1 15:56:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:56:04.706412 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad7fc6e-fa38-40ec-b0f0-b4fa5c46ab79 service swift] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:56:04.720742 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad7fc6e-fa38-40ec-b0f0-b4fa5c46ab79 service swift] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:56:04.726928 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9995ef20-c053-42a3-9007-fa4b6e66508a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77b43f1ee8cc4be3907a494abe90c1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:56:04.727578 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9995ef20-c053-42a3-9007-fa4b6e66508a service nova] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:56:04.727858 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9995ef20-c053-42a3-9007-fa4b6e66508a service nova] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:56:04.728137 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9995ef20-c053-42a3-9007-fa4b6e66508a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:56:04.737830 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9995ef20-c053-42a3-9007-fa4b6e66508a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:56:04.739588 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9995ef20-c053-42a3-9007-fa4b6e66508a service nova] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:56:04.764705 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1438/2856] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:56:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 15:56:14.665467 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=41 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:56:14.745236 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=83 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:56:17.572894 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bbb57d-3e44-4343-a7f7-8cd19ba88d03 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:56:17.586996 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bbb57d-3e44-4343-a7f7-8cd19ba88d03 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:56:17.593417 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b0a06d-415e-43ee-9824-bf4443e9db62 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77b43f1ee8cc4be3907a494abe90c1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:56:17.594752 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b0a06d-415e-43ee-9824-bf4443e9db62 service nova] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:56:17.595096 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b0a06d-415e-43ee-9824-bf4443e9db62 service nova] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:56:17.595441 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b0a06d-415e-43ee-9824-bf4443e9db62 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:56:17.597519 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-12b0a06d-415e-43ee-9824-bf4443e9db62 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:56:17.612488 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b0a06d-415e-43ee-9824-bf4443e9db62 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:56:17.614396 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b0a06d-415e-43ee-9824-bf4443e9db62 service nova] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:56:17.627052 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1419/2857] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:56:17 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:56:25.761331 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9995ef20-c053-42a3-9007-fa4b6e66508a service nova] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:56:25.762785 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-9995ef20-c053-42a3-9007-fa4b6e66508a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:56:25.826744 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9995ef20-c053-42a3-9007-fa4b6e66508a service nova] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:56:25.831635 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19843dad-9030-4aa1-9be7-1e63b03b1429 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a856a413100443939fe9b10daa868518', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:56:25.832355 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19843dad-9030-4aa1-9be7-1e63b03b1429 service neutron] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:56:25.832694 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19843dad-9030-4aa1-9be7-1e63b03b1429 service neutron] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:56:25.833063 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19843dad-9030-4aa1-9be7-1e63b03b1429 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:56:25.834988 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-19843dad-9030-4aa1-9be7-1e63b03b1429 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:56:25.846725 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19843dad-9030-4aa1-9be7-1e63b03b1429 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:56:25.848226 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19843dad-9030-4aa1-9be7-1e63b03b1429 service neutron] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:56:25.856923 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1439/2858] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:56:25 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:56:26.629111 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b0a06d-415e-43ee-9824-bf4443e9db62 service nova] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:56:26.630901 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-12b0a06d-415e-43ee-9824-bf4443e9db62 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:56:26.707478 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b0a06d-415e-43ee-9824-bf4443e9db62 service nova] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:56:26.712594 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50943de-d4b7-4b54-8379-4cf42c0eb1b7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b78f5749fe9c46a389c88bb9c222cc73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:56:26.713255 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50943de-d4b7-4b54-8379-4cf42c0eb1b7 service placement] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:56:26.713540 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50943de-d4b7-4b54-8379-4cf42c0eb1b7 service placement] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:56:26.713817 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50943de-d4b7-4b54-8379-4cf42c0eb1b7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:56:26.715805 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-a50943de-d4b7-4b54-8379-4cf42c0eb1b7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:56:26.728040 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50943de-d4b7-4b54-8379-4cf42c0eb1b7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:56:26.729727 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50943de-d4b7-4b54-8379-4cf42c0eb1b7 service placement] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:56:26.740948 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1420/2859] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:56:26 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:56:26.925196 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a33d646-2238-40d3-8bab-820c079e6a43 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:56:26.925685 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a33d646-2238-40d3-8bab-820c079e6a43 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:56:26.925823 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a33d646-2238-40d3-8bab-820c079e6a43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:56:26.954114 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-2a33d646-2238-40d3-8bab-820c079e6a43 None None] MFA Rules not processed for user `ae8514df55144c9086ed98ba44efbbd4`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:56:26.955485 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-2a33d646-2238-40d3-8bab-820c079e6a43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:56:26.963765 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1440/2860] 10.222.0.102 () {58 vars in 972 bytes} [Mon Aug 1 15:56:26 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:56:26.981635 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50943de-d4b7-4b54-8379-4cf42c0eb1b7 service placement] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:56:26.994112 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50943de-d4b7-4b54-8379-4cf42c0eb1b7 service placement] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:56:26.999312 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f9de0f-7595-4008-b25b-dd0b1f83a886 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90673f47354f4403aa0e12e3658441c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:56:26.999927 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f9de0f-7595-4008-b25b-dd0b1f83a886 service swift] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:56:27.000868 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f9de0f-7595-4008-b25b-dd0b1f83a886 service swift] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:56:27.001148 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f9de0f-7595-4008-b25b-dd0b1f83a886 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:56:27.009722 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f9de0f-7595-4008-b25b-dd0b1f83a886 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:56:27.011390 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f9de0f-7595-4008-b25b-dd0b1f83a886 service swift] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:56:27.019417 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1421/2861] 10.222.0.102 () {60 vars in 1389 bytes} [Mon Aug 1 15:56:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 01 15:56:28.438711 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a33d646-2238-40d3-8bab-820c079e6a43 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:56:28.450102 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a33d646-2238-40d3-8bab-820c079e6a43 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:56:28.455545 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212ea66f-b5d1-43ac-9649-3b50958c27d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:56:28.456244 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212ea66f-b5d1-43ac-9649-3b50958c27d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:56:28.456544 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212ea66f-b5d1-43ac-9649-3b50958c27d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:56:28.456914 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212ea66f-b5d1-43ac-9649-3b50958c27d8 admin admin] PATH_INFO: `/v3/users/d6abe7b0d6e148ddbe3c4e725c2c1613` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:56:28.458278 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212ea66f-b5d1-43ac-9649-3b50958c27d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d6abe7b0d6e148ddbe3c4e725c2c1613)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:56:28.460563 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212ea66f-b5d1-43ac-9649-3b50958c27d8 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:56:28.639888 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-212ea66f-b5d1-43ac-9649-3b50958c27d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6abe7b0d6e148ddbe3c4e725c2c1613'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:56:28.652228 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-212ea66f-b5d1-43ac-9649-3b50958c27d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6abe7b0d6e148ddbe3c4e725c2c1613'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:56:28.659457 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-212ea66f-b5d1-43ac-9649-3b50958c27d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6abe7b0d6e148ddbe3c4e725c2c1613'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:56:28.660168 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-212ea66f-b5d1-43ac-9649-3b50958c27d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6abe7b0d6e148ddbe3c4e725c2c1613'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:56:28.660778 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-212ea66f-b5d1-43ac-9649-3b50958c27d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6abe7b0d6e148ddbe3c4e725c2c1613'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:56:28.802744 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1441/2862] 10.222.0.102 () {58 vars in 1229 bytes} [Mon Aug 1 15:56:28 2022] DELETE /identity/v3/users/d6abe7b0d6e148ddbe3c4e725c2c1613 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:56:28.807968 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21885255-7774-424b-9414-02db4c3cb5bb None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:56:28.807968 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21885255-7774-424b-9414-02db4c3cb5bb None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:56:28.808495 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21885255-7774-424b-9414-02db4c3cb5bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:56:28.828775 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-21885255-7774-424b-9414-02db4c3cb5bb None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:56:28.830800 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-21885255-7774-424b-9414-02db4c3cb5bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:56:28.902529 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1422/2863] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:56:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:56:28.912651 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212ea66f-b5d1-43ac-9649-3b50958c27d8 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:56:28.914093 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-212ea66f-b5d1-43ac-9649-3b50958c27d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:56:28.974719 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212ea66f-b5d1-43ac-9649-3b50958c27d8 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:56:28.978701 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5477dc5-5af9-401a-b099-ddac365f1323 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a856a413100443939fe9b10daa868518', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:56:28.979312 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5477dc5-5af9-401a-b099-ddac365f1323 service neutron] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:56:28.979586 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5477dc5-5af9-401a-b099-ddac365f1323 service neutron] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:56:28.979898 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5477dc5-5af9-401a-b099-ddac365f1323 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:56:28.989713 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5477dc5-5af9-401a-b099-ddac365f1323 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:56:28.991191 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5477dc5-5af9-401a-b099-ddac365f1323 service neutron] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:56:29.000719 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1442/2864] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:56:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:56:29.480771 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21885255-7774-424b-9414-02db4c3cb5bb None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:56:29.484571 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-21885255-7774-424b-9414-02db4c3cb5bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:56:29.498842 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21885255-7774-424b-9414-02db4c3cb5bb None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:56:29.505447 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8ce8da-dd5f-4355-8167-8985f7da27e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:56:29.506108 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8ce8da-dd5f-4355-8167-8985f7da27e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:56:29.506378 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8ce8da-dd5f-4355-8167-8985f7da27e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:56:29.506839 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8ce8da-dd5f-4355-8167-8985f7da27e2 admin admin] PATH_INFO: `/v3/projects/214b46800fd24cd99743af3cb7804ded` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:56:29.508021 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8ce8da-dd5f-4355-8167-8985f7da27e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=214b46800fd24cd99743af3cb7804ded)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:56:29.510489 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8ce8da-dd5f-4355-8167-8985f7da27e2 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:56:29.656592 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-8b8ce8da-dd5f-4355-8167-8985f7da27e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '214b46800fd24cd99743af3cb7804ded', 'request_id': 'req-8b8ce8da-dd5f-4355-8167-8985f7da27e2'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:56:29.745939 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-8b8ce8da-dd5f-4355-8167-8985f7da27e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '214b46800fd24cd99743af3cb7804ded', 'request_id': 'req-8b8ce8da-dd5f-4355-8167-8985f7da27e2'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:56:29.749390 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:56:29.756276 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-8b8ce8da-dd5f-4355-8167-8985f7da27e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '214b46800fd24cd99743af3cb7804ded', 'request_id': 'req-8b8ce8da-dd5f-4355-8167-8985f7da27e2'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:56:29.773941 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-8b8ce8da-dd5f-4355-8167-8985f7da27e2 admin admin] The token cache is being invalidate because project 214b46800fd24cd99743af3cb7804ded was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80353) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 15:56:29.774648 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-8b8ce8da-dd5f-4355-8167-8985f7da27e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:56:29.774940 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-8b8ce8da-dd5f-4355-8167-8985f7da27e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:56:29.776657 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1423/2865] 10.222.0.102 () {58 vars in 1238 bytes} [Mon Aug 1 15:56:29 2022] DELETE /identity/v3/projects/214b46800fd24cd99743af3cb7804ded => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:56:29.781807 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34202b0d-bb84-4ac6-bd72-0f1ba0f57797 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:56:29.782317 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34202b0d-bb84-4ac6-bd72-0f1ba0f57797 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:56:29.782618 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34202b0d-bb84-4ac6-bd72-0f1ba0f57797 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:56:29.810887 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-34202b0d-bb84-4ac6-bd72-0f1ba0f57797 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:56:29.812248 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-34202b0d-bb84-4ac6-bd72-0f1ba0f57797 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:56:29.818881 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:56:29.902497 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1443/2866] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:56:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 15:56:29.912115 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d752ab4a-8a25-4816-a3c9-c241345d61b5 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:56:29.912636 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d752ab4a-8a25-4816-a3c9-c241345d61b5 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:56:29.912636 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d752ab4a-8a25-4816-a3c9-c241345d61b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:56:29.935216 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-d752ab4a-8a25-4816-a3c9-c241345d61b5 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:56:29.936685 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-d752ab4a-8a25-4816-a3c9-c241345d61b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:56:29.950174 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34202b0d-bb84-4ac6-bd72-0f1ba0f57797 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:56:29.955279 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1424/2867] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:56:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:56:29.962981 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34202b0d-bb84-4ac6-bd72-0f1ba0f57797 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:56:29.968453 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859a1229-e1a4-46e5-b135-85ea99fa6734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:56:29.969506 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859a1229-e1a4-46e5-b135-85ea99fa6734 admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:56:29.970044 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859a1229-e1a4-46e5-b135-85ea99fa6734 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:56:29.970646 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859a1229-e1a4-46e5-b135-85ea99fa6734 admin admin] PATH_INFO: `/v3/domains` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:56:29.971569 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859a1229-e1a4-46e5-b135-85ea99fa6734 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:56:29.972119 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859a1229-e1a4-46e5-b135-85ea99fa6734 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:56:29.974187 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859a1229-e1a4-46e5-b135-85ea99fa6734 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:56:29.992243 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1444/2868] 10.222.0.102 () {58 vars in 1158 bytes} [Mon Aug 1 15:56:29 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:56:30.000395 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d752ab4a-8a25-4816-a3c9-c241345d61b5 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:56:30.016925 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d752ab4a-8a25-4816-a3c9-c241345d61b5 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:56:30.024506 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c5a698-7182-4dae-9842-74720f7bf09a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:56:30.037023 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c5a698-7182-4dae-9842-74720f7bf09a admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:56:30.037023 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c5a698-7182-4dae-9842-74720f7bf09a admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:56:30.037023 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c5a698-7182-4dae-9842-74720f7bf09a admin admin] PATH_INFO: `/v3/projects` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:56:30.037023 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c5a698-7182-4dae-9842-74720f7bf09a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:56:30.037023 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c5a698-7182-4dae-9842-74720f7bf09a admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:56:30.174817 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1425/2869] 10.222.0.102 () {60 vars in 1158 bytes} [Mon Aug 1 15:56:29 2022] POST /identity/v3/projects => generated 386 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:56:30.178998 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859a1229-e1a4-46e5-b135-85ea99fa6734 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:56:30.189616 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859a1229-e1a4-46e5-b135-85ea99fa6734 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:56:30.274447 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d021f1-b994-4330-96b9-024332f32407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:56:30.275081 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d021f1-b994-4330-96b9-024332f32407 admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:56:30.275531 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d021f1-b994-4330-96b9-024332f32407 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:56:30.275817 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d021f1-b994-4330-96b9-024332f32407 admin admin] PATH_INFO: `/v3/users` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:56:30.276582 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d021f1-b994-4330-96b9-024332f32407 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:56:30.278592 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d021f1-b994-4330-96b9-024332f32407 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:56:30.411064 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1445/2870] 10.222.0.102 () {60 vars in 1149 bytes} [Mon Aug 1 15:56:30 2022] POST /identity/v3/users => generated 294 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:56:30.413476 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c5a698-7182-4dae-9842-74720f7bf09a admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:56:30.421843 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d021f1-b994-4330-96b9-024332f32407 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:56:30.425334 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-19d021f1-b994-4330-96b9-024332f32407 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:56:30.426585 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c5a698-7182-4dae-9842-74720f7bf09a admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:56:30.433837 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5771ec07-5d56-4942-95a3-6d958c869c80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:56:30.434480 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5771ec07-5d56-4942-95a3-6d958c869c80 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:56:30.434752 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5771ec07-5d56-4942-95a3-6d958c869c80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:56:30.435023 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5771ec07-5d56-4942-95a3-6d958c869c80 admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:56:30.436038 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5771ec07-5d56-4942-95a3-6d958c869c80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:56:30.438210 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5771ec07-5d56-4942-95a3-6d958c869c80 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:56:30.453961 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d021f1-b994-4330-96b9-024332f32407 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:56:30.465830 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1426/2871] 10.222.0.102 () {58 vars in 1127 bytes} [Mon Aug 1 15:56:30 2022] GET /identity/v3/roles => generated 1427 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:56:30.466765 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5771ec07-5d56-4942-95a3-6d958c869c80 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:56:30.466913 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6444283-a571-494b-b109-9343cfb412ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:56:30.467465 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6444283-a571-494b-b109-9343cfb412ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:56:30.467755 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6444283-a571-494b-b109-9343cfb412ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:56:30.467755 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6444283-a571-494b-b109-9343cfb412ab admin admin] PATH_INFO: `/v3/users/b2f73e2aa3744667bf16d5a303151284` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:56:30.473775 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6444283-a571-494b-b109-9343cfb412ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2f73e2aa3744667bf16d5a303151284)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:56:30.475757 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6444283-a571-494b-b109-9343cfb412ab admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:56:30.482964 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5771ec07-5d56-4942-95a3-6d958c869c80 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:56:30.497612 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78c81c4-f3d7-492e-9907-f80bd9655832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:56:30.498248 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78c81c4-f3d7-492e-9907-f80bd9655832 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:56:30.498528 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78c81c4-f3d7-492e-9907-f80bd9655832 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:56:30.499711 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78c81c4-f3d7-492e-9907-f80bd9655832 admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:56:30.500429 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78c81c4-f3d7-492e-9907-f80bd9655832 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:56:30.503884 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78c81c4-f3d7-492e-9907-f80bd9655832 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:56:30.516303 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1427/2872] 10.222.0.102 () {58 vars in 1127 bytes} [Mon Aug 1 15:56:30 2022] GET /identity/v3/roles => generated 1427 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:56:30.521101 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78c81c4-f3d7-492e-9907-f80bd9655832 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:56:30.533810 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78c81c4-f3d7-492e-9907-f80bd9655832 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:56:30.539167 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0635b3b-1a0b-4400-b0f1-244930994b8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:56:30.540071 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0635b3b-1a0b-4400-b0f1-244930994b8a admin admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:56:30.540449 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0635b3b-1a0b-4400-b0f1-244930994b8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:56:30.540792 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0635b3b-1a0b-4400-b0f1-244930994b8a admin admin] PATH_INFO: `/v3/projects/2f0f03f300d4442987ddeafa78e101bf/users/fbf6c1b387ca4fd6b3874b8d56ee35f8/roles/27f5093ac0674d799cdbd17c68482e32` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:56:30.558787 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0635b3b-1a0b-4400-b0f1-244930994b8a admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f0f03f300d4442987ddeafa78e101bf, user_id=fbf6c1b387ca4fd6b3874b8d56ee35f8, role_id=27f5093ac0674d799cdbd17c68482e32)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:56:30.569969 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0635b3b-1a0b-4400-b0f1-244930994b8a admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:56:30.675929 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1428/2873] 10.222.0.102 () {60 vars in 1488 bytes} [Mon Aug 1 15:56:30 2022] PUT /identity/v3/projects/2f0f03f300d4442987ddeafa78e101bf/users/fbf6c1b387ca4fd6b3874b8d56ee35f8/roles/27f5093ac0674d799cdbd17c68482e32 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 15:56:30.739010 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-c6444283-a571-494b-b109-9343cfb412ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2f73e2aa3744667bf16d5a303151284'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:56:30.756948 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8e321a-6834-4475-8f13-37d49b478543 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:56:30.756948 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8e321a-6834-4475-8f13-37d49b478543 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:56:30.756948 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8e321a-6834-4475-8f13-37d49b478543 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:56:30.757372 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-c6444283-a571-494b-b109-9343cfb412ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2f73e2aa3744667bf16d5a303151284'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:56:30.763653 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-c6444283-a571-494b-b109-9343cfb412ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2f73e2aa3744667bf16d5a303151284'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:56:30.764436 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-c6444283-a571-494b-b109-9343cfb412ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2f73e2aa3744667bf16d5a303151284'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:56:30.765324 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-c6444283-a571-494b-b109-9343cfb412ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2f73e2aa3744667bf16d5a303151284'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:56:30.786635 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-9c8e321a-6834-4475-8f13-37d49b478543 None None] MFA Rules not processed for user `fbf6c1b387ca4fd6b3874b8d56ee35f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:56:30.787893 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-9c8e321a-6834-4475-8f13-37d49b478543 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:56:30.831781 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:56:30.838084 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1446/2874] 10.222.0.102 () {58 vars in 1229 bytes} [Mon Aug 1 15:56:30 2022] DELETE /identity/v3/users/b2f73e2aa3744667bf16d5a303151284 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:56:30.868726 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1429/2875] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:56:30 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 15:56:30.886014 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6444283-a571-494b-b109-9343cfb412ab admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:56:30.889873 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-c6444283-a571-494b-b109-9343cfb412ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:56:30.953444 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6444283-a571-494b-b109-9343cfb412ab admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:56:30.957744 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fb1583-debd-4ad4-9977-82f3eb9885d1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff810b37183c4729859c1b05edff1703', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:56:30.958483 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fb1583-debd-4ad4-9977-82f3eb9885d1 service cinder] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:56:30.958794 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fb1583-debd-4ad4-9977-82f3eb9885d1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:56:30.959072 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fb1583-debd-4ad4-9977-82f3eb9885d1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:56:31.030212 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fb1583-debd-4ad4-9977-82f3eb9885d1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:56:31.031739 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fb1583-debd-4ad4-9977-82f3eb9885d1 service cinder] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:56:31.041285 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1447/2876] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:56:30 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:56:31.106176 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8e321a-6834-4475-8f13-37d49b478543 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:56:31.106176 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-9c8e321a-6834-4475-8f13-37d49b478543 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:56:31.218260 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8e321a-6834-4475-8f13-37d49b478543 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:56:31.224062 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:56:31.305543 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b76240-55a0-4338-8f39-9992e850559a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:56:31.306244 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b76240-55a0-4338-8f39-9992e850559a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:56:31.306522 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b76240-55a0-4338-8f39-9992e850559a admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:56:31.306792 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b76240-55a0-4338-8f39-9992e850559a admin admin] PATH_INFO: `/v3/projects/30486a035e874b26b0ead13de6225e30` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:56:31.308205 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b76240-55a0-4338-8f39-9992e850559a admin admin] RBAC: Authorizing `identity:delete_project(project_id=30486a035e874b26b0ead13de6225e30)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:56:31.310165 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b76240-55a0-4338-8f39-9992e850559a admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:56:31.435193 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-e6b76240-55a0-4338-8f39-9992e850559a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30486a035e874b26b0ead13de6225e30', 'request_id': 'req-e6b76240-55a0-4338-8f39-9992e850559a'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:56:31.517650 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-e6b76240-55a0-4338-8f39-9992e850559a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30486a035e874b26b0ead13de6225e30', 'request_id': 'req-e6b76240-55a0-4338-8f39-9992e850559a'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:56:31.528615 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-e6b76240-55a0-4338-8f39-9992e850559a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30486a035e874b26b0ead13de6225e30', 'request_id': 'req-e6b76240-55a0-4338-8f39-9992e850559a'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:56:31.537021 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-e6b76240-55a0-4338-8f39-9992e850559a admin admin] The token cache is being invalidate because project 30486a035e874b26b0ead13de6225e30 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80353) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 15:56:31.537401 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-e6b76240-55a0-4338-8f39-9992e850559a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:56:31.538140 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-e6b76240-55a0-4338-8f39-9992e850559a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:56:31.540040 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1430/2877] 10.222.0.102 () {58 vars in 1238 bytes} [Mon Aug 1 15:56:31 2022] DELETE /identity/v3/projects/30486a035e874b26b0ead13de6225e30 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:56:34.320555 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fb1583-debd-4ad4-9977-82f3eb9885d1 service cinder] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:56:34.322067 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-c6fb1583-debd-4ad4-9977-82f3eb9885d1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:56:34.335935 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fb1583-debd-4ad4-9977-82f3eb9885d1 service cinder] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:56:34.397366 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26807864-97fd-418f-9b99-99edad04155c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:56:34.397953 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26807864-97fd-418f-9b99-99edad04155c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:56:34.398234 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26807864-97fd-418f-9b99-99edad04155c admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:56:34.398505 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26807864-97fd-418f-9b99-99edad04155c admin admin] PATH_INFO: `/v3/users/fbf6c1b387ca4fd6b3874b8d56ee35f8` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:56:34.400086 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26807864-97fd-418f-9b99-99edad04155c admin admin] RBAC: Authorizing `identity:delete_user(user_id=fbf6c1b387ca4fd6b3874b8d56ee35f8)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:56:34.401646 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26807864-97fd-418f-9b99-99edad04155c admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:56:34.617023 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-26807864-97fd-418f-9b99-99edad04155c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fbf6c1b387ca4fd6b3874b8d56ee35f8'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:56:34.624047 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:56:34.629731 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-26807864-97fd-418f-9b99-99edad04155c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fbf6c1b387ca4fd6b3874b8d56ee35f8'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:56:34.638688 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-26807864-97fd-418f-9b99-99edad04155c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fbf6c1b387ca4fd6b3874b8d56ee35f8'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:56:34.638688 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-26807864-97fd-418f-9b99-99edad04155c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fbf6c1b387ca4fd6b3874b8d56ee35f8'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:56:34.638688 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-26807864-97fd-418f-9b99-99edad04155c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fbf6c1b387ca4fd6b3874b8d56ee35f8'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:56:34.729489 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1448/2878] 10.222.0.102 () {58 vars in 1229 bytes} [Mon Aug 1 15:56:34 2022] DELETE /identity/v3/users/fbf6c1b387ca4fd6b3874b8d56ee35f8 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:56:34.734171 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006bae11-69e9-432d-af79-2af95f2c0889 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:56:34.734653 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006bae11-69e9-432d-af79-2af95f2c0889 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:56:34.734819 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006bae11-69e9-432d-af79-2af95f2c0889 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:56:34.755003 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-006bae11-69e9-432d-af79-2af95f2c0889 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:56:34.756317 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-006bae11-69e9-432d-af79-2af95f2c0889 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:56:34.824230 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1431/2879] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:56:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:56:34.834398 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26807864-97fd-418f-9b99-99edad04155c admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:56:34.835868 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-26807864-97fd-418f-9b99-99edad04155c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:56:34.894923 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26807864-97fd-418f-9b99-99edad04155c admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:56:34.898569 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3261f6-31b0-49dc-ac53-d01b739b462e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a856a413100443939fe9b10daa868518', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:56:34.899180 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3261f6-31b0-49dc-ac53-d01b739b462e service neutron] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:56:34.899457 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3261f6-31b0-49dc-ac53-d01b739b462e service neutron] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:56:34.899726 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3261f6-31b0-49dc-ac53-d01b739b462e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:56:34.909481 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3261f6-31b0-49dc-ac53-d01b739b462e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:56:34.910905 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3261f6-31b0-49dc-ac53-d01b739b462e service neutron] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:56:34.920332 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1449/2880] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:56:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:56:35.327521 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006bae11-69e9-432d-af79-2af95f2c0889 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:56:35.329050 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-006bae11-69e9-432d-af79-2af95f2c0889 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:56:35.343175 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006bae11-69e9-432d-af79-2af95f2c0889 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:56:35.348118 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16da9402-9151-412b-a3e3-e057325a0143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:56:35.348801 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16da9402-9151-412b-a3e3-e057325a0143 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:56:35.349159 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16da9402-9151-412b-a3e3-e057325a0143 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:56:35.349440 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16da9402-9151-412b-a3e3-e057325a0143 admin admin] PATH_INFO: `/v3/projects/2f0f03f300d4442987ddeafa78e101bf` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:56:35.350628 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16da9402-9151-412b-a3e3-e057325a0143 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f0f03f300d4442987ddeafa78e101bf)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:56:35.352586 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16da9402-9151-412b-a3e3-e057325a0143 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:56:35.460247 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:56:35.469412 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-16da9402-9151-412b-a3e3-e057325a0143 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f0f03f300d4442987ddeafa78e101bf', 'request_id': 'req-16da9402-9151-412b-a3e3-e057325a0143'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:56:35.579724 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-16da9402-9151-412b-a3e3-e057325a0143 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f0f03f300d4442987ddeafa78e101bf', 'request_id': 'req-16da9402-9151-412b-a3e3-e057325a0143'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:56:35.587097 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-16da9402-9151-412b-a3e3-e057325a0143 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f0f03f300d4442987ddeafa78e101bf', 'request_id': 'req-16da9402-9151-412b-a3e3-e057325a0143'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:56:35.597657 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-16da9402-9151-412b-a3e3-e057325a0143 admin admin] The token cache is being invalidate because project 2f0f03f300d4442987ddeafa78e101bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80353) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 15:56:35.597968 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-16da9402-9151-412b-a3e3-e057325a0143 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:56:35.598596 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-16da9402-9151-412b-a3e3-e057325a0143 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:56:35.600124 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1432/2881] 10.222.0.102 () {58 vars in 1238 bytes} [Mon Aug 1 15:56:35 2022] DELETE /identity/v3/projects/2f0f03f300d4442987ddeafa78e101bf => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:56:35.605084 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bc4cdc-5e53-4921-afd3-c6f745a16fdd None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:56:35.605607 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bc4cdc-5e53-4921-afd3-c6f745a16fdd None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:56:35.605607 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bc4cdc-5e53-4921-afd3-c6f745a16fdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:56:35.625643 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-14bc4cdc-5e53-4921-afd3-c6f745a16fdd None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:56:35.626864 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-14bc4cdc-5e53-4921-afd3-c6f745a16fdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:56:35.687110 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1450/2882] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:56:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:56:35.694838 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cff8f5-8532-4c46-ac80-34d9b1221e28 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:56:35.695124 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cff8f5-8532-4c46-ac80-34d9b1221e28 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:56:35.695397 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cff8f5-8532-4c46-ac80-34d9b1221e28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:56:35.715161 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-b1cff8f5-8532-4c46-ac80-34d9b1221e28 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:56:35.716364 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-b1cff8f5-8532-4c46-ac80-34d9b1221e28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:56:35.724494 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1433/2883] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:56:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:56:35.728785 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bc4cdc-5e53-4921-afd3-c6f745a16fdd None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:56:35.739127 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bc4cdc-5e53-4921-afd3-c6f745a16fdd None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:56:35.743785 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2d6aca-fa41-42ab-a4dd-5ea0a9226f73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:56:35.744394 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2d6aca-fa41-42ab-a4dd-5ea0a9226f73 admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:56:35.744676 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2d6aca-fa41-42ab-a4dd-5ea0a9226f73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:56:35.745007 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2d6aca-fa41-42ab-a4dd-5ea0a9226f73 admin admin] PATH_INFO: `/v3/domains` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:56:35.745699 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2d6aca-fa41-42ab-a4dd-5ea0a9226f73 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:56:35.746004 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2d6aca-fa41-42ab-a4dd-5ea0a9226f73 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:56:35.747691 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2d6aca-fa41-42ab-a4dd-5ea0a9226f73 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:56:35.759510 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1451/2884] 10.222.0.102 () {58 vars in 1158 bytes} [Mon Aug 1 15:56:35 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 15:56:35.763792 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cff8f5-8532-4c46-ac80-34d9b1221e28 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:56:35.773702 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cff8f5-8532-4c46-ac80-34d9b1221e28 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:56:35.778446 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62e72c7-6427-4f2c-aed0-8c4e93365421 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:56:35.779048 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62e72c7-6427-4f2c-aed0-8c4e93365421 admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:56:35.779327 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62e72c7-6427-4f2c-aed0-8c4e93365421 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:56:35.779600 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62e72c7-6427-4f2c-aed0-8c4e93365421 admin admin] PATH_INFO: `/v3/projects` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:56:35.780266 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62e72c7-6427-4f2c-aed0-8c4e93365421 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:56:35.782205 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62e72c7-6427-4f2c-aed0-8c4e93365421 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:56:35.876540 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1434/2885] 10.222.0.102 () {60 vars in 1158 bytes} [Mon Aug 1 15:56:35 2022] POST /identity/v3/projects => generated 370 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 15:56:35.877444 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2d6aca-fa41-42ab-a4dd-5ea0a9226f73 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:56:35.887844 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2d6aca-fa41-42ab-a4dd-5ea0a9226f73 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:56:35.947497 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729cef1f-3db1-4955-a60e-22828311c878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:56:35.948173 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729cef1f-3db1-4955-a60e-22828311c878 admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:56:35.948459 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729cef1f-3db1-4955-a60e-22828311c878 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:56:35.948733 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729cef1f-3db1-4955-a60e-22828311c878 admin admin] PATH_INFO: `/v3/users` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:56:35.949427 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729cef1f-3db1-4955-a60e-22828311c878 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:56:35.951419 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729cef1f-3db1-4955-a60e-22828311c878 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:56:35.962031 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:56:36.048974 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1452/2886] 10.222.0.102 () {60 vars in 1149 bytes} [Mon Aug 1 15:56:35 2022] POST /identity/v3/users => generated 286 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:56:36.051213 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62e72c7-6427-4f2c-aed0-8c4e93365421 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:56:36.062022 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62e72c7-6427-4f2c-aed0-8c4e93365421 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:56:36.067427 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2ae093-1a79-4aad-be41-4570e16b1ac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:56:36.072372 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2ae093-1a79-4aad-be41-4570e16b1ac9 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:56:36.072372 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2ae093-1a79-4aad-be41-4570e16b1ac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:56:36.072372 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2ae093-1a79-4aad-be41-4570e16b1ac9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:56:36.072372 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2ae093-1a79-4aad-be41-4570e16b1ac9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:56:36.072372 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2ae093-1a79-4aad-be41-4570e16b1ac9 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:56:36.082458 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1435/2887] 10.222.0.102 () {58 vars in 1127 bytes} [Mon Aug 1 15:56:36 2022] GET /identity/v3/roles => generated 1427 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 15:56:36.086485 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729cef1f-3db1-4955-a60e-22828311c878 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:56:36.096863 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729cef1f-3db1-4955-a60e-22828311c878 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:56:36.102177 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c69aa7-bf33-4577-a3ce-55fb8dcb52e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:56:36.102849 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c69aa7-bf33-4577-a3ce-55fb8dcb52e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:56:36.103146 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c69aa7-bf33-4577-a3ce-55fb8dcb52e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:56:36.103422 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c69aa7-bf33-4577-a3ce-55fb8dcb52e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:56:36.104170 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c69aa7-bf33-4577-a3ce-55fb8dcb52e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:56:36.105925 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c69aa7-bf33-4577-a3ce-55fb8dcb52e8 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:56:36.117264 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1453/2888] 10.222.0.102 () {58 vars in 1127 bytes} [Mon Aug 1 15:56:36 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 15:56:36.121624 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2ae093-1a79-4aad-be41-4570e16b1ac9 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:56:36.135606 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2ae093-1a79-4aad-be41-4570e16b1ac9 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:56:36.137414 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4da45b0-574b-47b2-aa0b-931aaf05ee81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:56:36.138085 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4da45b0-574b-47b2-aa0b-931aaf05ee81 admin admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:56:36.138369 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4da45b0-574b-47b2-aa0b-931aaf05ee81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:56:36.138644 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4da45b0-574b-47b2-aa0b-931aaf05ee81 admin admin] PATH_INFO: `/v3/projects/cc4d918458e34e8b88194dc595ad8ed2/users/c19ac030e0624976859c909294487371/roles/27f5093ac0674d799cdbd17c68482e32` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:56:36.155440 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4da45b0-574b-47b2-aa0b-931aaf05ee81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc4d918458e34e8b88194dc595ad8ed2, user_id=c19ac030e0624976859c909294487371, role_id=27f5093ac0674d799cdbd17c68482e32)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:56:36.158105 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4da45b0-574b-47b2-aa0b-931aaf05ee81 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:56:36.255419 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1436/2889] 10.222.0.102 () {60 vars in 1488 bytes} [Mon Aug 1 15:56:36 2022] PUT /identity/v3/projects/cc4d918458e34e8b88194dc595ad8ed2/users/c19ac030e0624976859c909294487371/roles/27f5093ac0674d799cdbd17c68482e32 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 15:56:36.266677 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c40e3a-7296-4644-acef-9630755dc899 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:56:36.266959 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c40e3a-7296-4644-acef-9630755dc899 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:56:36.267227 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c40e3a-7296-4644-acef-9630755dc899 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:56:36.295352 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-d2c40e3a-7296-4644-acef-9630755dc899 None None] MFA Rules not processed for user `c19ac030e0624976859c909294487371`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:56:36.296564 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-d2c40e3a-7296-4644-acef-9630755dc899 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:56:36.365727 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1454/2890] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:56:36 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:56:36.382903 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4da45b0-574b-47b2-aa0b-931aaf05ee81 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:56:36.384742 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-e4da45b0-574b-47b2-aa0b-931aaf05ee81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:56:36.444883 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4da45b0-574b-47b2-aa0b-931aaf05ee81 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:56:36.448614 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db93002-4fb1-4c37-b3dd-4c6d6860403b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '613da2657ae34558b355cac53c8bf29a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:56:36.449275 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db93002-4fb1-4c37-b3dd-4c6d6860403b service glance] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:56:36.449583 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db93002-4fb1-4c37-b3dd-4c6d6860403b service glance] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:56:36.449857 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db93002-4fb1-4c37-b3dd-4c6d6860403b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:56:36.459595 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db93002-4fb1-4c37-b3dd-4c6d6860403b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:56:36.461171 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db93002-4fb1-4c37-b3dd-4c6d6860403b service glance] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:56:36.474087 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1437/2891] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:56:36 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 15:56:38.305705 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c40e3a-7296-4644-acef-9630755dc899 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:56:38.309245 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-d2c40e3a-7296-4644-acef-9630755dc899 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:56:38.417894 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c40e3a-7296-4644-acef-9630755dc899 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:56:38.424095 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b4fab2-3913-477e-919b-1d84f1f747af service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77b43f1ee8cc4be3907a494abe90c1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:56:38.425296 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b4fab2-3913-477e-919b-1d84f1f747af service nova] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:56:38.425580 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b4fab2-3913-477e-919b-1d84f1f747af service nova] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:56:38.425858 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b4fab2-3913-477e-919b-1d84f1f747af service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:56:38.427792 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-d1b4fab2-3913-477e-919b-1d84f1f747af service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:56:38.441580 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b4fab2-3913-477e-919b-1d84f1f747af service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:56:38.443226 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b4fab2-3913-477e-919b-1d84f1f747af service nova] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:56:38.454493 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1455/2892] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:56:38 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:56:42.328410 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db93002-4fb1-4c37-b3dd-4c6d6860403b service glance] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:56:42.329861 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-2db93002-4fb1-4c37-b3dd-4c6d6860403b service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:56:42.388258 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db93002-4fb1-4c37-b3dd-4c6d6860403b service glance] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:56:42.391906 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65df91a2-dd5b-4ea7-a613-69f3c8fa3feb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a856a413100443939fe9b10daa868518', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:56:42.392524 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65df91a2-dd5b-4ea7-a613-69f3c8fa3feb service neutron] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:56:42.392806 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65df91a2-dd5b-4ea7-a613-69f3c8fa3feb service neutron] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:56:42.393636 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65df91a2-dd5b-4ea7-a613-69f3c8fa3feb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:56:42.395418 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-65df91a2-dd5b-4ea7-a613-69f3c8fa3feb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:56:42.410155 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:DELETE=5,keystone:SELECT=92,keystone:INSERT=3 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:56:42.464333 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65df91a2-dd5b-4ea7-a613-69f3c8fa3feb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:56:42.465897 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65df91a2-dd5b-4ea7-a613-69f3c8fa3feb service neutron] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:56:42.477018 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1438/2893] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:56:42 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:56:46.310411 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b4fab2-3913-477e-919b-1d84f1f747af service nova] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:56:46.311849 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-d1b4fab2-3913-477e-919b-1d84f1f747af service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:56:46.374677 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:56:46.379438 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b4fab2-3913-477e-919b-1d84f1f747af service nova] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:56:46.384298 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb815fc-5abb-4929-be8e-12955838022b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:56:46.385496 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb815fc-5abb-4929-be8e-12955838022b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:56:46.387397 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb815fc-5abb-4929-be8e-12955838022b admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:56:46.387397 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb815fc-5abb-4929-be8e-12955838022b admin admin] PATH_INFO: `/v3/users/1a12e93026eb42849e473fe8d82e2a5e` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:56:46.387397 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb815fc-5abb-4929-be8e-12955838022b admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a12e93026eb42849e473fe8d82e2a5e)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:56:46.389379 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb815fc-5abb-4929-be8e-12955838022b admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:56:46.613670 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-1cb815fc-5abb-4929-be8e-12955838022b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a12e93026eb42849e473fe8d82e2a5e'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:56:46.626001 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-1cb815fc-5abb-4929-be8e-12955838022b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a12e93026eb42849e473fe8d82e2a5e'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:56:46.634225 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-1cb815fc-5abb-4929-be8e-12955838022b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a12e93026eb42849e473fe8d82e2a5e'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:56:46.634988 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-1cb815fc-5abb-4929-be8e-12955838022b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a12e93026eb42849e473fe8d82e2a5e'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:56:46.635597 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-1cb815fc-5abb-4929-be8e-12955838022b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a12e93026eb42849e473fe8d82e2a5e'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:56:46.705643 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1456/2894] 10.222.0.102 () {58 vars in 1229 bytes} [Mon Aug 1 15:56:46 2022] DELETE /identity/v3/users/1a12e93026eb42849e473fe8d82e2a5e => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:56:46.964394 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65df91a2-dd5b-4ea7-a613-69f3c8fa3feb service neutron] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:56:46.978687 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65df91a2-dd5b-4ea7-a613-69f3c8fa3feb service neutron] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:56:47.038892 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527f2a7d-c226-41de-bd33-3add7d5c0500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:56:47.039673 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527f2a7d-c226-41de-bd33-3add7d5c0500 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:56:47.039954 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527f2a7d-c226-41de-bd33-3add7d5c0500 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:56:47.040228 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527f2a7d-c226-41de-bd33-3add7d5c0500 admin admin] PATH_INFO: `/v3/projects/09d821cdd63f4fdcafad2f1781a9bf5e` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:56:47.041515 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527f2a7d-c226-41de-bd33-3add7d5c0500 admin admin] RBAC: Authorizing `identity:delete_project(project_id=09d821cdd63f4fdcafad2f1781a9bf5e)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:56:47.043487 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527f2a7d-c226-41de-bd33-3add7d5c0500 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:56:47.196082 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-527f2a7d-c226-41de-bd33-3add7d5c0500 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09d821cdd63f4fdcafad2f1781a9bf5e', 'request_id': 'req-527f2a7d-c226-41de-bd33-3add7d5c0500'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:56:47.270750 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-527f2a7d-c226-41de-bd33-3add7d5c0500 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09d821cdd63f4fdcafad2f1781a9bf5e', 'request_id': 'req-527f2a7d-c226-41de-bd33-3add7d5c0500'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:56:47.277938 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-527f2a7d-c226-41de-bd33-3add7d5c0500 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09d821cdd63f4fdcafad2f1781a9bf5e', 'request_id': 'req-527f2a7d-c226-41de-bd33-3add7d5c0500'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:56:47.289267 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-527f2a7d-c226-41de-bd33-3add7d5c0500 admin admin] The token cache is being invalidate because project 09d821cdd63f4fdcafad2f1781a9bf5e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80353) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 15:56:47.289582 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-527f2a7d-c226-41de-bd33-3add7d5c0500 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:56:47.290244 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-527f2a7d-c226-41de-bd33-3add7d5c0500 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:56:47.291860 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1439/2895] 10.222.0.102 () {58 vars in 1238 bytes} [Mon Aug 1 15:56:46 2022] DELETE /identity/v3/projects/09d821cdd63f4fdcafad2f1781a9bf5e => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:56:56.701699 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=27,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:56:57.285925 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=73,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:57:06.068963 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb815fc-5abb-4929-be8e-12955838022b admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:57:06.070401 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-1cb815fc-5abb-4929-be8e-12955838022b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:57:06.083284 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb815fc-5abb-4929-be8e-12955838022b admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:57:06.139694 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e4680b-71e5-4812-99c1-10296fd8122b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:57:06.140337 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e4680b-71e5-4812-99c1-10296fd8122b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:57:06.140614 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e4680b-71e5-4812-99c1-10296fd8122b admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:57:06.140965 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e4680b-71e5-4812-99c1-10296fd8122b admin admin] PATH_INFO: `/v3/users/c19ac030e0624976859c909294487371` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:57:06.142105 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e4680b-71e5-4812-99c1-10296fd8122b admin admin] RBAC: Authorizing `identity:delete_user(user_id=c19ac030e0624976859c909294487371)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:57:06.144047 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e4680b-71e5-4812-99c1-10296fd8122b admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:57:06.397939 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-49e4680b-71e5-4812-99c1-10296fd8122b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c19ac030e0624976859c909294487371'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:57:06.410702 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-49e4680b-71e5-4812-99c1-10296fd8122b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c19ac030e0624976859c909294487371'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:57:06.417731 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-49e4680b-71e5-4812-99c1-10296fd8122b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c19ac030e0624976859c909294487371'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:57:06.418415 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-49e4680b-71e5-4812-99c1-10296fd8122b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c19ac030e0624976859c909294487371'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:57:06.419024 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-49e4680b-71e5-4812-99c1-10296fd8122b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c19ac030e0624976859c909294487371'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:57:06.491384 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1457/2896] 10.222.0.102 () {58 vars in 1229 bytes} [Mon Aug 1 15:57:06 2022] DELETE /identity/v3/users/c19ac030e0624976859c909294487371 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:57:06.496078 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51c5d27-6047-4356-be11-9f32ff3fdaed None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:57:06.496585 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51c5d27-6047-4356-be11-9f32ff3fdaed None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:57:06.496696 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51c5d27-6047-4356-be11-9f32ff3fdaed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:57:06.529301 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-b51c5d27-6047-4356-be11-9f32ff3fdaed None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:57:06.530625 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-b51c5d27-6047-4356-be11-9f32ff3fdaed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:57:06.597907 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1440/2897] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:57:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:57:06.607635 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e4680b-71e5-4812-99c1-10296fd8122b admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:57:06.609086 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-49e4680b-71e5-4812-99c1-10296fd8122b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:57:06.665783 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e4680b-71e5-4812-99c1-10296fd8122b admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:57:06.669498 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4d77f2-6c4c-4770-a611-cb2e17784f43 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a856a413100443939fe9b10daa868518', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:57:06.670154 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4d77f2-6c4c-4770-a611-cb2e17784f43 service neutron] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:57:06.670431 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4d77f2-6c4c-4770-a611-cb2e17784f43 service neutron] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:57:06.670701 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4d77f2-6c4c-4770-a611-cb2e17784f43 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:57:06.680381 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4d77f2-6c4c-4770-a611-cb2e17784f43 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:57:06.682102 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4d77f2-6c4c-4770-a611-cb2e17784f43 service neutron] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:57:06.691617 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1458/2898] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:57:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:57:07.114989 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51c5d27-6047-4356-be11-9f32ff3fdaed None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:57:07.116575 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-b51c5d27-6047-4356-be11-9f32ff3fdaed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:57:07.129643 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51c5d27-6047-4356-be11-9f32ff3fdaed None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:57:07.134363 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751f8c66-ca61-44dd-8674-050bb10004b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:57:07.135263 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751f8c66-ca61-44dd-8674-050bb10004b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:57:07.135541 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751f8c66-ca61-44dd-8674-050bb10004b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:57:07.135814 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751f8c66-ca61-44dd-8674-050bb10004b9 admin admin] PATH_INFO: `/v3/projects/cc4d918458e34e8b88194dc595ad8ed2` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:57:07.137025 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751f8c66-ca61-44dd-8674-050bb10004b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc4d918458e34e8b88194dc595ad8ed2)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:57:07.139011 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751f8c66-ca61-44dd-8674-050bb10004b9 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:57:07.291177 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-751f8c66-ca61-44dd-8674-050bb10004b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc4d918458e34e8b88194dc595ad8ed2', 'request_id': 'req-751f8c66-ca61-44dd-8674-050bb10004b9'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:57:07.418882 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-751f8c66-ca61-44dd-8674-050bb10004b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc4d918458e34e8b88194dc595ad8ed2', 'request_id': 'req-751f8c66-ca61-44dd-8674-050bb10004b9'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:57:07.425750 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-751f8c66-ca61-44dd-8674-050bb10004b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc4d918458e34e8b88194dc595ad8ed2', 'request_id': 'req-751f8c66-ca61-44dd-8674-050bb10004b9'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:57:07.437068 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-751f8c66-ca61-44dd-8674-050bb10004b9 admin admin] The token cache is being invalidate because project cc4d918458e34e8b88194dc595ad8ed2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80353) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 15:57:07.437351 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-751f8c66-ca61-44dd-8674-050bb10004b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:57:07.437979 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-751f8c66-ca61-44dd-8674-050bb10004b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:57:07.439602 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1441/2899] 10.222.0.102 () {58 vars in 1238 bytes} [Mon Aug 1 15:57:07 2022] DELETE /identity/v3/projects/cc4d918458e34e8b88194dc595ad8ed2 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:57:07.445118 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca4adc8-3451-4dbf-9c62-8fb31c3f7e31 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:57:07.445584 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca4adc8-3451-4dbf-9c62-8fb31c3f7e31 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:57:07.445729 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca4adc8-3451-4dbf-9c62-8fb31c3f7e31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:57:07.466526 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-7ca4adc8-3451-4dbf-9c62-8fb31c3f7e31 None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:57:07.467886 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-7ca4adc8-3451-4dbf-9c62-8fb31c3f7e31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:57:07.484672 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:57:07.527505 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1459/2900] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:57:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:57:07.535404 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c079074e-a701-480b-9e79-6d34c37d168f None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:57:07.538915 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c079074e-a701-480b-9e79-6d34c37d168f None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:57:07.538915 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c079074e-a701-480b-9e79-6d34c37d168f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:57:07.560440 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-c079074e-a701-480b-9e79-6d34c37d168f None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:57:07.561642 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-c079074e-a701-480b-9e79-6d34c37d168f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:57:07.572628 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1442/2901] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:57:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:57:07.580242 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca4adc8-3451-4dbf-9c62-8fb31c3f7e31 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:57:07.599010 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca4adc8-3451-4dbf-9c62-8fb31c3f7e31 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:57:07.605029 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031c9719-c465-474a-b1dc-6c9300ae4d4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:57:07.605641 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031c9719-c465-474a-b1dc-6c9300ae4d4c admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:57:07.605917 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031c9719-c465-474a-b1dc-6c9300ae4d4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:57:07.606181 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031c9719-c465-474a-b1dc-6c9300ae4d4c admin admin] PATH_INFO: `/v3/domains` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:57:07.606869 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031c9719-c465-474a-b1dc-6c9300ae4d4c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 15:57:07.607165 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031c9719-c465-474a-b1dc-6c9300ae4d4c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:57:07.608817 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031c9719-c465-474a-b1dc-6c9300ae4d4c admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:57:07.621415 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1460/2902] 10.222.0.102 () {58 vars in 1158 bytes} [Mon Aug 1 15:57:07 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 15:57:07.625798 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c079074e-a701-480b-9e79-6d34c37d168f None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:57:07.635901 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c079074e-a701-480b-9e79-6d34c37d168f None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:57:07.640546 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02a82c5-97c6-4036-9215-9a1fbe413bd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:57:07.647580 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02a82c5-97c6-4036-9215-9a1fbe413bd8 admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:57:07.647580 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02a82c5-97c6-4036-9215-9a1fbe413bd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:57:07.647580 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02a82c5-97c6-4036-9215-9a1fbe413bd8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:57:07.647580 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02a82c5-97c6-4036-9215-9a1fbe413bd8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:57:07.647580 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02a82c5-97c6-4036-9215-9a1fbe413bd8 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:57:07.734341 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1443/2903] 10.222.0.102 () {60 vars in 1158 bytes} [Mon Aug 1 15:57:07 2022] POST /identity/v3/projects => generated 398 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:57:07.738938 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031c9719-c465-474a-b1dc-6c9300ae4d4c admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:57:07.749104 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031c9719-c465-474a-b1dc-6c9300ae4d4c admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:57:07.805231 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29ae6af-fff7-465e-889c-1c3f1e343c69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:57:07.805839 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29ae6af-fff7-465e-889c-1c3f1e343c69 admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:57:07.806120 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29ae6af-fff7-465e-889c-1c3f1e343c69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:57:07.806653 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29ae6af-fff7-465e-889c-1c3f1e343c69 admin admin] PATH_INFO: `/v3/users` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:57:07.807328 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29ae6af-fff7-465e-889c-1c3f1e343c69 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:57:07.809282 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29ae6af-fff7-465e-889c-1c3f1e343c69 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:57:07.939282 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1461/2904] 10.222.0.102 () {60 vars in 1149 bytes} [Mon Aug 1 15:57:07 2022] POST /identity/v3/users => generated 300 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 15:57:07.943474 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02a82c5-97c6-4036-9215-9a1fbe413bd8 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:57:07.954257 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02a82c5-97c6-4036-9215-9a1fbe413bd8 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:57:07.959073 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fece2f7-8df6-43cd-8e94-09837686eff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:57:07.961531 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fece2f7-8df6-43cd-8e94-09837686eff4 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:57:07.961531 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fece2f7-8df6-43cd-8e94-09837686eff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:57:07.961531 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fece2f7-8df6-43cd-8e94-09837686eff4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:57:07.961531 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fece2f7-8df6-43cd-8e94-09837686eff4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:57:07.962637 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fece2f7-8df6-43cd-8e94-09837686eff4 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:57:07.973196 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1444/2905] 10.222.0.102 () {58 vars in 1127 bytes} [Mon Aug 1 15:57:07 2022] GET /identity/v3/roles => generated 1427 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:57:07.977168 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29ae6af-fff7-465e-889c-1c3f1e343c69 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:57:07.987972 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29ae6af-fff7-465e-889c-1c3f1e343c69 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:57:07.992554 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fc9987-8b0a-41a8-9258-de2833682838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:57:07.993189 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fc9987-8b0a-41a8-9258-de2833682838 admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:57:07.993496 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fc9987-8b0a-41a8-9258-de2833682838 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:57:07.993772 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fc9987-8b0a-41a8-9258-de2833682838 admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:57:07.994462 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fc9987-8b0a-41a8-9258-de2833682838 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:57:07.996057 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fc9987-8b0a-41a8-9258-de2833682838 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:57:08.006554 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1462/2906] 10.222.0.102 () {58 vars in 1127 bytes} [Mon Aug 1 15:57:07 2022] GET /identity/v3/roles => generated 1427 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 15:57:08.010642 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fece2f7-8df6-43cd-8e94-09837686eff4 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:57:08.021498 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fece2f7-8df6-43cd-8e94-09837686eff4 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:57:08.026025 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55ff8da-d424-4eaa-b0c5-91eed375caaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:57:08.026676 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55ff8da-d424-4eaa-b0c5-91eed375caaf admin admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:57:08.026969 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55ff8da-d424-4eaa-b0c5-91eed375caaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:57:08.027223 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55ff8da-d424-4eaa-b0c5-91eed375caaf admin admin] PATH_INFO: `/v3/projects/7baf4b07ecc041a28aa23c15a91ce7f9/users/c2737cdea30a4c63ae63eb8b67e11069/roles/27f5093ac0674d799cdbd17c68482e32` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:57:08.042247 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55ff8da-d424-4eaa-b0c5-91eed375caaf admin admin] RBAC: Authorizing `identity:create_grant(project_id=7baf4b07ecc041a28aa23c15a91ce7f9, user_id=c2737cdea30a4c63ae63eb8b67e11069, role_id=27f5093ac0674d799cdbd17c68482e32)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:57:08.045007 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55ff8da-d424-4eaa-b0c5-91eed375caaf admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:57:08.138685 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1445/2907] 10.222.0.102 () {60 vars in 1488 bytes} [Mon Aug 1 15:57:08 2022] PUT /identity/v3/projects/7baf4b07ecc041a28aa23c15a91ce7f9/users/c2737cdea30a4c63ae63eb8b67e11069/roles/27f5093ac0674d799cdbd17c68482e32 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:57:08.150220 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c33e50-4001-4a79-86e4-cc4693d0887e None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:57:08.150440 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c33e50-4001-4a79-86e4-cc4693d0887e None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:57:08.150712 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c33e50-4001-4a79-86e4-cc4693d0887e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:57:08.179220 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-c0c33e50-4001-4a79-86e4-cc4693d0887e None None] MFA Rules not processed for user `c2737cdea30a4c63ae63eb8b67e11069`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:57:08.180423 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-c0c33e50-4001-4a79-86e4-cc4693d0887e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:57:08.246126 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1463/2908] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:57:08 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:57:08.257470 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55ff8da-d424-4eaa-b0c5-91eed375caaf admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:57:08.259144 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-d55ff8da-d424-4eaa-b0c5-91eed375caaf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:57:08.281506 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:57:08.318113 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55ff8da-d424-4eaa-b0c5-91eed375caaf admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:57:08.321795 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d45093-c92d-44a0-a590-de248d6f9d51 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff810b37183c4729859c1b05edff1703', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:57:08.324904 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d45093-c92d-44a0-a590-de248d6f9d51 service cinder] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:57:08.324904 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d45093-c92d-44a0-a590-de248d6f9d51 service cinder] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:57:08.324904 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d45093-c92d-44a0-a590-de248d6f9d51 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:57:08.331073 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d45093-c92d-44a0-a590-de248d6f9d51 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:57:08.333091 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d45093-c92d-44a0-a590-de248d6f9d51 service cinder] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:57:08.341955 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1446/2909] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:57:08 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:57:14.329554 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c33e50-4001-4a79-86e4-cc4693d0887e None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:57:14.349711 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:57:14.391899 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c33e50-4001-4a79-86e4-cc4693d0887e None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:57:14.397845 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bca8bb-e41c-44a3-8dbc-ae1391dc1cec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:57:14.398488 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bca8bb-e41c-44a3-8dbc-ae1391dc1cec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:57:14.398770 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bca8bb-e41c-44a3-8dbc-ae1391dc1cec admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:57:14.399041 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bca8bb-e41c-44a3-8dbc-ae1391dc1cec admin admin] PATH_INFO: `/v3/users/c2737cdea30a4c63ae63eb8b67e11069` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:57:14.400219 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bca8bb-e41c-44a3-8dbc-ae1391dc1cec admin admin] RBAC: Authorizing `identity:delete_user(user_id=c2737cdea30a4c63ae63eb8b67e11069)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:57:14.402159 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bca8bb-e41c-44a3-8dbc-ae1391dc1cec admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:57:14.600688 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-c7bca8bb-e41c-44a3-8dbc-ae1391dc1cec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c2737cdea30a4c63ae63eb8b67e11069'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:57:14.612565 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-c7bca8bb-e41c-44a3-8dbc-ae1391dc1cec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c2737cdea30a4c63ae63eb8b67e11069'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:57:14.619461 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-c7bca8bb-e41c-44a3-8dbc-ae1391dc1cec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c2737cdea30a4c63ae63eb8b67e11069'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:57:14.620130 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-c7bca8bb-e41c-44a3-8dbc-ae1391dc1cec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c2737cdea30a4c63ae63eb8b67e11069'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:57:14.620748 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-c7bca8bb-e41c-44a3-8dbc-ae1391dc1cec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c2737cdea30a4c63ae63eb8b67e11069'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:57:14.739191 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1464/2910] 10.222.0.102 () {58 vars in 1229 bytes} [Mon Aug 1 15:57:14 2022] DELETE /identity/v3/users/c2737cdea30a4c63ae63eb8b67e11069 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 15:57:14.743637 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432cde6a-b30d-4830-8981-077a038430ad None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:57:14.744141 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432cde6a-b30d-4830-8981-077a038430ad None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:57:14.744246 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432cde6a-b30d-4830-8981-077a038430ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:57:14.763221 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-432cde6a-b30d-4830-8981-077a038430ad None None] MFA Rules not processed for user `b6b2cd3e98284877b95b595df909c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 15:57:14.764423 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-432cde6a-b30d-4830-8981-077a038430ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:57:14.822362 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1447/2911] 10.222.0.102 () {58 vars in 963 bytes} [Mon Aug 1 15:57:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 15:57:14.832693 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bca8bb-e41c-44a3-8dbc-ae1391dc1cec admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:57:14.834163 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-c7bca8bb-e41c-44a3-8dbc-ae1391dc1cec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:57:14.893609 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bca8bb-e41c-44a3-8dbc-ae1391dc1cec admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:57:14.897937 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010df06b-66ad-4dd5-a971-9469afa5f94f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a856a413100443939fe9b10daa868518', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:57:14.898554 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010df06b-66ad-4dd5-a971-9469afa5f94f service neutron] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:57:14.898834 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010df06b-66ad-4dd5-a971-9469afa5f94f service neutron] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:57:14.899108 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010df06b-66ad-4dd5-a971-9469afa5f94f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:57:14.908148 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010df06b-66ad-4dd5-a971-9469afa5f94f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:57:14.909619 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010df06b-66ad-4dd5-a971-9469afa5f94f service neutron] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:57:14.919142 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1465/2912] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:57:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:57:15.350189 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432cde6a-b30d-4830-8981-077a038430ad None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:57:15.351676 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-432cde6a-b30d-4830-8981-077a038430ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:57:15.364525 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432cde6a-b30d-4830-8981-077a038430ad None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:57:15.369262 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9926e5-0a5e-4d3a-aaf3-556177fd668a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:57:15.369917 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9926e5-0a5e-4d3a-aaf3-556177fd668a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:57:15.370203 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9926e5-0a5e-4d3a-aaf3-556177fd668a admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:57:15.370474 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9926e5-0a5e-4d3a-aaf3-556177fd668a admin admin] PATH_INFO: `/v3/projects/7baf4b07ecc041a28aa23c15a91ce7f9` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:57:15.371758 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9926e5-0a5e-4d3a-aaf3-556177fd668a admin admin] RBAC: Authorizing `identity:delete_project(project_id=7baf4b07ecc041a28aa23c15a91ce7f9)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:57:15.373736 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9926e5-0a5e-4d3a-aaf3-556177fd668a admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:57:15.536710 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-2a9926e5-0a5e-4d3a-aaf3-556177fd668a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7baf4b07ecc041a28aa23c15a91ce7f9', 'request_id': 'req-2a9926e5-0a5e-4d3a-aaf3-556177fd668a'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:57:15.607376 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-2a9926e5-0a5e-4d3a-aaf3-556177fd668a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7baf4b07ecc041a28aa23c15a91ce7f9', 'request_id': 'req-2a9926e5-0a5e-4d3a-aaf3-556177fd668a'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:57:15.615182 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-2a9926e5-0a5e-4d3a-aaf3-556177fd668a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7baf4b07ecc041a28aa23c15a91ce7f9', 'request_id': 'req-2a9926e5-0a5e-4d3a-aaf3-556177fd668a'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:57:15.628246 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-2a9926e5-0a5e-4d3a-aaf3-556177fd668a admin admin] The token cache is being invalidate because project 7baf4b07ecc041a28aa23c15a91ce7f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80353) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 15:57:15.628534 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-2a9926e5-0a5e-4d3a-aaf3-556177fd668a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:57:15.629245 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-2a9926e5-0a5e-4d3a-aaf3-556177fd668a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 15:57:15.630816 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1448/2913] 10.222.0.102 () {58 vars in 1238 bytes} [Mon Aug 1 15:57:15 2022] DELETE /identity/v3/projects/7baf4b07ecc041a28aa23c15a91ce7f9 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 15:57:24.914907 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=71,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:57:25.625168 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=71,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:58:40.705843 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010df06b-66ad-4dd5-a971-9469afa5f94f service neutron] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:58:40.707252 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-010df06b-66ad-4dd5-a971-9469afa5f94f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:58:40.777670 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010df06b-66ad-4dd5-a971-9469afa5f94f service neutron] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:58:40.838008 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a154baff-938c-4d61-a42f-2357686a689b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b78f5749fe9c46a389c88bb9c222cc73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:58:40.838621 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a154baff-938c-4d61-a42f-2357686a689b service placement] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:58:40.838897 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a154baff-938c-4d61-a42f-2357686a689b service placement] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:58:40.839170 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a154baff-938c-4d61-a42f-2357686a689b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:58:40.841020 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-a154baff-938c-4d61-a42f-2357686a689b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:58:40.852759 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a154baff-938c-4d61-a42f-2357686a689b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:58:40.854355 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a154baff-938c-4d61-a42f-2357686a689b service placement] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:58:40.864216 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1466/2914] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:58:40 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:58:50.860055 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=58 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:59:41.307034 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9926e5-0a5e-4d3a-aaf3-556177fd668a admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:41.308838 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-2a9926e5-0a5e-4d3a-aaf3-556177fd668a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:59:41.373648 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9926e5-0a5e-4d3a-aaf3-556177fd668a admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:41.377202 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8475bfc4-a878-46a2-9ba4-2e0bef9607a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a856a413100443939fe9b10daa868518', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:41.377815 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8475bfc4-a878-46a2-9ba4-2e0bef9607a8 service neutron] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:41.378096 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8475bfc4-a878-46a2-9ba4-2e0bef9607a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:41.378922 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8475bfc4-a878-46a2-9ba4-2e0bef9607a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:41.380686 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-8475bfc4-a878-46a2-9ba4-2e0bef9607a8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:59:41.390440 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8475bfc4-a878-46a2-9ba4-2e0bef9607a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:41.391938 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8475bfc4-a878-46a2-9ba4-2e0bef9607a8 service neutron] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:41.400132 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1449/2915] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:59:41 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:59:41.479020 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a154baff-938c-4d61-a42f-2357686a689b service placement] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 15:59:41.488963 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a154baff-938c-4d61-a42f-2357686a689b service placement] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 15:59:41.492569 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d8c9a3-a19d-4d33-9d93-6fa35504ddfa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a856a413100443939fe9b10daa868518', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 15:59:41.493217 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d8c9a3-a19d-4d33-9d93-6fa35504ddfa service neutron] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 15:59:41.493499 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d8c9a3-a19d-4d33-9d93-6fa35504ddfa service neutron] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 15:59:41.493767 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d8c9a3-a19d-4d33-9d93-6fa35504ddfa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 15:59:41.495499 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-f5d8c9a3-a19d-4d33-9d93-6fa35504ddfa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 15:59:41.565449 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d8c9a3-a19d-4d33-9d93-6fa35504ddfa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 15:59:41.566913 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d8c9a3-a19d-4d33-9d93-6fa35504ddfa service neutron] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 15:59:41.577796 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1467/2916] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 15:59:41 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 15:59:51.396508 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=26 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:59:51.573001 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=34 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:00:47.733399 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8475bfc4-a878-46a2-9ba4-2e0bef9607a8 service neutron] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:00:47.742224 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8475bfc4-a878-46a2-9ba4-2e0bef9607a8 service neutron] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:00:47.745795 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fda67e-a731-48ca-854b-cf60a6360fac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a856a413100443939fe9b10daa868518', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:00:47.746398 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fda67e-a731-48ca-854b-cf60a6360fac service neutron] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:00:47.746674 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fda67e-a731-48ca-854b-cf60a6360fac service neutron] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:00:47.746943 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fda67e-a731-48ca-854b-cf60a6360fac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:00:47.748656 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-42fda67e-a731-48ca-854b-cf60a6360fac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:00:47.758670 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fda67e-a731-48ca-854b-cf60a6360fac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:00:47.760080 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fda67e-a731-48ca-854b-cf60a6360fac service neutron] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:00:47.768796 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1450/2917] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 16:00:47 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:00:57.764544 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=6 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:01:37.821622 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d8c9a3-a19d-4d33-9d93-6fa35504ddfa service neutron] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:01:37.830509 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d8c9a3-a19d-4d33-9d93-6fa35504ddfa service neutron] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:01:37.834102 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b30925a-eeb7-4de5-a71c-fd008e46259e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a856a413100443939fe9b10daa868518', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:01:37.834702 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b30925a-eeb7-4de5-a71c-fd008e46259e service neutron] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:01:37.834980 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b30925a-eeb7-4de5-a71c-fd008e46259e service neutron] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:01:37.835250 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b30925a-eeb7-4de5-a71c-fd008e46259e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:01:37.837731 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-3b30925a-eeb7-4de5-a71c-fd008e46259e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:01:37.897084 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b30925a-eeb7-4de5-a71c-fd008e46259e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:01:37.898533 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b30925a-eeb7-4de5-a71c-fd008e46259e service neutron] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:01:37.908256 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1468/2918] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 16:01:37 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:01:38.804980 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fda67e-a731-48ca-854b-cf60a6360fac service neutron] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:01:38.806639 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-42fda67e-a731-48ca-854b-cf60a6360fac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:01:38.824708 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fda67e-a731-48ca-854b-cf60a6360fac service neutron] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:01:38.831671 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c5e9de-200d-4e3b-84e7-852771d37fc9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77b43f1ee8cc4be3907a494abe90c1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:01:38.832749 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c5e9de-200d-4e3b-84e7-852771d37fc9 service nova] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:01:38.833261 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c5e9de-200d-4e3b-84e7-852771d37fc9 service nova] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:01:38.834262 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c5e9de-200d-4e3b-84e7-852771d37fc9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:01:38.838514 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-38c5e9de-200d-4e3b-84e7-852771d37fc9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:01:38.852675 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c5e9de-200d-4e3b-84e7-852771d37fc9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:01:38.854478 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c5e9de-200d-4e3b-84e7-852771d37fc9 service nova] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:01:38.868171 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1451/2919] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 16:01:38 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:01:39.216921 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b30925a-eeb7-4de5-a71c-fd008e46259e service neutron] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:01:39.218470 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-3b30925a-eeb7-4de5-a71c-fd008e46259e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:01:39.229916 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b30925a-eeb7-4de5-a71c-fd008e46259e service neutron] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:01:39.233591 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcdf715-db14-425b-8e7a-05d8de9501f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a856a413100443939fe9b10daa868518', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:01:39.234197 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcdf715-db14-425b-8e7a-05d8de9501f4 service neutron] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:01:39.234474 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcdf715-db14-425b-8e7a-05d8de9501f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:01:39.234776 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcdf715-db14-425b-8e7a-05d8de9501f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:01:39.236479 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-0bcdf715-db14-425b-8e7a-05d8de9501f4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:01:39.250966 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcdf715-db14-425b-8e7a-05d8de9501f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:01:39.252568 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcdf715-db14-425b-8e7a-05d8de9501f4 service neutron] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:01:39.265302 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1469/2920] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 16:01:39 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:01:40.459342 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c5e9de-200d-4e3b-84e7-852771d37fc9 service nova] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:01:40.469764 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c5e9de-200d-4e3b-84e7-852771d37fc9 service nova] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:01:40.473378 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06454ee0-f702-4ed8-bb17-3ba0f855ad83 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a856a413100443939fe9b10daa868518', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:01:40.473983 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06454ee0-f702-4ed8-bb17-3ba0f855ad83 service neutron] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:01:40.474265 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06454ee0-f702-4ed8-bb17-3ba0f855ad83 service neutron] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:01:40.474529 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06454ee0-f702-4ed8-bb17-3ba0f855ad83 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:01:40.476247 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-06454ee0-f702-4ed8-bb17-3ba0f855ad83 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:01:40.490984 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06454ee0-f702-4ed8-bb17-3ba0f855ad83 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:01:40.492398 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06454ee0-f702-4ed8-bb17-3ba0f855ad83 service neutron] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:01:40.503770 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1452/2921] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 16:01:40 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:01:44.263401 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcdf715-db14-425b-8e7a-05d8de9501f4 service neutron] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:01:44.272399 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcdf715-db14-425b-8e7a-05d8de9501f4 service neutron] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:01:44.276116 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36724589-c7c2-4780-8d7e-167ace42f495 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a856a413100443939fe9b10daa868518', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:01:44.276711 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36724589-c7c2-4780-8d7e-167ace42f495 service neutron] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:01:44.277026 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36724589-c7c2-4780-8d7e-167ace42f495 service neutron] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:01:44.277296 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36724589-c7c2-4780-8d7e-167ace42f495 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:01:44.279007 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-36724589-c7c2-4780-8d7e-167ace42f495 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:01:44.341451 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36724589-c7c2-4780-8d7e-167ace42f495 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:01:44.342885 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36724589-c7c2-4780-8d7e-167ace42f495 service neutron] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:01:44.353425 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1470/2922] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 16:01:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 16:01:47.953002 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06454ee0-f702-4ed8-bb17-3ba0f855ad83 service neutron] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:01:47.953743 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-06454ee0-f702-4ed8-bb17-3ba0f855ad83 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:01:47.968548 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06454ee0-f702-4ed8-bb17-3ba0f855ad83 service neutron] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:01:47.973868 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8830bcc-82c9-4c6a-9df6-89a036b74ba6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b78f5749fe9c46a389c88bb9c222cc73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:01:47.974483 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8830bcc-82c9-4c6a-9df6-89a036b74ba6 service placement] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:01:47.974768 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8830bcc-82c9-4c6a-9df6-89a036b74ba6 service placement] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:01:47.975041 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8830bcc-82c9-4c6a-9df6-89a036b74ba6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:01:47.976787 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-b8830bcc-82c9-4c6a-9df6-89a036b74ba6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:01:47.988558 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8830bcc-82c9-4c6a-9df6-89a036b74ba6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:01:47.990179 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8830bcc-82c9-4c6a-9df6-89a036b74ba6 service placement] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:01:48.001205 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1453/2923] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 16:01:47 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:01:51.788453 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36724589-c7c2-4780-8d7e-167ace42f495 service neutron] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:01:51.801955 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36724589-c7c2-4780-8d7e-167ace42f495 service neutron] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:01:51.807012 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029276c1-fcc5-40f1-9a0b-e4d23a4e797d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b78f5749fe9c46a389c88bb9c222cc73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:01:51.809822 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029276c1-fcc5-40f1-9a0b-e4d23a4e797d service placement] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:01:51.809822 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029276c1-fcc5-40f1-9a0b-e4d23a4e797d service placement] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:01:51.809822 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029276c1-fcc5-40f1-9a0b-e4d23a4e797d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:01:51.810109 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-029276c1-fcc5-40f1-9a0b-e4d23a4e797d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:01:51.821961 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029276c1-fcc5-40f1-9a0b-e4d23a4e797d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:01:51.823536 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029276c1-fcc5-40f1-9a0b-e4d23a4e797d service placement] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:01:51.834065 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1471/2924] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 16:01:51 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:01:51.922949 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8830bcc-82c9-4c6a-9df6-89a036b74ba6 service placement] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:01:51.924538 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-b8830bcc-82c9-4c6a-9df6-89a036b74ba6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:01:51.938550 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8830bcc-82c9-4c6a-9df6-89a036b74ba6 service placement] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:01:51.943049 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65932aa4-d251-489a-ae46-7ba2e209656b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:01:51.943785 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65932aa4-d251-489a-ae46-7ba2e209656b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:01:51.944066 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65932aa4-d251-489a-ae46-7ba2e209656b admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:01:51.944367 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65932aa4-d251-489a-ae46-7ba2e209656b admin admin] PATH_INFO: `/v3/users/e12cb37988234aecb973ba456dc1044d` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:01:51.946110 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65932aa4-d251-489a-ae46-7ba2e209656b admin admin] RBAC: Authorizing `identity:delete_user(user_id=e12cb37988234aecb973ba456dc1044d)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:01:51.948077 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65932aa4-d251-489a-ae46-7ba2e209656b admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:01:52.151730 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-65932aa4-d251-489a-ae46-7ba2e209656b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e12cb37988234aecb973ba456dc1044d'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:01:52.254801 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-65932aa4-d251-489a-ae46-7ba2e209656b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e12cb37988234aecb973ba456dc1044d'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:01:52.267931 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-65932aa4-d251-489a-ae46-7ba2e209656b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e12cb37988234aecb973ba456dc1044d'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:01:52.268579 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-65932aa4-d251-489a-ae46-7ba2e209656b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e12cb37988234aecb973ba456dc1044d'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:01:52.269272 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-65932aa4-d251-489a-ae46-7ba2e209656b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e12cb37988234aecb973ba456dc1044d'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:01:52.282541 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1454/2925] 10.222.0.102 () {58 vars in 1229 bytes} [Mon Aug 1 16:01:51 2022] DELETE /identity/v3/users/e12cb37988234aecb973ba456dc1044d => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:01:52.563279 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029276c1-fcc5-40f1-9a0b-e4d23a4e797d service placement] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:01:52.574731 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029276c1-fcc5-40f1-9a0b-e4d23a4e797d service placement] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:01:52.634205 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ccbedd-1767-4bb8-baa8-f009b6834bec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:01:52.634861 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ccbedd-1767-4bb8-baa8-f009b6834bec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:01:52.635144 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ccbedd-1767-4bb8-baa8-f009b6834bec admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:01:52.635420 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ccbedd-1767-4bb8-baa8-f009b6834bec admin admin] PATH_INFO: `/v3/projects/f52ffa471cdc4f4aa652facb29b5526f` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:01:52.636600 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ccbedd-1767-4bb8-baa8-f009b6834bec admin admin] RBAC: Authorizing `identity:delete_project(project_id=f52ffa471cdc4f4aa652facb29b5526f)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:01:52.638669 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ccbedd-1767-4bb8-baa8-f009b6834bec admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:01:52.647604 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:01:52.773828 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-a0ccbedd-1767-4bb8-baa8-f009b6834bec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f52ffa471cdc4f4aa652facb29b5526f', 'request_id': 'req-a0ccbedd-1767-4bb8-baa8-f009b6834bec'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:01:52.780083 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-a0ccbedd-1767-4bb8-baa8-f009b6834bec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f52ffa471cdc4f4aa652facb29b5526f', 'request_id': 'req-a0ccbedd-1767-4bb8-baa8-f009b6834bec'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:01:52.852685 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-a0ccbedd-1767-4bb8-baa8-f009b6834bec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f52ffa471cdc4f4aa652facb29b5526f', 'request_id': 'req-a0ccbedd-1767-4bb8-baa8-f009b6834bec'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:01:52.863457 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-a0ccbedd-1767-4bb8-baa8-f009b6834bec admin admin] The token cache is being invalidate because project f52ffa471cdc4f4aa652facb29b5526f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80352) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 16:01:52.863744 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-a0ccbedd-1767-4bb8-baa8-f009b6834bec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:01:52.864374 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-a0ccbedd-1767-4bb8-baa8-f009b6834bec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:01:52.865945 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1472/2926] 10.222.0.102 () {58 vars in 1238 bytes} [Mon Aug 1 16:01:52 2022] DELETE /identity/v3/projects/f52ffa471cdc4f4aa652facb29b5526f => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:01:52.870855 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65932aa4-d251-489a-ae46-7ba2e209656b admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:01:52.872257 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-65932aa4-d251-489a-ae46-7ba2e209656b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:01:52.885818 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65932aa4-d251-489a-ae46-7ba2e209656b admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:01:52.942369 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c31c69-e664-4f57-a4b1-f3a6cad650be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:01:52.948114 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c31c69-e664-4f57-a4b1-f3a6cad650be admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:01:52.948114 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c31c69-e664-4f57-a4b1-f3a6cad650be admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:01:52.948114 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c31c69-e664-4f57-a4b1-f3a6cad650be admin admin] PATH_INFO: `/v3/users/356251660a26431e95b2e9fd450ad5e1` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:01:52.948114 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c31c69-e664-4f57-a4b1-f3a6cad650be admin admin] RBAC: Authorizing `identity:delete_user(user_id=356251660a26431e95b2e9fd450ad5e1)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:01:52.948114 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c31c69-e664-4f57-a4b1-f3a6cad650be admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:01:53.140105 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:01:53.149616 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-76c31c69-e664-4f57-a4b1-f3a6cad650be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '356251660a26431e95b2e9fd450ad5e1'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:01:53.246433 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-76c31c69-e664-4f57-a4b1-f3a6cad650be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '356251660a26431e95b2e9fd450ad5e1'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:01:53.258618 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-76c31c69-e664-4f57-a4b1-f3a6cad650be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '356251660a26431e95b2e9fd450ad5e1'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:01:53.259259 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-76c31c69-e664-4f57-a4b1-f3a6cad650be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '356251660a26431e95b2e9fd450ad5e1'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:01:53.259872 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-76c31c69-e664-4f57-a4b1-f3a6cad650be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '356251660a26431e95b2e9fd450ad5e1'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:01:53.274262 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1455/2927] 10.222.0.102 () {58 vars in 1229 bytes} [Mon Aug 1 16:01:52 2022] DELETE /identity/v3/users/356251660a26431e95b2e9fd450ad5e1 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:01:53.603025 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ccbedd-1767-4bb8-baa8-f009b6834bec admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:01:53.604512 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-a0ccbedd-1767-4bb8-baa8-f009b6834bec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:01:53.618962 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ccbedd-1767-4bb8-baa8-f009b6834bec admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:01:53.677083 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ac3ef5-9dc9-4eb7-baac-f35e66881a2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b2cd3e98284877b95b595df909c37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba62fb532fd40bd9b79f542e01e21d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:01:53.677721 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ac3ef5-9dc9-4eb7-baac-f35e66881a2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:01:53.677998 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ac3ef5-9dc9-4eb7-baac-f35e66881a2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:01:53.678265 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ac3ef5-9dc9-4eb7-baac-f35e66881a2b admin admin] PATH_INFO: `/v3/projects/481d13e6162c49f3a37b11ca5cc9e7ed` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:01:53.679428 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ac3ef5-9dc9-4eb7-baac-f35e66881a2b admin admin] RBAC: Authorizing `identity:delete_project(project_id=481d13e6162c49f3a37b11ca5cc9e7ed)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:01:53.681869 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ac3ef5-9dc9-4eb7-baac-f35e66881a2b admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:01:53.818143 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-a2ac3ef5-9dc9-4eb7-baac-f35e66881a2b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '481d13e6162c49f3a37b11ca5cc9e7ed', 'request_id': 'req-a2ac3ef5-9dc9-4eb7-baac-f35e66881a2b'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:01:53.825481 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-a2ac3ef5-9dc9-4eb7-baac-f35e66881a2b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '481d13e6162c49f3a37b11ca5cc9e7ed', 'request_id': 'req-a2ac3ef5-9dc9-4eb7-baac-f35e66881a2b'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:01:53.930407 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-a2ac3ef5-9dc9-4eb7-baac-f35e66881a2b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '481d13e6162c49f3a37b11ca5cc9e7ed', 'request_id': 'req-a2ac3ef5-9dc9-4eb7-baac-f35e66881a2b'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:01:53.941406 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-a2ac3ef5-9dc9-4eb7-baac-f35e66881a2b admin admin] The token cache is being invalidate because project 481d13e6162c49f3a37b11ca5cc9e7ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80352) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 16:01:53.941693 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-a2ac3ef5-9dc9-4eb7-baac-f35e66881a2b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:01:53.942316 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-a2ac3ef5-9dc9-4eb7-baac-f35e66881a2b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:01:53.943955 dv-cinder-843277-7-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1473/2928] 10.222.0.102 () {58 vars in 1238 bytes} [Mon Aug 1 16:01:53 2022] DELETE /identity/v3/projects/481d13e6162c49f3a37b11ca5cc9e7ed => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:02:03.338419 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=16,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:02:03.938198 dv-cinder-843277-7-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=72,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:03:44.723448 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c31c69-e664-4f57-a4b1-f3a6cad650be admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:03:44.724867 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-76c31c69-e664-4f57-a4b1-f3a6cad650be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:03:44.862956 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c31c69-e664-4f57-a4b1-f3a6cad650be admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:03:44.923605 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78954a0e-cf52-458c-a437-7ac497af6222 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b78f5749fe9c46a389c88bb9c222cc73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb32fbe631843d8be84d41f8ba88d6e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:03:44.924160 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78954a0e-cf52-458c-a437-7ac497af6222 service placement] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:03:44.924441 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78954a0e-cf52-458c-a437-7ac497af6222 service placement] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:03:44.924712 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78954a0e-cf52-458c-a437-7ac497af6222 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:03:44.926751 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-78954a0e-cf52-458c-a437-7ac497af6222 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:03:44.938511 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78954a0e-cf52-458c-a437-7ac497af6222 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:03:44.940073 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78954a0e-cf52-458c-a437-7ac497af6222 service placement] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:03:44.950070 dv-cinder-843277-7-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1456/2929] 10.222.0.102 () {60 vars in 1370 bytes} [Mon Aug 1 16:03:44 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:03:54.945851 dv-cinder-843277-7-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=89 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}